[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:17:33.384338 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:39859
I20260709 13:17:33.385908 17964 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:17:33.386955 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:33.403365 17970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:33.403409 17971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:33.405678 17964 server_base.cc:1061] running on GCE node
W20260709 13:17:33.415978 17973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:34.588153 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:34.588402 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:34.588663 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603054588634 us; error 0 us; skew 500 ppm
I20260709 13:17:34.589529 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:34.594861 17964 webserver.cc:533] Webserver started at http://127.17.139.62:36075/ using document root <none> and password file <none>
I20260709 13:17:34.595712 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:34.595949 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:34.596405 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:34.602240 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "1513cbba8ae24f8b8b6c10f40f118246"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-z675"
I20260709 13:17:34.610153 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:17:34.615258 17979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.616480 17964 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:17:34.616869 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "1513cbba8ae24f8b8b6c10f40f118246"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-z675"
I20260709 13:17:34.617300 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:34.675164 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:34.676787 17964 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:17:34.677301 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:34.750151 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:39859
I20260709 13:17:34.750263 18030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:39859 every 8 connection(s)
I20260709 13:17:34.757858 18031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:34.780455 18031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246: Bootstrap starting.
I20260709 13:17:34.786793 18031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:34.788802 18031 log.cc:826] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246: Log is configured to *not* fsync() on all Append() calls
I20260709 13:17:34.793561 18031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246: No bootstrap required, opened a new log
I20260709 13:17:34.814822 18031 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1513cbba8ae24f8b8b6c10f40f118246" member_type: VOTER }
I20260709 13:17:34.815399 18031 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:34.815740 18031 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1513cbba8ae24f8b8b6c10f40f118246, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.816717 18031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1513cbba8ae24f8b8b6c10f40f118246" member_type: VOTER }
I20260709 13:17:34.817292 18031 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:34.817610 18031 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:34.818077 18031 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:34.822486 18031 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1513cbba8ae24f8b8b6c10f40f118246" member_type: VOTER }
I20260709 13:17:34.823243 18031 leader_election.cc:304] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1513cbba8ae24f8b8b6c10f40f118246; no voters: 
I20260709 13:17:34.825176 18031 leader_election.cc:290] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:34.825575 18034 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:34.828258 18034 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 1 LEADER]: Becoming Leader. State: Replica: 1513cbba8ae24f8b8b6c10f40f118246, State: Running, Role: LEADER
I20260709 13:17:34.829164 18034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1513cbba8ae24f8b8b6c10f40f118246" member_type: VOTER }
I20260709 13:17:34.830359 18031 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:34.839604 18036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1513cbba8ae24f8b8b6c10f40f118246. Latest consensus state: current_term: 1 leader_uuid: "1513cbba8ae24f8b8b6c10f40f118246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1513cbba8ae24f8b8b6c10f40f118246" member_type: VOTER } }
I20260709 13:17:34.840306 18036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:34.839576 18035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1513cbba8ae24f8b8b6c10f40f118246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1513cbba8ae24f8b8b6c10f40f118246" member_type: VOTER } }
I20260709 13:17:34.841377 18035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:34.843478 18042 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:34.856663 18042 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:34.859123 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:34.874344 18042 catalog_manager.cc:1383] Generated new cluster ID: 68ef75f2df8c48ddac8c24edc192eafd
I20260709 13:17:34.874683 18042 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:34.899837 18042 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:34.901366 18042 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:34.915158 18042 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246: Generated new TSK 0
I20260709 13:17:34.916075 18042 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:34.925551 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:34.934424 18053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:34.936208 18054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:34.939771 17964 server_base.cc:1061] running on GCE node
W20260709 13:17:34.939914 18056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:34.940843 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:34.941140 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:34.941355 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603054941338 us; error 0 us; skew 500 ppm
I20260709 13:17:34.941959 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:34.946622 17964 webserver.cc:533] Webserver started at http://127.17.139.1:38707/ using document root <none> and password file <none>
I20260709 13:17:34.947177 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:34.947410 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:34.947702 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:34.948822 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "7dbbd9fef5644548bf684f059f151ee5"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-z675"
I20260709 13:17:34.954623 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:17:34.959085 18061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.959964 17964 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:17:34.960258 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "7dbbd9fef5644548bf684f059f151ee5"
format_stamp: "Formatted at 2026-07-09 13:17:34 on dist-test-slave-z675"
I20260709 13:17:34.960548 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:34.976308 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:34.977667 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:34.980423 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:34.985018 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:34.985270 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:34.985564 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:34.985715 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:35.093602 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:42651
I20260709 13:17:35.093669 18123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:42651 every 8 connection(s)
I20260709 13:17:35.100597 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:35.110172 18128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:35.112432 18129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:35.123241 18131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:35.125160 18124 heartbeater.cc:344] Connected to a master server at 127.17.139.62:39859
I20260709 13:17:35.125558 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:35.125663 18124 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:35.126492 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:35.126722 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:35.126818 18124 heartbeater.cc:507] Master 127.17.139.62:39859 requested a full tablet report, sending...
I20260709 13:17:35.126931 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603055126912 us; error 0 us; skew 500 ppm
I20260709 13:17:35.127552 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:35.130066 17996 ts_manager.cc:194] Registered new tserver with Master: 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651)
I20260709 13:17:35.131060 17964 webserver.cc:533] Webserver started at http://127.17.139.2:33765/ using document root <none> and password file <none>
I20260709 13:17:35.131783 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:35.132018 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:35.132413 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:35.132440 17996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38964
I20260709 13:17:35.133906 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
format_stamp: "Formatted at 2026-07-09 13:17:35 on dist-test-slave-z675"
I20260709 13:17:35.140355 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:17:35.145385 18136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:35.146198 17964 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:35.146502 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
format_stamp: "Formatted at 2026-07-09 13:17:35 on dist-test-slave-z675"
I20260709 13:17:35.146842 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:35.191136 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:35.192436 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:35.195062 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:35.198495 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:35.198670 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:35.198973 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:35.199121 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:35.301872 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:44329
I20260709 13:17:35.301970 18198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:44329 every 8 connection(s)
I20260709 13:17:35.309187 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:35.318907 18202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:35.324259 18203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:35.324663 18199 heartbeater.cc:344] Connected to a master server at 127.17.139.62:39859
I20260709 13:17:35.325088 18199 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:35.325999 18199 heartbeater.cc:507] Master 127.17.139.62:39859 requested a full tablet report, sending...
I20260709 13:17:35.328341 17996 ts_manager.cc:194] Registered new tserver with Master: 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
W20260709 13:17:35.329057 18205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:35.330224 17996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38976
I20260709 13:17:35.331696 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:35.332783 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:35.333058 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:35.333251 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603055333234 us; error 0 us; skew 500 ppm
I20260709 13:17:35.333931 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:35.336570 17964 webserver.cc:533] Webserver started at http://127.17.139.3:36667/ using document root <none> and password file <none>
I20260709 13:17:35.337177 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:35.337414 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:35.337708 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:35.339131 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
format_stamp: "Formatted at 2026-07-09 13:17:35 on dist-test-slave-z675"
I20260709 13:17:35.344723 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:17:35.348775 18210 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:35.349803 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:17:35.350118 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
format_stamp: "Formatted at 2026-07-09 13:17:35 on dist-test-slave-z675"
I20260709 13:17:35.350440 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:35.371249 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:35.372483 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:35.373905 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:35.376742 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:35.376981 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:17:35.377247 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:35.377426 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:35.467149 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:38971
I20260709 13:17:35.467244 18272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:38971 every 8 connection(s)
I20260709 13:17:35.484709 18273 heartbeater.cc:344] Connected to a master server at 127.17.139.62:39859
I20260709 13:17:35.485126 18273 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:35.485910 18273 heartbeater.cc:507] Master 127.17.139.62:39859 requested a full tablet report, sending...
I20260709 13:17:35.487780 17996 ts_manager.cc:194] Registered new tserver with Master: 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:35.487923 17964 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015661768s
I20260709 13:17:35.489169 17996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38988
I20260709 13:17:35.538995 17996 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38998:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:35.542721 17996 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:35.653548 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 27faddc6920d4d709a0050bb3758bf5d (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:35.655154 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27faddc6920d4d709a0050bb3758bf5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.657966 18163 tablet_service.cc:1511] Processing CreateTablet for tablet efedead5151c48bc98da33aadf5ca280 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:35.659391 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efedead5151c48bc98da33aadf5ca280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.659654 18162 tablet_service.cc:1511] Processing CreateTablet for tablet d8e64e663e034ac9b3b4e8b51a27dac2 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:35.661335 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e64e663e034ac9b3b4e8b51a27dac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.664804 18160 tablet_service.cc:1511] Processing CreateTablet for tablet d2ba71acd8f3492f9dea6092ec53dd0a (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:35.666910 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ba71acd8f3492f9dea6092ec53dd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.668045 18161 tablet_service.cc:1511] Processing CreateTablet for tablet 35984391032a42d6a033774af797d2d7 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:35.671795 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35984391032a42d6a033774af797d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.676469 18159 tablet_service.cc:1511] Processing CreateTablet for tablet d1dd010cc296464bbda60f5915e3569e (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:35.678915 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1dd010cc296464bbda60f5915e3569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.687312 18158 tablet_service.cc:1511] Processing CreateTablet for tablet 18279075f9e64696b85a584e61448e2c (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:35.696532 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18279075f9e64696b85a584e61448e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.693216 18089 tablet_service.cc:1511] Processing CreateTablet for tablet 27faddc6920d4d709a0050bb3758bf5d (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:35.698432 18088 tablet_service.cc:1511] Processing CreateTablet for tablet efedead5151c48bc98da33aadf5ca280 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:35.705128 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efedead5151c48bc98da33aadf5ca280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.705643 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 35984391032a42d6a033774af797d2d7 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:35.702692 18087 tablet_service.cc:1511] Processing CreateTablet for tablet d8e64e663e034ac9b3b4e8b51a27dac2 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:35.709281 18084 tablet_service.cc:1511] Processing CreateTablet for tablet d1dd010cc296464bbda60f5915e3569e (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:35.706724 18085 tablet_service.cc:1511] Processing CreateTablet for tablet d2ba71acd8f3492f9dea6092ec53dd0a (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:35.716140 18083 tablet_service.cc:1511] Processing CreateTablet for tablet 18279075f9e64696b85a584e61448e2c (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:35.716327 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35984391032a42d6a033774af797d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.720829 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1dd010cc296464bbda60f5915e3569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.723906 18089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27faddc6920d4d709a0050bb3758bf5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.727365 18082 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2369e882654da1935ad16bb6979bfb (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:35.727385 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18279075f9e64696b85a584e61448e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.729187 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e64e663e034ac9b3b4e8b51a27dac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.743494 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ba71acd8f3492f9dea6092ec53dd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.747625 18082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2369e882654da1935ad16bb6979bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.747516 18157 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2369e882654da1935ad16bb6979bfb (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:35.752164 18157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2369e882654da1935ad16bb6979bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.798857 18238 tablet_service.cc:1511] Processing CreateTablet for tablet 27faddc6920d4d709a0050bb3758bf5d (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:35.808092 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27faddc6920d4d709a0050bb3758bf5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.814170 18236 tablet_service.cc:1511] Processing CreateTablet for tablet d8e64e663e034ac9b3b4e8b51a27dac2 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:35.820079 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e64e663e034ac9b3b4e8b51a27dac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.814203 18237 tablet_service.cc:1511] Processing CreateTablet for tablet efedead5151c48bc98da33aadf5ca280 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:35.812700 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 35984391032a42d6a033774af797d2d7 (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:35.826582 18233 tablet_service.cc:1511] Processing CreateTablet for tablet d1dd010cc296464bbda60f5915e3569e (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:35.820775 18234 tablet_service.cc:1511] Processing CreateTablet for tablet d2ba71acd8f3492f9dea6092ec53dd0a (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:35.833244 18232 tablet_service.cc:1511] Processing CreateTablet for tablet 18279075f9e64696b85a584e61448e2c (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:35.835064 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efedead5151c48bc98da33aadf5ca280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.852507 18291 tablet_bootstrap.cc:492] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:35.863210 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ba71acd8f3492f9dea6092ec53dd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.871261 18231 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2369e882654da1935ad16bb6979bfb (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:35.870739 18081 tablet_service.cc:1511] Processing CreateTablet for tablet e74a4eaf425e45669e84532813ff527d (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:35.881687 18081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74a4eaf425e45669e84532813ff527d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:35.878147 18044 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:35.897058 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1dd010cc296464bbda60f5915e3569e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.899555 18231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2369e882654da1935ad16bb6979bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.904124 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35984391032a42d6a033774af797d2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.910053 18232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18279075f9e64696b85a584e61448e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.926333 18158 tablet_service.cc:1511] Processing CreateTablet for tablet e74a4eaf425e45669e84532813ff527d (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:35.927599 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74a4eaf425e45669e84532813ff527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.934701 18230 tablet_service.cc:1511] Processing CreateTablet for tablet e74a4eaf425e45669e84532813ff527d (DEFAULT_TABLE table=test-workload [id=0bd6e97caa844a0c9a528bcad39b43fd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:35.938980 18230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74a4eaf425e45669e84532813ff527d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:35.943665 18291 tablet_bootstrap.cc:654] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:35.948123 18292 tablet_bootstrap.cc:492] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.025156 18293 tablet_bootstrap.cc:492] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.029424 18292 tablet_bootstrap.cc:654] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.085454 18291 tablet_bootstrap.cc:492] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.085947 18291 ts_tablet_manager.cc:1403] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.254s	user 0.016s	sys 0.010s
I20260709 13:17:36.090850 18291 raft_consensus.cc:359] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.091732 18291 raft_consensus.cc:385] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.092029 18291 raft_consensus.cc:740] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.093582 18291 consensus_queue.cc:260] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.100109 18293 tablet_bootstrap.cc:654] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.106024 18292 tablet_bootstrap.cc:492] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.106441 18292 ts_tablet_manager.cc:1403] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.169s	user 0.007s	sys 0.021s
I20260709 13:17:36.109238 18199 heartbeater.cc:499] Master 127.17.139.62:39859 was elected leader, sending a full tablet report...
I20260709 13:17:36.109025 18292 raft_consensus.cc:359] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.109776 18292 raft_consensus.cc:385] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.110086 18292 raft_consensus.cc:740] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.110623 18291 ts_tablet_manager.cc:1434] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
I20260709 13:17:36.111181 18292 consensus_queue.cc:260] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.111781 18291 tablet_bootstrap.cc:492] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.121080 18291 tablet_bootstrap.cc:654] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.125135 18293 tablet_bootstrap.cc:492] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.125589 18293 ts_tablet_manager.cc:1403] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.004s
I20260709 13:17:36.135579 18124 heartbeater.cc:499] Master 127.17.139.62:39859 was elected leader, sending a full tablet report...
I20260709 13:17:36.128332 18293 raft_consensus.cc:359] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.149529 18293 raft_consensus.cc:385] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.149859 18293 raft_consensus.cc:740] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.151868 18293 consensus_queue.cc:260] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.159364 18273 heartbeater.cc:499] Master 127.17.139.62:39859 was elected leader, sending a full tablet report...
I20260709 13:17:36.161092 18292 ts_tablet_manager.cc:1434] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.054s	user 0.020s	sys 0.034s
I20260709 13:17:36.161636 18300 raft_consensus.cc:493] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.162037 18292 tablet_bootstrap.cc:492] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.162914 18293 ts_tablet_manager.cc:1434] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:17:36.165680 18293 tablet_bootstrap.cc:492] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.164345 18300 raft_consensus.cc:515] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.168398 18300 leader_election.cc:290] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:36.163946 18291 tablet_bootstrap.cc:492] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.177722 18291 ts_tablet_manager.cc:1403] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.020s
I20260709 13:17:36.188371 18292 tablet_bootstrap.cc:654] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.194576 18291 raft_consensus.cc:359] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.195580 18291 raft_consensus.cc:385] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.195962 18291 raft_consensus.cc:740] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.197611 18291 consensus_queue.cc:260] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.200381 18291 ts_tablet_manager.cc:1434] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:17:36.201342 18291 tablet_bootstrap.cc:492] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.205868 18293 tablet_bootstrap.cc:654] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.220726 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
W20260709 13:17:36.222491 18212 leader_election.cc:343] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:36.224572 18274 tablet.cc:2406] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:36.227840 18291 tablet_bootstrap.cc:654] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.231015 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
W20260709 13:17:36.232649 18211 leader_election.cc:343] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.233140 18211 leader_election.cc:304] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43; no voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:36.233986 18300 raft_consensus.cc:2749] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:36.234779 18293 tablet_bootstrap.cc:492] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.235167 18293 ts_tablet_manager.cc:1403] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.005s
I20260709 13:17:36.237193 18292 tablet_bootstrap.cc:492] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.237699 18292 ts_tablet_manager.cc:1403] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.009s
I20260709 13:17:36.237985 18293 raft_consensus.cc:359] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.238700 18293 raft_consensus.cc:385] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.238840 18291 tablet_bootstrap.cc:492] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.239025 18293 raft_consensus.cc:740] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.239295 18291 ts_tablet_manager.cc:1403] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.009s
I20260709 13:17:36.239768 18293 consensus_queue.cc:260] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.241009 18292 raft_consensus.cc:359] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.241771 18292 raft_consensus.cc:385] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.242353 18293 ts_tablet_manager.cc:1434] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:36.242272 18292 raft_consensus.cc:740] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.242002 18291 raft_consensus.cc:359] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.243270 18293 tablet_bootstrap.cc:492] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.243499 18291 raft_consensus.cc:385] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.244319 18291 raft_consensus.cc:740] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.243270 18292 consensus_queue.cc:260] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.245116 18291 consensus_queue.cc:260] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.249672 18292 ts_tablet_manager.cc:1434] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:17:36.250669 18292 tablet_bootstrap.cc:492] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.253736 18291 ts_tablet_manager.cc:1434] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:17:36.256986 18291 tablet_bootstrap.cc:492] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.261320 18292 tablet_bootstrap.cc:654] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.257059 18293 tablet_bootstrap.cc:654] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.263955 18291 tablet_bootstrap.cc:654] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.281478 18296 raft_consensus.cc:493] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.282111 18296 raft_consensus.cc:515] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.284726 18296 leader_election.cc:290] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.285638 18291 tablet_bootstrap.cc:492] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.286087 18291 ts_tablet_manager.cc:1403] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.009s
I20260709 13:17:36.289083 18291 raft_consensus.cc:359] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.289786 18291 raft_consensus.cc:385] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.290093 18291 raft_consensus.cc:740] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.290868 18291 consensus_queue.cc:260] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.298750 18292 tablet_bootstrap.cc:492] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.299227 18293 tablet_bootstrap.cc:492] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.299651 18293 ts_tablet_manager.cc:1403] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.057s	user 0.004s	sys 0.011s
I20260709 13:17:36.300307 18291 ts_tablet_manager.cc:1434] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:17:36.302882 18293 raft_consensus.cc:359] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.303614 18291 tablet_bootstrap.cc:492] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.299201 18292 ts_tablet_manager.cc:1403] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.008s
I20260709 13:17:36.304067 18293 raft_consensus.cc:385] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.304426 18293 raft_consensus.cc:740] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.305317 18293 consensus_queue.cc:260] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.310796 18293 ts_tablet_manager.cc:1434] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:36.311704 18291 tablet_bootstrap.cc:654] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.308717 18292 raft_consensus.cc:359] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.312112 18292 raft_consensus.cc:385] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.312479 18292 raft_consensus.cc:740] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.313398 18292 consensus_queue.cc:260] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.318037 18292 ts_tablet_manager.cc:1434] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:17:36.323764 18292 tablet_bootstrap.cc:492] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.328173 18291 tablet_bootstrap.cc:492] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.311825 18293 tablet_bootstrap.cc:492] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.328678 18291 ts_tablet_manager.cc:1403] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.011s
I20260709 13:17:36.331756 18291 raft_consensus.cc:359] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.332640 18291 raft_consensus.cc:385] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.332954 18291 raft_consensus.cc:740] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.333838 18291 consensus_queue.cc:260] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.335335 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.336796 18293 tablet_bootstrap.cc:654] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:36.336827 18137 leader_election.cc:343] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.338613 18291 ts_tablet_manager.cc:1434] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:17:36.342983 18291 tablet_bootstrap.cc:492] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.344590 18292 tablet_bootstrap.cc:654] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.345145 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.346781 18296 raft_consensus.cc:493] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.347259 18296 raft_consensus.cc:515] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
W20260709 13:17:36.347687 18137 leader_election.cc:343] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.348133 18137 leader_election.cc:304] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:36.349334 18296 leader_election.cc:290] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.349912 18296 raft_consensus.cc:2749] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:36.354159 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.354744 18099 raft_consensus.cc:2468] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 0.
I20260709 13:17:36.355923 18291 tablet_bootstrap.cc:654] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.356890 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.357029 18137 leader_election.cc:304] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.357921 18316 raft_consensus.cc:2804] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.358352 18316 raft_consensus.cc:493] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.358673 18316 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.361482 18292 tablet_bootstrap.cc:492] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.363678 18292 ts_tablet_manager.cc:1403] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.003s
I20260709 13:17:36.366215 18316 raft_consensus.cc:515] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.368166 18316 leader_election.cc:290] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.370182 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:36.370723 18099 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.370864 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
W20260709 13:17:36.372263 18137 leader_election.cc:343] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:36.373230 18137 leader_election.cc:343] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.372133 18292 raft_consensus.cc:359] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.374215 18292 raft_consensus.cc:385] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.374516 18292 raft_consensus.cc:740] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.375439 18291 tablet_bootstrap.cc:492] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.375211 18292 consensus_queue.cc:260] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.375973 18291 ts_tablet_manager.cc:1403] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.011s
I20260709 13:17:36.377668 18292 ts_tablet_manager.cc:1434] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:17:36.378573 18292 tablet_bootstrap.cc:492] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.378960 18291 raft_consensus.cc:359] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.379678 18291 raft_consensus.cc:385] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.380010 18291 raft_consensus.cc:740] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.380801 18291 consensus_queue.cc:260] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.383181 18291 ts_tablet_manager.cc:1434] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:36.384124 18291 tablet_bootstrap.cc:492] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.385324 18292 tablet_bootstrap.cc:654] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.391505 18291 tablet_bootstrap.cc:654] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.395756 18099 raft_consensus.cc:2468] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 1.
I20260709 13:17:36.396898 18137 leader_election.cc:304] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 7c8b0b69e4a64a1bac45f7d912616d43
I20260709 13:17:36.397683 18296 raft_consensus.cc:2804] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.398799 18293 tablet_bootstrap.cc:492] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.399297 18293 ts_tablet_manager.cc:1403] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.004s
I20260709 13:17:36.402951 18293 raft_consensus.cc:359] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.403846 18293 raft_consensus.cc:385] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.404196 18293 raft_consensus.cc:740] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.405067 18293 consensus_queue.cc:260] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.407699 18293 ts_tablet_manager.cc:1434] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:36.408828 18293 tablet_bootstrap.cc:492] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.412067 18296 raft_consensus.cc:697] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:36.414394 18296 consensus_queue.cc:237] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.410390 18292 tablet_bootstrap.cc:492] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.417325 18292 ts_tablet_manager.cc:1403] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.012s
I20260709 13:17:36.420341 18292 raft_consensus.cc:359] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.420810 18291 tablet_bootstrap.cc:492] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.421545 18292 raft_consensus.cc:385] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.421885 18292 raft_consensus.cc:740] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.422585 18292 consensus_queue.cc:260] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.421378 18291 ts_tablet_manager.cc:1403] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.011s
I20260709 13:17:36.425091 18292 ts_tablet_manager.cc:1434] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:17:36.426033 18292 tablet_bootstrap.cc:492] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.427033 18293 tablet_bootstrap.cc:654] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.433705 18292 tablet_bootstrap.cc:654] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.438925 18291 raft_consensus.cc:359] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.439888 18291 raft_consensus.cc:385] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.440253 18291 raft_consensus.cc:740] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.441108 18291 consensus_queue.cc:260] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.443943 18291 ts_tablet_manager.cc:1434] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:17:36.447434 18293 tablet_bootstrap.cc:492] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.447847 18293 ts_tablet_manager.cc:1403] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.039s	user 0.002s	sys 0.015s
I20260709 13:17:36.449626 18291 tablet_bootstrap.cc:492] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.452283 18292 tablet_bootstrap.cc:492] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.452952 18292 ts_tablet_manager.cc:1403] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.005s
I20260709 13:17:36.453469 18293 raft_consensus.cc:359] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.454442 18293 raft_consensus.cc:385] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.454828 18293 raft_consensus.cc:740] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.456604 18292 raft_consensus.cc:359] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.457386 18292 raft_consensus.cc:385] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.457681 18292 raft_consensus.cc:740] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.458690 18291 tablet_bootstrap.cc:654] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.458382 18292 consensus_queue.cc:260] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.459897 18296 raft_consensus.cc:493] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.460355 18296 raft_consensus.cc:515] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.463584 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.463938 18321 raft_consensus.cc:493] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.463147 18296 leader_election.cc:290] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.464411 18321 raft_consensus.cc:515] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.455943 18293 consensus_queue.cc:260] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
W20260709 13:17:36.465129 18137 leader_election.cc:343] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.464452 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.466720 18321 leader_election.cc:290] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
W20260709 13:17:36.466862 18137 leader_election.cc:343] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.467291 18137 leader_election.cc:304] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:36.467808 18292 ts_tablet_manager.cc:1434] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:36.469208 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.469444 17994 catalog_manager.cc:5697] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 1 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.471012 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.471640 18248 raft_consensus.cc:2468] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 0.
I20260709 13:17:36.472785 18137 leader_election.cc:304] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.473090 18321 raft_consensus.cc:2749] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:36.473338 18293 ts_tablet_manager.cc:1434] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 13:17:36.475508 18292 tablet_bootstrap.cc:492] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.473541 18296 raft_consensus.cc:2804] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.478571 18296 raft_consensus.cc:493] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.478900 18296 raft_consensus.cc:3060] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.479724 18298 raft_consensus.cc:493] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.480269 18298 raft_consensus.cc:515] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
W20260709 13:17:36.473672 18137 leader_election.cc:343] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.486521 18298 leader_election.cc:290] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.493183 18293 tablet_bootstrap.cc:492] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.485633 18296 raft_consensus.cc:515] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.502516 18296 leader_election.cc:290] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.500789 18291 tablet_bootstrap.cc:492] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.503242 18291 ts_tablet_manager.cc:1403] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.001s
I20260709 13:17:36.503616 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:36.504204 18248 raft_consensus.cc:3060] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.506072 18291 raft_consensus.cc:359] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.506711 18291 raft_consensus.cc:385] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.506974 18291 raft_consensus.cc:740] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.508147 18293 tablet_bootstrap.cc:654] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.509274 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
W20260709 13:17:36.510512 18137 leader_election.cc:343] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.511250 18291 consensus_queue.cc:260] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.512051 18292 tablet_bootstrap.cc:654] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.513382 18248 raft_consensus.cc:2468] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 1.
I20260709 13:17:36.514210 18291 ts_tablet_manager.cc:1434] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:17:36.514408 18137 leader_election.cc:304] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:36.515043 18291 tablet_bootstrap.cc:492] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e: Bootstrap starting.
I20260709 13:17:36.516217 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
I20260709 13:17:36.526759 18174 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 0.
I20260709 13:17:36.528475 18063 leader_election.cc:304] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.529712 18298 raft_consensus.cc:2804] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.530153 18298 raft_consensus.cc:493] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.530543 18298 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.531678 18291 tablet_bootstrap.cc:654] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.515273 18296 raft_consensus.cc:2804] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.533373 18296 raft_consensus.cc:697] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:36.534200 18296 consensus_queue.cc:237] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.534739 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.535313 18248 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 0.
I20260709 13:17:36.539485 18298 raft_consensus.cc:515] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.542985 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:36.543661 18174 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.544816 18300 raft_consensus.cc:493] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.547405 18298 leader_election.cc:290] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.548323 18293 tablet_bootstrap.cc:492] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.548530 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:36.549666 18293 ts_tablet_manager.cc:1403] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.011s
I20260709 13:17:36.549615 18248 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.549320 18300 raft_consensus.cc:515] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.558297 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74a4eaf425e45669e84532813ff527d" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.559062 18099 raft_consensus.cc:2468] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 0.
I20260709 13:17:36.560711 18211 leader_election.cc:304] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:36.562574 18300 leader_election.cc:290] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:36.566092 18300 raft_consensus.cc:2804] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.566587 18300 raft_consensus.cc:493] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.566334 18293 raft_consensus.cc:359] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.567039 18300 raft_consensus.cc:3060] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.567130 18293 raft_consensus.cc:385] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.567271 18248 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 1.
I20260709 13:17:36.567571 18293 raft_consensus.cc:740] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.570262 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74a4eaf425e45669e84532813ff527d" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
I20260709 13:17:36.571614 18062 leader_election.cc:304] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:36.573261 18292 tablet_bootstrap.cc:492] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.573719 18292 ts_tablet_manager.cc:1403] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.009s
I20260709 13:17:36.576834 18298 raft_consensus.cc:2804] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:36.577716 18212 leader_election.cc:343] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.577484 18293 consensus_queue.cc:260] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.585784 18293 ts_tablet_manager.cc:1434] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 13:17:36.591302 18292 raft_consensus.cc:359] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.592013 18292 raft_consensus.cc:385] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.592376 18291 tablet_bootstrap.cc:492] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e: No bootstrap required, opened a new log
I20260709 13:17:36.592782 18291 ts_tablet_manager.cc:1403] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.007s
I20260709 13:17:36.592274 18292 raft_consensus.cc:740] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.595669 18292 consensus_queue.cc:260] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.597892 18293 tablet_bootstrap.cc:492] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.598268 18291 raft_consensus.cc:359] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.599073 18291 raft_consensus.cc:385] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.599395 18291 raft_consensus.cc:740] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.603987 18291 consensus_queue.cc:260] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.593120 18300 raft_consensus.cc:515] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.603516 18292 ts_tablet_manager.cc:1434] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.000s
W20260709 13:17:36.618947 18211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:42651, user_credentials={real_user=slave}} blocked reactor thread for 58312.9us
I20260709 13:17:36.621438 18300 leader_election.cc:290] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:36.623638 18174 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 1.
I20260709 13:17:36.624142 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74a4eaf425e45669e84532813ff527d" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:36.624827 18173 raft_consensus.cc:3060] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.626940 18292 tablet_bootstrap.cc:492] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.632057 18298 raft_consensus.cc:697] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:36.632652 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e74a4eaf425e45669e84532813ff527d" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:36.633507 18099 raft_consensus.cc:3060] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.634202 18291 ts_tablet_manager.cc:1434] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.007s
I20260709 13:17:36.632913 18293 tablet_bootstrap.cc:654] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.637732 17996 catalog_manager.cc:5697] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 1 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.637120 18298 consensus_queue.cc:237] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.638756 18296 raft_consensus.cc:493] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.648268 18296 raft_consensus.cc:515] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.646764 18099 raft_consensus.cc:2468] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 1.
I20260709 13:17:36.649996 18211 leader_election.cc:304] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:36.650276 18296 leader_election.cc:290] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.650720 18300 raft_consensus.cc:2804] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.652246 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.652992 18248 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 0.
I20260709 13:17:36.654441 18296 raft_consensus.cc:493] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.654405 18137 leader_election.cc:304] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.655526 18321 raft_consensus.cc:2804] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.656036 18321 raft_consensus.cc:493] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.655292 18296 raft_consensus.cc:515] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.656479 18321 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.657177 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.659217 18099 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 0.
I20260709 13:17:36.660344 18296 leader_election.cc:290] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.647271 18292 tablet_bootstrap.cc:654] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.647194 18335 raft_consensus.cc:493] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.661935 18335 raft_consensus.cc:515] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.663568 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.647790 18173 raft_consensus.cc:2468] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 1.
I20260709 13:17:36.664191 18335 leader_election.cc:290] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
W20260709 13:17:36.665015 18137 leader_election.cc:343] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.663563 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.666188 18099 raft_consensus.cc:2468] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 0.
I20260709 13:17:36.664220 18321 raft_consensus.cc:515] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.666599 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
I20260709 13:17:36.669090 18137 leader_election.cc:304] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 7c8b0b69e4a64a1bac45f7d912616d43
I20260709 13:17:36.669893 18296 raft_consensus.cc:2804] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.670256 18321 leader_election.cc:290] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.670445 18296 raft_consensus.cc:493] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.666128 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.671602 18098 raft_consensus.cc:2393] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c8b0b69e4a64a1bac45f7d912616d43 in current term 1: Already voted for candidate 9c42f27ce7cf45ea9c004b89f094e73e in this term.
I20260709 13:17:36.671437 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:36.672045 18248 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.676124 18296 raft_consensus.cc:3060] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.672722 18211 leader_election.cc:304] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43; no voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:36.678926 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:36.679540 18098 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.685081 18300 raft_consensus.cc:697] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 LEADER]: Becoming Leader. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:36.686215 18300 consensus_queue.cc:237] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.692845 18248 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 1.
I20260709 13:17:36.694659 18137 leader_election.cc:304] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.696072 18292 tablet_bootstrap.cc:492] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.695963 18321 raft_consensus.cc:2804] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.696544 18292 ts_tablet_manager.cc:1403] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.070s	user 0.003s	sys 0.009s
I20260709 13:17:36.694265 18296 raft_consensus.cc:515] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.696621 18321 raft_consensus.cc:697] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:36.698105 18321 consensus_queue.cc:237] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.703838 18340 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.704113 18296 leader_election.cc:290] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.706547 18293 tablet_bootstrap.cc:492] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.710738 18293 ts_tablet_manager.cc:1403] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.009s
I20260709 13:17:36.709283 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:36.712085 18099 raft_consensus.cc:3060] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.715605 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:36.716087 18293 raft_consensus.cc:359] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.717015 18293 raft_consensus.cc:385] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:36.717273 18137 leader_election.cc:343] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:36.717375 18293 raft_consensus.cc:740] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.731581 18098 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 1.
I20260709 13:17:36.731957 18292 raft_consensus.cc:359] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.738750 18292 raft_consensus.cc:385] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.739023 18292 raft_consensus.cc:740] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.728655 18293 consensus_queue.cc:260] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.740367 17996 catalog_manager.cc:5697] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.745172 18292 consensus_queue.cc:260] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.746707 18099 raft_consensus.cc:2468] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 1.
I20260709 13:17:36.748137 18292 ts_tablet_manager.cc:1434] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:17:36.748256 18137 leader_election.cc:304] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 7c8b0b69e4a64a1bac45f7d912616d43
I20260709 13:17:36.749161 18292 tablet_bootstrap.cc:492] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5: Bootstrap starting.
I20260709 13:17:36.749544 18321 raft_consensus.cc:2804] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.751497 18340 raft_consensus.cc:2749] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:36.750473 18293 ts_tablet_manager.cc:1434] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.008s
I20260709 13:17:36.750917 17995 catalog_manager.cc:5697] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.753296 18300 raft_consensus.cc:493] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.756263 18300 raft_consensus.cc:515] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.756865 18293 tablet_bootstrap.cc:492] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.750545 18321 raft_consensus.cc:697] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:36.758391 18300 leader_election.cc:290] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:36.752703 17994 catalog_manager.cc:5697] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 1 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.759438 18321 consensus_queue.cc:237] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.759693 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
I20260709 13:17:36.760356 18173 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 0.
I20260709 13:17:36.761700 18212 leader_election.cc:304] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.762563 18300 raft_consensus.cc:2804] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.763193 18300 raft_consensus.cc:493] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.763621 18300 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.771664 18296 raft_consensus.cc:493] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.772778 18296 raft_consensus.cc:515] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.778156 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.808198 18298 raft_consensus.cc:493] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.808933 18298 raft_consensus.cc:515] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.831854 18292 tablet_bootstrap.cc:654] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.833412 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:36.834105 18098 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 0.
I20260709 13:17:36.833825 18298 leader_election.cc:290] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.839767 18296 leader_election.cc:290] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.837090 18300 raft_consensus.cc:515] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.840068 18293 tablet_bootstrap.cc:654] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.836432 18099 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 0.
I20260709 13:17:36.839730 18137 leader_election.cc:304] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.845633 18300 leader_election.cc:290] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:36.846002 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
I20260709 13:17:36.846624 18173 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 0.
I20260709 13:17:36.848104 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.848711 18247 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 0.
I20260709 13:17:36.841233 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:36.850241 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:36.850633 18063 leader_election.cc:304] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.851054 18174 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.853637 18298 raft_consensus.cc:2804] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.854182 18296 raft_consensus.cc:2804] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:36.854147 18298 raft_consensus.cc:493] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.856678 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:36.855907 18296 raft_consensus.cc:493] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.857515 18099 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.858134 18298 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.850281 18248 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 0.
I20260709 13:17:36.865948 18298 raft_consensus.cc:515] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.867740 18293 tablet_bootstrap.cc:492] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.868163 18293 ts_tablet_manager.cc:1403] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.006s
I20260709 13:17:36.868602 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:36.869683 18298 leader_election.cc:290] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.870640 18293 raft_consensus.cc:359] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.871073 18293 raft_consensus.cc:385] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.871228 18293 raft_consensus.cc:740] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.871625 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:36.872495 18248 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.857594 18296 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:36.871762 18293 consensus_queue.cc:260] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.880228 17994 catalog_manager.cc:5697] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 1 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.884624 18296 raft_consensus.cc:515] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.887550 18174 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 1.
I20260709 13:17:36.889483 18173 raft_consensus.cc:2393] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7dbbd9fef5644548bf684f059f151ee5 in current term 1: Already voted for candidate 9c42f27ce7cf45ea9c004b89f094e73e in this term.
I20260709 13:17:36.892549 18248 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 1.
I20260709 13:17:36.892601 18099 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 1.
I20260709 13:17:36.893025 18212 leader_election.cc:304] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:36.893806 18300 raft_consensus.cc:2804] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.894307 18300 raft_consensus.cc:697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 LEADER]: Becoming Leader. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:36.895148 18300 consensus_queue.cc:237] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.899215 18296 leader_election.cc:290] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:36.899834 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
W20260709 13:17:36.900411 18044 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:36.900651 18247 raft_consensus.cc:2393] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9c42f27ce7cf45ea9c004b89f094e73e in current term 1: Already voted for candidate 7dbbd9fef5644548bf684f059f151ee5 in this term.
I20260709 13:17:36.901294 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:36.902290 18099 raft_consensus.cc:2393] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9c42f27ce7cf45ea9c004b89f094e73e in current term 1: Already voted for candidate 7dbbd9fef5644548bf684f059f151ee5 in this term.
I20260709 13:17:36.903247 18292 tablet_bootstrap.cc:492] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5: No bootstrap required, opened a new log
I20260709 13:17:36.903677 18292 ts_tablet_manager.cc:1403] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5: Time spent bootstrapping tablet: real 0.155s	user 0.018s	sys 0.035s
I20260709 13:17:36.903595 18137 leader_election.cc:304] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:36.904721 18296 raft_consensus.cc:2749] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:36.905704 18293 ts_tablet_manager.cc:1434] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.037s	user 0.001s	sys 0.005s
I20260709 13:17:36.906878 18293 tablet_bootstrap.cc:492] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43: Bootstrap starting.
I20260709 13:17:36.908171 18292 raft_consensus.cc:359] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.908821 18292 raft_consensus.cc:385] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:36.909111 18292 raft_consensus.cc:740] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.909814 18292 consensus_queue.cc:260] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.911911 18292 ts_tablet_manager.cc:1434] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:17:36.915197 18062 leader_election.cc:304] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:36.916101 18298 raft_consensus.cc:2804] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:36.916709 18298 raft_consensus.cc:697] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:36.917846 18293 tablet_bootstrap.cc:654] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:36.917785 18298 consensus_queue.cc:237] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:36.940275 17996 catalog_manager.cc:5697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.958926 18296 consensus_queue.cc:1048] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:36.985770 17994 catalog_manager.cc:5697] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.993001 18296 consensus_queue.cc:1048] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:36.998729 18293 tablet_bootstrap.cc:492] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43: No bootstrap required, opened a new log
I20260709 13:17:36.999404 18293 ts_tablet_manager.cc:1403] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.028s
I20260709 13:17:36.999506 18298 raft_consensus.cc:493] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.000147 18298 raft_consensus.cc:515] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.002244 18298 leader_election.cc:290] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:37.002905 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
I20260709 13:17:37.003541 18174 raft_consensus.cc:2468] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 0.
I20260709 13:17:37.002718 18293 raft_consensus.cc:359] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.003770 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" is_pre_election: true
I20260709 13:17:37.004257 18293 raft_consensus.cc:385] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:37.004431 18247 raft_consensus.cc:2468] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 0.
I20260709 13:17:37.004819 18063 leader_election.cc:304] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:37.004567 18293 raft_consensus.cc:740] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Initialized, Role: FOLLOWER
I20260709 13:17:37.005599 18298 raft_consensus.cc:2804] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:37.006184 18293 consensus_queue.cc:260] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.006187 18298 raft_consensus.cc:493] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.008764 18293 ts_tablet_manager.cc:1434] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:17:37.009090 18298 raft_consensus.cc:3060] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.016587 18298 raft_consensus.cc:515] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.018573 18298 leader_election.cc:290] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:37.019421 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:37.020026 18174 raft_consensus.cc:3060] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.025666 18174 raft_consensus.cc:2468] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 1.
I20260709 13:17:37.025935 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:37.026506 18248 raft_consensus.cc:3060] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.026798 18063 leader_election.cc:304] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:37.027585 18298 raft_consensus.cc:2804] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:37.028034 18298 raft_consensus.cc:697] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:37.028793 18298 consensus_queue.cc:237] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.035661 18248 raft_consensus.cc:2468] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 1.
I20260709 13:17:37.047920 18316 consensus_queue.cc:1048] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.053864 17995 catalog_manager.cc:5697] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.067531 18099 raft_consensus.cc:3060] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.075867 18321 consensus_queue.cc:1048] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:37.082759 18336 consensus_queue.cc:1048] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:37.098829 18336 consensus_queue.cc:1048] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.109124 18300 consensus_queue.cc:1048] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.119171 18321 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:37.135195 18335 consensus_queue.cc:1048] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.141776 18316 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.182790 18247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2"
dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
mode: GRACEFUL
new_leader_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:58244
I20260709 13:17:37.183488 18247 raft_consensus.cc:606] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 LEADER]: Received request to transfer leadership to TS 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:37.197228 18362 raft_consensus.cc:493] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.197849 18174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35984391032a42d6a033774af797d2d7"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
mode: GRACEFUL
new_leader_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:17:37.197768 18362 raft_consensus.cc:515] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.198383 18174 raft_consensus.cc:606] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Received request to transfer leadership to TS 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:37.199995 18362 leader_election.cc:290] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:37.200675 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dbbd9fef5644548bf684f059f151ee5" is_pre_election: true
I20260709 13:17:37.201445 18098 raft_consensus.cc:2393] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c8b0b69e4a64a1bac45f7d912616d43 in current term 1: Already voted for candidate 9c42f27ce7cf45ea9c004b89f094e73e in this term.
I20260709 13:17:37.201483 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" is_pre_election: true
I20260709 13:17:37.203533 18212 leader_election.cc:304] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43; no voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:37.204288 18362 raft_consensus.cc:3060] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:37.211699 18362 raft_consensus.cc:2749] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:37.224422 18098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
mode: GRACEFUL
new_leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:37038
I20260709 13:17:37.225051 18098 raft_consensus.cc:606] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Received request to transfer leadership to TS 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:37.306109 18316 consensus_queue.cc:1048] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.317389 18321 consensus_queue.cc:1048] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.362550 18362 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.372094 18335 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.388732 18335 raft_consensus.cc:993] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43: : Instructing follower 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:37.389230 18300 raft_consensus.cc:1081] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 LEADER]: Signalling peer 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:37.392012 18099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:37012
I20260709 13:17:37.392570 18099 raft_consensus.cc:493] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:37.393028 18099 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.397423 18099 raft_consensus.cc:515] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.399830 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:37.400051 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:37.400394 18174 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.400553 18247 raft_consensus.cc:3055] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:37.400913 18247 raft_consensus.cc:740] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:37.401748 18247 consensus_queue.cc:260] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.402937 18247 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.404441 18099 leader_election.cc:290] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:37.407135 18174 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:37.408299 18063 leader_election.cc:304] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:37.409123 18298 raft_consensus.cc:2804] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:37.409577 18247 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:37.409592 18298 raft_consensus.cc:697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:37.410602 18298 consensus_queue.cc:237] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.416926 17995 catalog_manager.cc:5697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 1 to 2, leader changed from 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3) to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.511281 18298 consensus_queue.cc:1048] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.522279 18336 consensus_queue.cc:1048] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.531551 18337 raft_consensus.cc:993] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5: : Instructing follower 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:37.532049 18336 raft_consensus.cc:1081] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Signalling peer 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:37.533980 18174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:52828
I20260709 13:17:37.534526 18174 raft_consensus.cc:493] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:37.534901 18174 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.540644 18174 raft_consensus.cc:515] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.542214 18174 leader_election.cc:290] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 2 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:37.543063 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:37.543341 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:37.543638 18099 raft_consensus.cc:3055] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:37.543900 18247 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.544045 18099 raft_consensus.cc:740] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:37.544819 18099 consensus_queue.cc:260] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.545729 18099 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.550158 18099 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 2.
I20260709 13:17:37.550184 18247 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 2.
I20260709 13:17:37.551210 18137 leader_election.cc:304] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:37.551847 18321 raft_consensus.cc:2804] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:37.552362 18321 raft_consensus.cc:697] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:37.553141 18321 consensus_queue.cc:237] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.559399 18321 raft_consensus.cc:993] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e: : Instructing follower 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:37.559791 18316 raft_consensus.cc:1081] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Signalling peer 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:37.560411 17995 catalog_manager.cc:5697] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 1 to 2, leader changed from 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1) to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 2 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.561412 18099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35984391032a42d6a033774af797d2d7"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:37028
I20260709 13:17:37.564467 18336 consensus_queue.cc:1048] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.562001 18099 raft_consensus.cc:493] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:37.567617 18099 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.575515 18099 raft_consensus.cc:515] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.577580 18099 leader_election.cc:290] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:37.578835 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:37.579396 18248 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.585172 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:37.587980 18174 raft_consensus.cc:3055] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:37.588362 18174 raft_consensus.cc:740] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:37.588449 18298 consensus_queue.cc:1048] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:37.589267 18174 consensus_queue.cc:260] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.590513 18174 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.587472 18248 raft_consensus.cc:2468] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:37.595546 18062 leader_election.cc:304] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:37.596331 18298 raft_consensus.cc:2804] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:37.596783 18298 raft_consensus.cc:697] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:37.597608 18298 consensus_queue.cc:237] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:37.598857 18174 raft_consensus.cc:2468] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:37.608649 17996 catalog_manager.cc:5697] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 1 to 2, leader changed from 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2) to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:37.967247 18173 raft_consensus.cc:1275] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:37.968410 18337 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:37.974505 18247 raft_consensus.cc:1275] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:37.976058 18298 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.022992 18099 raft_consensus.cc:1275] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:38.024346 18316 consensus_queue.cc:1048] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.031363 18247 raft_consensus.cc:1275] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:38.033154 18321 consensus_queue.cc:1048] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.099308 18247 raft_consensus.cc:1275] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:38.100519 18337 consensus_queue.cc:1048] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.108695 18173 raft_consensus.cc:1275] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:38.110337 18378 consensus_queue.cc:1048] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.261343 17964 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:17:40.262130 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:40.288048 18098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
mode: GRACEFUL
new_leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:58122
I20260709 13:17:40.288552 18098 raft_consensus.cc:606] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Received request to transfer leadership to TS 7c8b0b69e4a64a1bac45f7d912616d43
I20260709 13:17:40.298496 18173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
mode: GRACEFUL
new_leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:17:40.298987 18173 raft_consensus.cc:606] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Received request to transfer leadership to TS 7c8b0b69e4a64a1bac45f7d912616d43
I20260709 13:17:40.300169 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:40.300625 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:40.313858 18298 raft_consensus.cc:993] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5: : Instructing follower 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:40.314275 18384 raft_consensus.cc:1081] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Signalling peer 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:40.315654 18247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d"
dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:58232
I20260709 13:17:40.316126 18247 raft_consensus.cc:493] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:40.316418 18247 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.321177 18247 raft_consensus.cc:515] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:40.322975 18247 leader_election.cc:290] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 2 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651)
I20260709 13:17:40.323634 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:40.323886 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:40.324224 18173 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.324443 18098 raft_consensus.cc:3055] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:40.324774 18098 raft_consensus.cc:740] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:40.325448 18098 consensus_queue.cc:260] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:40.326318 18098 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.328795 18173 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 2.
I20260709 13:17:40.329878 18212 leader_election.cc:304] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:40.330613 18300 raft_consensus.cc:2804] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:40.330912 18098 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 2.
I20260709 13:17:40.331847 18300 raft_consensus.cc:697] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Becoming Leader. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:40.332647 18300 consensus_queue.cc:237] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:40.339779 17994 catalog_manager.cc:5697] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 reported cstate change: term changed from 1 to 2, leader changed from 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1) to 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.687851 18390 raft_consensus.cc:993] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: : Instructing follower 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:40.688289 18380 raft_consensus.cc:1081] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Signalling peer 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:40.689739 18247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a"
dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:17:40.690223 18247 raft_consensus.cc:493] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:40.690507 18247 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.695560 18247 raft_consensus.cc:515] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:40.697052 18247 leader_election.cc:290] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 2 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:40.697826 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:40.698069 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:40.698410 18098 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.698637 18173 raft_consensus.cc:3055] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:40.698992 18173 raft_consensus.cc:740] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:40.699630 18173 consensus_queue.cc:260] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:40.700644 18173 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.703564 18098 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 2.
I20260709 13:17:40.704401 18211 leader_election.cc:304] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:40.705044 18300 raft_consensus.cc:2804] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:40.705427 18300 raft_consensus.cc:697] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Becoming Leader. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:40.705734 18173 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 2.
I20260709 13:17:40.706138 18300 consensus_queue.cc:237] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:40.714740 17994 catalog_manager.cc:5697] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 reported cstate change: term changed from 1 to 2, leader changed from 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2) to 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.808597 18173 raft_consensus.cc:1275] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:40.809764 18300 consensus_queue.cc:1048] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.818567 18098 raft_consensus.cc:1275] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:40.820947 18300 consensus_queue.cc:1048] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.129298 18174 raft_consensus.cc:1275] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.130467 18300 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.138726 18098 raft_consensus.cc:1275] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.140662 18300 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.301371 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:41.310247 18247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d"
dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
mode: GRACEFUL
new_leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:58244
I20260709 13:17:41.310765 18247 raft_consensus.cc:606] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Received request to transfer leadership to TS 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:41.315198 18098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
mode: GRACEFUL
new_leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:37038
I20260709 13:17:41.315613 18098 raft_consensus.cc:606] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Received request to transfer leadership to TS 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:41.319818 18098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
mode: GRACEFUL
new_leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:37038
I20260709 13:17:41.320237 18098 raft_consensus.cc:606] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Received request to transfer leadership to TS 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:41.324795 18098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35984391032a42d6a033774af797d2d7"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
mode: GRACEFUL
new_leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:37038
I20260709 13:17:41.325254 18098 raft_consensus.cc:606] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Received request to transfer leadership to TS 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:41.329276 18247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a"
dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
mode: GRACEFUL
new_leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:58244
I20260709 13:17:41.329748 18247 raft_consensus.cc:606] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Received request to transfer leadership to TS 9c42f27ce7cf45ea9c004b89f094e73e
I20260709 13:17:41.348251 18398 raft_consensus.cc:993] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5: : Instructing follower 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.348730 18384 raft_consensus.cc:1081] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Signalling peer 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.350023 18174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:52828
I20260709 13:17:41.350471 18174 raft_consensus.cc:493] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.350780 18174 raft_consensus.cc:3060] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.355186 18174 raft_consensus.cc:515] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.356591 18174 leader_election.cc:290] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 2 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:41.357358 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:41.357719 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efedead5151c48bc98da33aadf5ca280" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:41.357883 18098 raft_consensus.cc:3055] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.358235 18098 raft_consensus.cc:740] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:41.358230 18247 raft_consensus.cc:3060] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.359089 18098 consensus_queue.cc:260] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.360088 18098 raft_consensus.cc:3060] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.363023 18247 raft_consensus.cc:2468] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 2.
I20260709 13:17:41.364104 18137 leader_election.cc:304] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:41.364751 18380 raft_consensus.cc:2804] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.365819 18098 raft_consensus.cc:2468] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 2.
I20260709 13:17:41.366128 18380 raft_consensus.cc:697] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:41.366446 18300 raft_consensus.cc:993] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43: : Instructing follower 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.366855 18400 raft_consensus.cc:1081] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Signalling peer 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.366943 18380 consensus_queue.cc:237] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.368386 18174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:52826
I20260709 13:17:41.368975 18174 raft_consensus.cc:493] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.369328 18174 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.373966 18174 raft_consensus.cc:515] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.374013 17996 catalog_manager.cc:5697] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 1 to 2, leader changed from 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1) to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 2 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.375607 18174 leader_election.cc:290] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:41.376226 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:41.376509 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27faddc6920d4d709a0050bb3758bf5d" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:41.377036 18098 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.377070 18247 raft_consensus.cc:3055] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.377605 18247 raft_consensus.cc:740] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:41.378350 18247 consensus_queue.cc:260] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.379482 18247 raft_consensus.cc:3060] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.382032 18098 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.383133 18137 leader_election.cc:304] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:41.383948 18380 raft_consensus.cc:2804] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.384390 18380 raft_consensus.cc:697] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:41.385162 18380 consensus_queue.cc:237] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.385684 18247 raft_consensus.cc:2468] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.390862 17996 catalog_manager.cc:5697] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 2 to 3, leader changed from 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3) to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 3 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.454520 18398 raft_consensus.cc:993] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5: : Instructing follower 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.454917 18398 raft_consensus.cc:1081] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Signalling peer 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.456293 18174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:52828
I20260709 13:17:41.456746 18174 raft_consensus.cc:493] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.457053 18174 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.461603 18174 raft_consensus.cc:515] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.463362 18174 leader_election.cc:290] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:41.464128 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:41.464320 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:41.464733 18098 raft_consensus.cc:3055] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.464789 18247 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.465154 18098 raft_consensus.cc:740] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:41.465819 18098 consensus_queue.cc:260] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.466662 18098 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.468758 18247 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.469602 18137 leader_election.cc:304] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:41.470273 18380 raft_consensus.cc:2804] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.470664 18380 raft_consensus.cc:697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:41.471454 18098 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.471331 18380 consensus_queue.cc:237] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.477886 17996 catalog_manager.cc:5697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 2 to 3, leader changed from 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1) to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 3 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.659128 18384 raft_consensus.cc:993] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5: : Instructing follower 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.659611 18398 raft_consensus.cc:1081] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Signalling peer 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.660955 18174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35984391032a42d6a033774af797d2d7"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:52828
I20260709 13:17:41.661402 18174 raft_consensus.cc:493] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.661698 18174 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.666206 18174 raft_consensus.cc:515] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.667621 18174 leader_election.cc:290] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:41.668377 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:41.668660 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35984391032a42d6a033774af797d2d7" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:41.668912 18098 raft_consensus.cc:3055] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.669179 18247 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.669286 18098 raft_consensus.cc:740] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:41.669987 18098 consensus_queue.cc:260] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.670822 18098 raft_consensus.cc:3060] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.673132 18247 raft_consensus.cc:2468] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.674088 18137 leader_election.cc:304] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:41.674909 18380 raft_consensus.cc:2804] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.675611 18380 raft_consensus.cc:697] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:41.676215 18098 raft_consensus.cc:2468] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.676425 18380 consensus_queue.cc:237] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.677559 18385 raft_consensus.cc:993] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: : Instructing follower 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.677978 18400 raft_consensus.cc:1081] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Signalling peer 9c42f27ce7cf45ea9c004b89f094e73e to start an election
I20260709 13:17:41.679343 18174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
 from {username='slave'} at 127.0.0.1:52826
I20260709 13:17:41.679893 18174 raft_consensus.cc:493] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.680332 18174 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.683017 17996 catalog_manager.cc:5697] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 2 to 3, leader changed from 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1) to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 3 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.686393 18174 raft_consensus.cc:515] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.687974 18174 leader_election.cc:290] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:41.688606 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:41.689180 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:41.689178 18098 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.689822 18247 raft_consensus.cc:3055] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.690133 18247 raft_consensus.cc:740] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:41.690740 18247 consensus_queue.cc:260] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.691665 18247 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.694481 18098 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.695452 18247 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c42f27ce7cf45ea9c004b89f094e73e in term 3.
I20260709 13:17:41.695399 18137 leader_election.cc:304] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dbbd9fef5644548bf684f059f151ee5, 9c42f27ce7cf45ea9c004b89f094e73e; no voters: 
I20260709 13:17:41.696251 18380 raft_consensus.cc:2804] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.696635 18380 raft_consensus.cc:697] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Becoming Leader. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:41.697362 18380 consensus_queue.cc:237] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:41.702754 17996 catalog_manager.cc:5697] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e reported cstate change: term changed from 2 to 3, leader changed from 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3) to 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2). New cstate: current_term: 3 leader_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.769380 18247 raft_consensus.cc:1275] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.770507 18380 consensus_queue.cc:1048] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.779143 18098 raft_consensus.cc:1275] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.780557 18402 consensus_queue.cc:1048] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.928251 18098 raft_consensus.cc:1275] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.929410 18402 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:41.938028 18247 raft_consensus.cc:1275] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.939987 18402 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:41.943604 18248 raft_consensus.cc:1275] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.945061 18402 consensus_queue.cc:1048] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:41.958482 18098 raft_consensus.cc:1275] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.959877 18402 consensus_queue.cc:1048] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.066502 18098 raft_consensus.cc:1275] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.067721 18402 consensus_queue.cc:1048] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.076035 18248 raft_consensus.cc:1275] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.077678 18402 consensus_queue.cc:1048] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.138142 18098 raft_consensus.cc:1275] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.139201 18402 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.145581 18248 raft_consensus.cc:1275] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Refusing update from remote peer 9c42f27ce7cf45ea9c004b89f094e73e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.147327 18402 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:44.341379 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:44.348361 18174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18279075f9e64696b85a584e61448e2c"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
mode: GRACEFUL
new_leader_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:17:44.349116 18174 raft_consensus.cc:606] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Received request to transfer leadership to TS 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:44.351657 18174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
mode: GRACEFUL
new_leader_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:17:44.352078 18174 raft_consensus.cc:606] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Received request to transfer leadership to TS 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:44.354146 18174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
mode: GRACEFUL
new_leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:17:44.354558 18174 raft_consensus.cc:606] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 LEADER]: Received request to transfer leadership to TS 7c8b0b69e4a64a1bac45f7d912616d43
I20260709 13:17:44.356653 18174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
mode: GRACEFUL
new_leader_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:17:44.357053 18174 raft_consensus.cc:606] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Received request to transfer leadership to TS 7dbbd9fef5644548bf684f059f151ee5
I20260709 13:17:44.359031 18174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2"
dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
mode: GRACEFUL
new_leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:38528
I20260709 13:17:44.359479 18174 raft_consensus.cc:606] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Received request to transfer leadership to TS 7c8b0b69e4a64a1bac45f7d912616d43
I20260709 13:17:44.360457 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:44.360926 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:44.409225 18402 raft_consensus.cc:993] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e: : Instructing follower 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:44.409754 18424 raft_consensus.cc:1081] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Signalling peer 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:44.411182 18099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:37028
I20260709 13:17:44.411625 18099 raft_consensus.cc:493] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.411908 18099 raft_consensus.cc:3060] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.416824 18099 raft_consensus.cc:515] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.418675 18099 leader_election.cc:290] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:44.419711 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:44.419814 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2369e882654da1935ad16bb6979bfb" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:44.420323 18174 raft_consensus.cc:3055] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.420413 18247 raft_consensus.cc:3060] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.420616 18174 raft_consensus.cc:740] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:44.421458 18174 consensus_queue.cc:260] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.422343 18174 raft_consensus.cc:3060] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.424736 18247 raft_consensus.cc:2468] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:44.425900 18062 leader_election.cc:304] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:44.427245 18174 raft_consensus.cc:2468] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:44.427359 18425 raft_consensus.cc:2804] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.428359 18425 raft_consensus.cc:697] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:44.429248 18425 consensus_queue.cc:237] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.436282 17996 catalog_manager.cc:5697] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 1 to 2, leader changed from 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2) to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.513031 18402 raft_consensus.cc:993] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e: : Instructing follower 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:44.513453 18402 raft_consensus.cc:1081] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Signalling peer 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:44.514892 18099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18279075f9e64696b85a584e61448e2c"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:37028
I20260709 13:17:44.515332 18099 raft_consensus.cc:493] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.515584 18099 raft_consensus.cc:3060] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.520134 18099 raft_consensus.cc:515] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.521699 18099 leader_election.cc:290] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:44.522351 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:44.522575 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18279075f9e64696b85a584e61448e2c" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:44.522864 18174 raft_consensus.cc:3055] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.523033 18247 raft_consensus.cc:3060] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.523183 18174 raft_consensus.cc:740] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:44.523933 18174 consensus_queue.cc:260] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.524981 18174 raft_consensus.cc:3060] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.528582 18247 raft_consensus.cc:2468] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:44.529541 18062 leader_election.cc:304] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:44.530192 18425 raft_consensus.cc:2804] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.530305 18174 raft_consensus.cc:2468] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 2.
I20260709 13:17:44.530664 18425 raft_consensus.cc:697] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:44.531646 18425 consensus_queue.cc:237] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.537847 17996 catalog_manager.cc:5697] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 1 to 2, leader changed from 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2) to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.570261 18424 raft_consensus.cc:993] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: : Instructing follower 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:44.570719 18402 raft_consensus.cc:1081] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Signalling peer 7dbbd9fef5644548bf684f059f151ee5 to start an election
I20260709 13:17:44.572064 18099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a"
dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
 from {username='slave'} at 127.0.0.1:37028
I20260709 13:17:44.572463 18099 raft_consensus.cc:493] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.572716 18099 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.576650 18099 raft_consensus.cc:515] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.577885 18099 leader_election.cc:290] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 4 election: Requested vote from peers 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329), 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3:38971)
I20260709 13:17:44.578732 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:44.578787 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ba71acd8f3492f9dea6092ec53dd0a" candidate_uuid: "7dbbd9fef5644548bf684f059f151ee5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
I20260709 13:17:44.579294 18174 raft_consensus.cc:3055] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:44.579397 18247 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.579582 18174 raft_consensus.cc:740] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:44.580257 18174 consensus_queue.cc:260] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.581102 18174 raft_consensus.cc:3060] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.583302 18247 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 4.
I20260709 13:17:44.584156 18062 leader_election.cc:304] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:44.584821 18425 raft_consensus.cc:2804] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:44.585129 18174 raft_consensus.cc:2468] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dbbd9fef5644548bf684f059f151ee5 in term 4.
I20260709 13:17:44.585285 18425 raft_consensus.cc:697] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 4 LEADER]: Becoming Leader. State: Replica: 7dbbd9fef5644548bf684f059f151ee5, State: Running, Role: LEADER
I20260709 13:17:44.586094 18425 consensus_queue.cc:237] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.592520 17996 catalog_manager.cc:5697] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 reported cstate change: term changed from 3 to 4, leader changed from 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2) to 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1). New cstate: current_term: 4 leader_uuid: "7dbbd9fef5644548bf684f059f151ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.690653 18424 raft_consensus.cc:993] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e: : Instructing follower 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:44.691032 18402 raft_consensus.cc:1081] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 LEADER]: Signalling peer 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:44.692440 18247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e"
dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:17:44.692852 18247 raft_consensus.cc:493] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.693179 18247 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.697150 18247 raft_consensus.cc:515] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.698545 18247 leader_election.cc:290] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 3 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:44.699470 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:44.699605 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1dd010cc296464bbda60f5915e3569e" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:44.700037 18099 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.700119 18174 raft_consensus.cc:3055] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:44.700452 18174 raft_consensus.cc:740] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:44.701130 18174 consensus_queue.cc:260] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.701902 18174 raft_consensus.cc:3060] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.704021 18099 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 3.
I20260709 13:17:44.705128 18211 leader_election.cc:304] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:44.705914 18422 raft_consensus.cc:2804] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:44.706046 18174 raft_consensus.cc:2468] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 3.
I20260709 13:17:44.707147 18422 raft_consensus.cc:697] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 LEADER]: Becoming Leader. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:44.707957 18422 consensus_queue.cc:237] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.714696 17996 catalog_manager.cc:5697] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 reported cstate change: term changed from 2 to 3, leader changed from 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2) to 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.836913 18424 raft_consensus.cc:993] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e: : Instructing follower 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:44.837445 18402 raft_consensus.cc:1081] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Signalling peer 7c8b0b69e4a64a1bac45f7d912616d43 to start an election
I20260709 13:17:44.838796 18247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2"
dest_uuid: "7c8b0b69e4a64a1bac45f7d912616d43"
 from {username='slave'} at 127.0.0.1:58216
I20260709 13:17:44.839151 18247 raft_consensus.cc:493] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.839367 18247 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.843377 18247 raft_consensus.cc:515] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.844638 18247 leader_election.cc:290] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 4 election: Requested vote from peers 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651), 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2:44329)
I20260709 13:17:44.845363 18099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7dbbd9fef5644548bf684f059f151ee5"
I20260709 13:17:44.845516 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8e64e663e034ac9b3b4e8b51a27dac2" candidate_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9c42f27ce7cf45ea9c004b89f094e73e"
I20260709 13:17:44.845890 18099 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.845952 18174 raft_consensus.cc:3055] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:44.846297 18174 raft_consensus.cc:740] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9c42f27ce7cf45ea9c004b89f094e73e, State: Running, Role: LEADER
I20260709 13:17:44.847009 18174 consensus_queue.cc:260] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.848023 18174 raft_consensus.cc:3060] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.851536 18099 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 4.
I20260709 13:17:44.852613 18211 leader_election.cc:304] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8b0b69e4a64a1bac45f7d912616d43, 7dbbd9fef5644548bf684f059f151ee5; no voters: 
I20260709 13:17:44.853420 18422 raft_consensus.cc:2804] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:44.853906 18173 raft_consensus.cc:1275] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.853933 18422 raft_consensus.cc:697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 LEADER]: Becoming Leader. State: Replica: 7c8b0b69e4a64a1bac45f7d912616d43, State: Running, Role: LEADER
I20260709 13:17:44.854535 18174 raft_consensus.cc:2468] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8b0b69e4a64a1bac45f7d912616d43 in term 4.
I20260709 13:17:44.854895 18422 consensus_queue.cc:237] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } }
I20260709 13:17:44.855322 18425 consensus_queue.cc:1048] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.863554 17996 catalog_manager.cc:5697] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 reported cstate change: term changed from 3 to 4, leader changed from 9c42f27ce7cf45ea9c004b89f094e73e (127.17.139.2) to 7c8b0b69e4a64a1bac45f7d912616d43 (127.17.139.3). New cstate: current_term: 4 leader_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.876721 18247 raft_consensus.cc:1275] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.878060 18425 consensus_queue.cc:1048] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.911844 18247 raft_consensus.cc:1275] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.913060 18425 consensus_queue.cc:1048] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:44.921173 18174 raft_consensus.cc:1275] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:44.922785 18426 consensus_queue.cc:1048] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.086771 18248 raft_consensus.cc:1275] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:45.087905 18426 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8b0b69e4a64a1bac45f7d912616d43" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:45.098376 18174 raft_consensus.cc:1275] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Refusing update from remote peer 7dbbd9fef5644548bf684f059f151ee5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:45.100039 18446 consensus_queue.cc:1048] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:45.181318 18099 raft_consensus.cc:1275] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:45.182516 18422 consensus_queue.cc:1048] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:45.192567 18174 raft_consensus.cc:1275] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:45.193948 18449 consensus_queue.cc:1048] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:45.241981 18174 raft_consensus.cc:1275] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:45.243129 18449 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c42f27ce7cf45ea9c004b89f094e73e" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:45.252813 18099 raft_consensus.cc:1275] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 4 FOLLOWER]: Refusing update from remote peer 7c8b0b69e4a64a1bac45f7d912616d43: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:45.254550 18422 consensus_queue.cc:1048] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dbbd9fef5644548bf684f059f151ee5" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 42651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:45.361757 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.366956 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
I20260709 13:17:45.389158 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:45.389837 17964 tablet_replica.cc:333] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.390516 17964 raft_consensus.cc:2243] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.390910 17964 raft_consensus.cc:2272] T e74a4eaf425e45669e84532813ff527d P 7dbbd9fef5644548bf684f059f151ee5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.393642 17964 tablet_replica.cc:333] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.394411 17964 raft_consensus.cc:2243] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.395354 17964 raft_consensus.cc:2272] T 18279075f9e64696b85a584e61448e2c P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.397545 17964 tablet_replica.cc:333] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.398231 17964 raft_consensus.cc:2243] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.398789 17964 raft_consensus.cc:2272] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7dbbd9fef5644548bf684f059f151ee5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.400713 17964 tablet_replica.cc:333] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.401252 17964 raft_consensus.cc:2243] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.401846 17964 raft_consensus.cc:2272] T d2ba71acd8f3492f9dea6092ec53dd0a P 7dbbd9fef5644548bf684f059f151ee5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.403644 17964 tablet_replica.cc:333] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.404325 17964 raft_consensus.cc:2243] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.404835 17964 raft_consensus.cc:2272] T efedead5151c48bc98da33aadf5ca280 P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:45.405951 18137 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:45.406659 17964 tablet_replica.cc:333] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.407194 17964 raft_consensus.cc:2243] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.407612 17964 raft_consensus.cc:2272] T d1dd010cc296464bbda60f5915e3569e P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:45.408983 18137 consensus_peers.cc:597] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e -> Peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Couldn't send request to peer 7dbbd9fef5644548bf684f059f151ee5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.409853 17964 tablet_replica.cc:333] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.410349 17964 raft_consensus.cc:2243] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.410995 17964 raft_consensus.cc:2272] T 3e2369e882654da1935ad16bb6979bfb P 7dbbd9fef5644548bf684f059f151ee5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.412654 17964 tablet_replica.cc:333] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.413166 17964 raft_consensus.cc:2243] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.413548 17964 raft_consensus.cc:2272] T 35984391032a42d6a033774af797d2d7 P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.415112 17964 tablet_replica.cc:333] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5: stopping tablet replica
I20260709 13:17:45.415535 17964 raft_consensus.cc:2243] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.415935 17964 raft_consensus.cc:2272] T 27faddc6920d4d709a0050bb3758bf5d P 7dbbd9fef5644548bf684f059f151ee5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.575696 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
W20260709 13:17:45.578840 18137 consensus_peers.cc:597] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e -> Peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Couldn't send request to peer 7dbbd9fef5644548bf684f059f151ee5. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:42651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:45.579236 18211 consensus_peers.cc:597] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 -> Peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Couldn't send request to peer 7dbbd9fef5644548bf684f059f151ee5. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:42651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.594023 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
I20260709 13:17:45.616113 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:45.616665 17964 tablet_replica.cc:333] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.617203 17964 raft_consensus.cc:2243] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.617601 17964 raft_consensus.cc:2272] T e74a4eaf425e45669e84532813ff527d P 9c42f27ce7cf45ea9c004b89f094e73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.619205 17964 tablet_replica.cc:333] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.619640 17964 raft_consensus.cc:2243] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.620282 17964 raft_consensus.cc:2272] T 27faddc6920d4d709a0050bb3758bf5d P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.621852 17964 tablet_replica.cc:333] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.622292 17964 raft_consensus.cc:2243] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.622603 17964 raft_consensus.cc:2272] T 18279075f9e64696b85a584e61448e2c P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.624372 17964 tablet_replica.cc:333] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.624817 17964 raft_consensus.cc:2243] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.625197 17964 raft_consensus.cc:2272] T d2ba71acd8f3492f9dea6092ec53dd0a P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.626873 17964 tablet_replica.cc:333] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.627287 17964 raft_consensus.cc:2243] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.627607 17964 raft_consensus.cc:2272] T d8e64e663e034ac9b3b4e8b51a27dac2 P 9c42f27ce7cf45ea9c004b89f094e73e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.629542 17964 tablet_replica.cc:333] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.630030 17964 raft_consensus.cc:2243] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.630401 17964 raft_consensus.cc:2272] T 3e2369e882654da1935ad16bb6979bfb P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.632344 17964 tablet_replica.cc:333] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.632788 17964 raft_consensus.cc:2243] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.633523 17964 raft_consensus.cc:2272] T 35984391032a42d6a033774af797d2d7 P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.635048 17964 tablet_replica.cc:333] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.635485 17964 raft_consensus.cc:2243] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.635843 17964 raft_consensus.cc:2272] T d1dd010cc296464bbda60f5915e3569e P 9c42f27ce7cf45ea9c004b89f094e73e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.637652 17964 tablet_replica.cc:333] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e: stopping tablet replica
I20260709 13:17:45.638078 17964 raft_consensus.cc:2243] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.638754 17964 raft_consensus.cc:2272] T efedead5151c48bc98da33aadf5ca280 P 9c42f27ce7cf45ea9c004b89f094e73e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.665460 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
I20260709 13:17:45.682514 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
W20260709 13:17:45.685870 18211 consensus_peers.cc:597] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 -> Peer 7dbbd9fef5644548bf684f059f151ee5 (127.17.139.1:42651): Couldn't send request to peer 7dbbd9fef5644548bf684f059f151ee5. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:42651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.706118 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:45.706660 17964 tablet_replica.cc:333] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.707206 17964 raft_consensus.cc:2243] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.707569 17964 raft_consensus.cc:2272] T 18279075f9e64696b85a584e61448e2c P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.709499 17964 tablet_replica.cc:333] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.709954 17964 raft_consensus.cc:2243] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.710290 17964 raft_consensus.cc:2272] T efedead5151c48bc98da33aadf5ca280 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.711680 17964 tablet_replica.cc:333] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.712087 17964 raft_consensus.cc:2243] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.712698 17964 raft_consensus.cc:2272] T d1dd010cc296464bbda60f5915e3569e P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.714349 17964 tablet_replica.cc:333] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.714871 17964 raft_consensus.cc:2243] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.715284 17964 raft_consensus.cc:2272] T 27faddc6920d4d709a0050bb3758bf5d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.716794 17964 tablet_replica.cc:333] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.717309 17964 raft_consensus.cc:2243] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.717691 17964 raft_consensus.cc:2272] T 3e2369e882654da1935ad16bb6979bfb P 7c8b0b69e4a64a1bac45f7d912616d43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.719502 17964 tablet_replica.cc:333] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.719952 17964 raft_consensus.cc:2243] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.720343 17964 raft_consensus.cc:2272] T 35984391032a42d6a033774af797d2d7 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.721880 17964 tablet_replica.cc:333] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.722386 17964 raft_consensus.cc:2243] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.723042 17964 raft_consensus.cc:2272] T e74a4eaf425e45669e84532813ff527d P 7c8b0b69e4a64a1bac45f7d912616d43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.724467 17964 tablet_replica.cc:333] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.724939 17964 raft_consensus.cc:2243] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.725597 17964 raft_consensus.cc:2272] T d8e64e663e034ac9b3b4e8b51a27dac2 P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.727226 17964 tablet_replica.cc:333] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43: stopping tablet replica
I20260709 13:17:45.727650 17964 raft_consensus.cc:2243] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:45.728048 17964 raft_consensus.cc:2272] T d2ba71acd8f3492f9dea6092ec53dd0a P 7c8b0b69e4a64a1bac45f7d912616d43 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.753379 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
I20260709 13:17:45.768735 17964 master.cc:562] Master@127.17.139.62:39859 shutting down...
I20260709 13:17:45.936996 18051 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:17:45.967774 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:45.968333 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:45.968674 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1513cbba8ae24f8b8b6c10f40f118246: stopping tablet replica
I20260709 13:17:45.987553 17964 master.cc:584] Master@127.17.139.62:39859 shutdown complete.
7c8b0b69e4a64a1bac45f7d912616d43  1
7dbbd9fef5644548bf684f059f151ee5  4
9c42f27ce7cf45ea9c004b89f094e73e  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12644 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:17:46.025910 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:32819
I20260709 13:17:46.026986 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:46.032361 18457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:46.032624 18458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:46.034158 17964 server_base.cc:1061] running on GCE node
W20260709 13:17:46.034129 18460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:46.035211 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:46.035437 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:46.035555 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603066035543 us; error 0 us; skew 500 ppm
I20260709 13:17:46.035984 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:46.038232 17964 webserver.cc:533] Webserver started at http://127.17.139.62:46561/ using document root <none> and password file <none>
I20260709 13:17:46.038667 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:46.038820 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:46.039031 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:46.040024 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "1054e390f9fe4841824ace4df83c23fe"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.044063 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:17:46.047169 18465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.047861 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:46.048134 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "1054e390f9fe4841824ace4df83c23fe"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.048419 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:46.060544 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:46.061736 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:46.098266 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:32819
I20260709 13:17:46.098371 18516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:32819 every 8 connection(s)
I20260709 13:17:46.102011 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.110819 18517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe: Bootstrap starting.
I20260709 13:17:46.115123 18517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.118885 18517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe: No bootstrap required, opened a new log
I20260709 13:17:46.120770 18517 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1054e390f9fe4841824ace4df83c23fe" member_type: VOTER }
I20260709 13:17:46.121136 18517 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.121305 18517 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1054e390f9fe4841824ace4df83c23fe, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.121773 18517 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1054e390f9fe4841824ace4df83c23fe" member_type: VOTER }
I20260709 13:17:46.122154 18517 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:46.122331 18517 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:46.122543 18517 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:46.126235 18517 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1054e390f9fe4841824ace4df83c23fe" member_type: VOTER }
I20260709 13:17:46.126755 18517 leader_election.cc:304] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1054e390f9fe4841824ace4df83c23fe; no voters: 
I20260709 13:17:46.127840 18517 leader_election.cc:290] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:46.128163 18520 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:46.129448 18520 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 1 LEADER]: Becoming Leader. State: Replica: 1054e390f9fe4841824ace4df83c23fe, State: Running, Role: LEADER
I20260709 13:17:46.130071 18520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1054e390f9fe4841824ace4df83c23fe" member_type: VOTER }
I20260709 13:17:46.130745 18517 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:46.136061 18522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1054e390f9fe4841824ace4df83c23fe. Latest consensus state: current_term: 1 leader_uuid: "1054e390f9fe4841824ace4df83c23fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1054e390f9fe4841824ace4df83c23fe" member_type: VOTER } }
I20260709 13:17:46.136289 18521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1054e390f9fe4841824ace4df83c23fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1054e390f9fe4841824ace4df83c23fe" member_type: VOTER } }
I20260709 13:17:46.136658 18522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:46.136834 18521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:46.138496 18528 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:46.144362 18528 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:46.145426 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:46.152313 18528 catalog_manager.cc:1383] Generated new cluster ID: 5851c3b7e4444775bfb306cca3d09b26
I20260709 13:17:46.152585 18528 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:46.170392 18528 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:46.171550 18528 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:46.183910 18528 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe: Generated new TSK 0
I20260709 13:17:46.184463 18528 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:46.211745 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:46.217543 18538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:46.218525 18539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:46.220482 17964 server_base.cc:1061] running on GCE node
W20260709 13:17:46.220836 18541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:46.221696 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:46.221866 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:46.221983 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603066221972 us; error 0 us; skew 500 ppm
I20260709 13:17:46.222441 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:46.224490 17964 webserver.cc:533] Webserver started at http://127.17.139.1:38689/ using document root <none> and password file <none>
I20260709 13:17:46.225003 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:46.225169 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:46.225369 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:46.226331 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "ef471ec398df4226b58133e90d9c2a59"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.230589 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:46.233732 18546 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.234431 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:46.234738 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "ef471ec398df4226b58133e90d9c2a59"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.234997 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:46.254477 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:46.256047 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:46.258526 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:46.260699 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:46.260929 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.261191 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:46.261371 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.310791 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:41559
I20260709 13:17:46.310878 18608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:41559 every 8 connection(s)
I20260709 13:17:46.315584 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:46.321928 18613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:46.323077 18614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:46.324644 18616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:46.326179 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:46.326912 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:46.327081 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:46.327200 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603066327190 us; error 0 us; skew 500 ppm
I20260709 13:17:46.327620 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:46.329870 17964 webserver.cc:533] Webserver started at http://127.17.139.2:32795/ using document root <none> and password file <none>
I20260709 13:17:46.330314 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:46.330474 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:46.330686 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:46.331754 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.336176 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:46.338740 18609 heartbeater.cc:344] Connected to a master server at 127.17.139.62:32819
I20260709 13:17:46.339098 18609 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:46.339957 18609 heartbeater.cc:507] Master 127.17.139.62:32819 requested a full tablet report, sending...
I20260709 13:17:46.340955 18621 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.341744 17964 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:46.342079 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.342378 18482 ts_manager.cc:194] Registered new tserver with Master: ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559)
I20260709 13:17:46.342433 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:46.344758 18482 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38386
I20260709 13:17:46.368031 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:46.369385 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:46.370821 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:46.373077 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:46.373306 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.373548 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:46.373720 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.412758 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:46365
I20260709 13:17:46.412947 18683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:46365 every 8 connection(s)
I20260709 13:17:46.417287 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:46.424337 18687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:46.425654 18688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:46.427145 18690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:46.428159 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:46.429036 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:46.429272 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:46.429369 18684 heartbeater.cc:344] Connected to a master server at 127.17.139.62:32819
I20260709 13:17:46.429512 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603066429490 us; error 0 us; skew 500 ppm
I20260709 13:17:46.429798 18684 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:46.430188 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:46.430548 18684 heartbeater.cc:507] Master 127.17.139.62:32819 requested a full tablet report, sending...
I20260709 13:17:46.432720 18482 ts_manager.cc:194] Registered new tserver with Master: becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:46.432958 17964 webserver.cc:533] Webserver started at http://127.17.139.3:43913/ using document root <none> and password file <none>
I20260709 13:17:46.433542 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:46.433734 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:46.434033 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:46.434307 18482 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38388
I20260709 13:17:46.435204 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "5885e806f30545dd870389d2f5029618"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.439527 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:46.442670 18695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.443338 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:46.443637 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "5885e806f30545dd870389d2f5029618"
format_stamp: "Formatted at 2026-07-09 13:17:46 on dist-test-slave-z675"
I20260709 13:17:46.443893 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:46.457787 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:46.458895 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:46.460227 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:46.462261 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:46.462482 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.462715 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:46.462886 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:46.501266 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:36815
I20260709 13:17:46.501362 18757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:36815 every 8 connection(s)
I20260709 13:17:46.514603 18758 heartbeater.cc:344] Connected to a master server at 127.17.139.62:32819
I20260709 13:17:46.514940 18758 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:46.515614 18758 heartbeater.cc:507] Master 127.17.139.62:32819 requested a full tablet report, sending...
I20260709 13:17:46.517405 18482 ts_manager.cc:194] Registered new tserver with Master: 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:46.517700 17964 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01333922s
I20260709 13:17:46.518683 18482 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38396
I20260709 13:17:46.540992 18482 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38410:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:46.543731 18482 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:46.626984 18722 tablet_service.cc:1511] Processing CreateTablet for tablet 34876c3dddbe455db3c699b7635e2a64 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:46.627734 18723 tablet_service.cc:1511] Processing CreateTablet for tablet c381efa54e4946f082f5902a07b7aedb (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:46.628540 18722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34876c3dddbe455db3c699b7635e2a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.630010 18721 tablet_service.cc:1511] Processing CreateTablet for tablet d8564fa436704b018e1fc017bbec738e (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:46.630326 18574 tablet_service.cc:1511] Processing CreateTablet for tablet c381efa54e4946f082f5902a07b7aedb (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:46.631289 18721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8564fa436704b018e1fc017bbec738e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.631606 18574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c381efa54e4946f082f5902a07b7aedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.633427 18573 tablet_service.cc:1511] Processing CreateTablet for tablet 34876c3dddbe455db3c699b7635e2a64 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:46.634058 18720 tablet_service.cc:1511] Processing CreateTablet for tablet 727b544e776a48979f8d948b991d1cc7 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:46.634690 18573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34876c3dddbe455db3c699b7635e2a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.635320 18720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727b544e776a48979f8d948b991d1cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.638232 18572 tablet_service.cc:1511] Processing CreateTablet for tablet d8564fa436704b018e1fc017bbec738e (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:46.639470 18572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8564fa436704b018e1fc017bbec738e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.640645 18568 tablet_service.cc:1511] Processing CreateTablet for tablet 637793f279834387b5e3483a7da00bd4 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:46.641920 18568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637793f279834387b5e3483a7da00bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.645073 18569 tablet_service.cc:1511] Processing CreateTablet for tablet a9832810216c4c83a5ab7e91f50e7c26 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:46.639489 18567 tablet_service.cc:1511] Processing CreateTablet for tablet 3879352733954380a925a48634dd5808 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:46.646394 18569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9832810216c4c83a5ab7e91f50e7c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.647032 18570 tablet_service.cc:1511] Processing CreateTablet for tablet 1da13ccdb09c42a88b73b8b311e3e42d (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:46.648262 18570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da13ccdb09c42a88b73b8b311e3e42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.650009 18571 tablet_service.cc:1511] Processing CreateTablet for tablet 727b544e776a48979f8d948b991d1cc7 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:46.651262 18571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727b544e776a48979f8d948b991d1cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.653429 18567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879352733954380a925a48634dd5808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.657552 18649 tablet_service.cc:1511] Processing CreateTablet for tablet c381efa54e4946f082f5902a07b7aedb (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:46.658802 18649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c381efa54e4946f082f5902a07b7aedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.659744 18566 tablet_service.cc:1511] Processing CreateTablet for tablet cfd0bb72b17f4c3483242e36ccc46162 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:46.660084 18565 tablet_service.cc:1511] Processing CreateTablet for tablet 5a743f2612de41589b8386d67b0de55a (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:46.661046 18566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd0bb72b17f4c3483242e36ccc46162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.661512 18723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c381efa54e4946f082f5902a07b7aedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.662070 18648 tablet_service.cc:1511] Processing CreateTablet for tablet 34876c3dddbe455db3c699b7635e2a64 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:46.662801 18565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a743f2612de41589b8386d67b0de55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.663340 18648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34876c3dddbe455db3c699b7635e2a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.664610 18715 tablet_service.cc:1511] Processing CreateTablet for tablet cfd0bb72b17f4c3483242e36ccc46162 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:46.666285 18715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd0bb72b17f4c3483242e36ccc46162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.668628 18716 tablet_service.cc:1511] Processing CreateTablet for tablet 3879352733954380a925a48634dd5808 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:46.670351 18716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879352733954380a925a48634dd5808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.672760 18717 tablet_service.cc:1511] Processing CreateTablet for tablet 637793f279834387b5e3483a7da00bd4 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:46.674652 18717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637793f279834387b5e3483a7da00bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.677256 18718 tablet_service.cc:1511] Processing CreateTablet for tablet a9832810216c4c83a5ab7e91f50e7c26 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:46.678908 18718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9832810216c4c83a5ab7e91f50e7c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.681432 18642 tablet_service.cc:1511] Processing CreateTablet for tablet 3879352733954380a925a48634dd5808 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:46.683105 18642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3879352733954380a925a48634dd5808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.685606 18643 tablet_service.cc:1511] Processing CreateTablet for tablet 637793f279834387b5e3483a7da00bd4 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:46.687296 18643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637793f279834387b5e3483a7da00bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.689288 18644 tablet_service.cc:1511] Processing CreateTablet for tablet a9832810216c4c83a5ab7e91f50e7c26 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:46.690917 18644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9832810216c4c83a5ab7e91f50e7c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.693490 18645 tablet_service.cc:1511] Processing CreateTablet for tablet 1da13ccdb09c42a88b73b8b311e3e42d (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:46.695155 18645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da13ccdb09c42a88b73b8b311e3e42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.697686 18646 tablet_service.cc:1511] Processing CreateTablet for tablet 727b544e776a48979f8d948b991d1cc7 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:46.699317 18646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727b544e776a48979f8d948b991d1cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.701896 18647 tablet_service.cc:1511] Processing CreateTablet for tablet d8564fa436704b018e1fc017bbec738e (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:46.703543 18647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8564fa436704b018e1fc017bbec738e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.708940 18719 tablet_service.cc:1511] Processing CreateTablet for tablet 1da13ccdb09c42a88b73b8b311e3e42d (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:46.710629 18719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1da13ccdb09c42a88b73b8b311e3e42d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.714444 18641 tablet_service.cc:1511] Processing CreateTablet for tablet cfd0bb72b17f4c3483242e36ccc46162 (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:46.716006 18641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd0bb72b17f4c3483242e36ccc46162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.718317 18640 tablet_service.cc:1511] Processing CreateTablet for tablet 5a743f2612de41589b8386d67b0de55a (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:46.719568 18640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a743f2612de41589b8386d67b0de55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.729754 18714 tablet_service.cc:1511] Processing CreateTablet for tablet 5a743f2612de41589b8386d67b0de55a (DEFAULT_TABLE table=test-workload [id=b507cefe659c45f0b3c40d1cee563055]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:46.735040 18714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a743f2612de41589b8386d67b0de55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:46.805553 18774 tablet_bootstrap.cc:492] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:46.809500 18773 tablet_bootstrap.cc:492] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:46.828094 18775 tablet_bootstrap.cc:492] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:46.826977 18773 tablet_bootstrap.cc:654] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.836738 18774 tablet_bootstrap.cc:654] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.839632 18775 tablet_bootstrap.cc:654] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.847819 18773 tablet_bootstrap.cc:492] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:46.848362 18773 ts_tablet_manager.cc:1403] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.014s
I20260709 13:17:46.852219 18773 raft_consensus.cc:359] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.853257 18773 raft_consensus.cc:385] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.853706 18773 raft_consensus.cc:740] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.855052 18773 consensus_queue.cc:260] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.859989 18609 heartbeater.cc:499] Master 127.17.139.62:32819 was elected leader, sending a full tablet report...
I20260709 13:17:46.860464 18773 ts_tablet_manager.cc:1434] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:17:46.861322 18773 tablet_bootstrap.cc:492] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:46.865834 18773 tablet_bootstrap.cc:654] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.867082 18775 tablet_bootstrap.cc:492] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:46.867576 18775 ts_tablet_manager.cc:1403] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.006s
I20260709 13:17:46.871395 18775 raft_consensus.cc:359] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.872483 18775 raft_consensus.cc:385] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.872956 18775 raft_consensus.cc:740] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.874173 18775 consensus_queue.cc:260] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.880683 18773 tablet_bootstrap.cc:492] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:46.881233 18684 heartbeater.cc:499] Master 127.17.139.62:32819 was elected leader, sending a full tablet report...
I20260709 13:17:46.882177 18775 ts_tablet_manager.cc:1434] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:17:46.883095 18775 tablet_bootstrap.cc:492] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:46.881245 18773 ts_tablet_manager.cc:1403] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:17:46.889086 18773 raft_consensus.cc:359] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.889911 18773 raft_consensus.cc:385] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.890255 18773 raft_consensus.cc:740] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.890990 18773 consensus_queue.cc:260] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.892375 18774 tablet_bootstrap.cc:492] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:46.892930 18774 ts_tablet_manager.cc:1403] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.012s
I20260709 13:17:46.893180 18773 ts_tablet_manager.cc:1434] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:46.894140 18773 tablet_bootstrap.cc:492] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:46.895967 18774 raft_consensus.cc:359] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.896731 18774 raft_consensus.cc:385] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.897120 18774 raft_consensus.cc:740] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.897946 18774 consensus_queue.cc:260] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.889603 18775 tablet_bootstrap.cc:654] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.902447 18758 heartbeater.cc:499] Master 127.17.139.62:32819 was elected leader, sending a full tablet report...
I20260709 13:17:46.902849 18774 ts_tablet_manager.cc:1434] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:17:46.903800 18774 tablet_bootstrap.cc:492] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:46.908732 18773 tablet_bootstrap.cc:654] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.911340 18774 tablet_bootstrap.cc:654] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.914909 18773 tablet_bootstrap.cc:492] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:46.915397 18773 ts_tablet_manager.cc:1403] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:17:46.918988 18773 raft_consensus.cc:359] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.919742 18773 raft_consensus.cc:385] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.920073 18773 raft_consensus.cc:740] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.920961 18773 consensus_queue.cc:260] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.923131 18773 ts_tablet_manager.cc:1434] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:46.924180 18773 tablet_bootstrap.cc:492] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:46.924281 18774 tablet_bootstrap.cc:492] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:46.924988 18774 ts_tablet_manager.cc:1403] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.010s
I20260709 13:17:46.926095 18778 raft_consensus.cc:493] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.926555 18778 raft_consensus.cc:515] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.928812 18774 raft_consensus.cc:359] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.935108 18774 raft_consensus.cc:385] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.935547 18774 raft_consensus.cc:740] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.937076 18773 tablet_bootstrap.cc:654] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.936681 18774 consensus_queue.cc:260] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.943135 18774 ts_tablet_manager.cc:1434] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.005s
I20260709 13:17:46.945930 18778 leader_election.cc:290] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:46.946489 18774 tablet_bootstrap.cc:492] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:46.953959 18773 tablet_bootstrap.cc:492] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:46.954550 18773 ts_tablet_manager.cc:1403] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.007s
I20260709 13:17:46.956444 18659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
W20260709 13:17:46.959009 18547 leader_election.cc:343] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.959475 18774 tablet_bootstrap.cc:654] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.963263 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
W20260709 13:17:46.964849 18548 leader_election.cc:343] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:46.965291 18548 leader_election.cc:304] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef471ec398df4226b58133e90d9c2a59; no voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:46.966420 18775 tablet_bootstrap.cc:492] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:46.966398 18778 raft_consensus.cc:2749] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:46.967015 18775 ts_tablet_manager.cc:1403] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.084s	user 0.033s	sys 0.028s
I20260709 13:17:46.960417 18773 raft_consensus.cc:359] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.967828 18773 raft_consensus.cc:385] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.968184 18773 raft_consensus.cc:740] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.968961 18773 consensus_queue.cc:260] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.969921 18775 raft_consensus.cc:359] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.970577 18775 raft_consensus.cc:385] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.970855 18775 raft_consensus.cc:740] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.971565 18775 consensus_queue.cc:260] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.973006 18773 ts_tablet_manager.cc:1434] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:17:46.973966 18773 tablet_bootstrap.cc:492] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:46.975486 18775 ts_tablet_manager.cc:1434] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:46.976439 18775 tablet_bootstrap.cc:492] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:46.980213 18773 tablet_bootstrap.cc:654] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.982796 18775 tablet_bootstrap.cc:654] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:46.983011 18774 tablet_bootstrap.cc:492] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:46.983487 18774 ts_tablet_manager.cc:1403] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.008s
I20260709 13:17:46.987223 18774 raft_consensus.cc:359] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.988821 18774 raft_consensus.cc:385] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.989179 18774 raft_consensus.cc:740] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.990437 18774 consensus_queue.cc:260] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.991916 18773 tablet_bootstrap.cc:492] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:46.992055 18775 tablet_bootstrap.cc:492] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:46.992460 18773 ts_tablet_manager.cc:1403] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.009s
I20260709 13:17:46.992558 18774 ts_tablet_manager.cc:1434] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:17:46.992578 18775 ts_tablet_manager.cc:1403] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:17:46.993768 18774 tablet_bootstrap.cc:492] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:46.995416 18773 raft_consensus.cc:359] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.995678 18775 raft_consensus.cc:359] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.996197 18773 raft_consensus.cc:385] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.996506 18775 raft_consensus.cc:385] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:46.996598 18773 raft_consensus.cc:740] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.996958 18775 raft_consensus.cc:740] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:46.997640 18773 consensus_queue.cc:260] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:46.997960 18775 consensus_queue.cc:260] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.000128 18775 ts_tablet_manager.cc:1434] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:17:47.000422 18774 tablet_bootstrap.cc:654] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.001142 18775 tablet_bootstrap.cc:492] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:47.001966 18781 raft_consensus.cc:493] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.002422 18781 raft_consensus.cc:515] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.010032 18781 leader_election.cc:290] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.012269 18773 ts_tablet_manager.cc:1434] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260709 13:17:47.013221 18773 tablet_bootstrap.cc:492] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:47.017338 18774 tablet_bootstrap.cc:492] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:47.019342 18773 tablet_bootstrap.cc:654] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.019804 18774 ts_tablet_manager.cc:1403] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:17:47.023119 18775 tablet_bootstrap.cc:654] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.022769 18774 raft_consensus.cc:359] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.027556 18774 raft_consensus.cc:385] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.030671 18781 raft_consensus.cc:493] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.030687 18774 raft_consensus.cc:740] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.031136 18781 raft_consensus.cc:515] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.031989 18774 consensus_queue.cc:260] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.036893 18781 leader_election.cc:290] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.038823 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.039656 18584 raft_consensus.cc:2468] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 0.
I20260709 13:17:47.041188 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd0bb72b17f4c3483242e36ccc46162" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.042004 18583 raft_consensus.cc:2468] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 0.
I20260709 13:17:47.043551 18775 tablet_bootstrap.cc:492] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:47.043715 18624 leader_election.cc:304] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.044050 18775 ts_tablet_manager.cc:1403] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.008s
I20260709 13:17:47.044384 18774 ts_tablet_manager.cc:1434] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:17:47.044683 18624 leader_election.cc:304] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.045205 18781 raft_consensus.cc:2804] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.049606 18781 raft_consensus.cc:493] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.046931 18775 raft_consensus.cc:359] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.049691 18774 tablet_bootstrap.cc:492] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:47.050012 18781 raft_consensus.cc:3060] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.050077 18775 raft_consensus.cc:385] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.050608 18775 raft_consensus.cc:740] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.045521 18773 tablet_bootstrap.cc:492] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:47.051357 18773 ts_tablet_manager.cc:1403] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.012s
I20260709 13:17:47.051321 18775 consensus_queue.cc:260] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.053224 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.054433 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd0bb72b17f4c3483242e36ccc46162" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.054349 18773 raft_consensus.cc:359] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.055094 18773 raft_consensus.cc:385] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.055374 18773 raft_consensus.cc:740] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
W20260709 13:17:47.056114 18623 leader_election.cc:343] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.056082 18773 consensus_queue.cc:260] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
W20260709 13:17:47.057081 18623 leader_election.cc:343] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.058669 18774 tablet_bootstrap.cc:654] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.063027 18781 raft_consensus.cc:515] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.065289 18773 ts_tablet_manager.cc:1434] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:17:47.068032 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
W20260709 13:17:47.069397 18623 leader_election.cc:343] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.071115 18781 leader_election.cc:290] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.072036 18781 raft_consensus.cc:2804] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.073099 18773 tablet_bootstrap.cc:492] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:47.073001 18781 raft_consensus.cc:493] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.073841 18781 raft_consensus.cc:3060] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.075749 18774 tablet_bootstrap.cc:492] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:47.076426 18774 ts_tablet_manager.cc:1403] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.000s
I20260709 13:17:47.080351 18773 tablet_bootstrap.cc:654] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.080267 18774 raft_consensus.cc:359] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.081215 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:47.081535 18774 raft_consensus.cc:385] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.081843 18583 raft_consensus.cc:3060] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.081962 18774 raft_consensus.cc:740] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.083140 18774 consensus_queue.cc:260] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.084755 18782 raft_consensus.cc:493] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.085319 18782 raft_consensus.cc:515] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.089226 18778 raft_consensus.cc:493] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.089851 18778 raft_consensus.cc:515] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.092972 18778 leader_election.cc:290] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.094707 18659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8564fa436704b018e1fc017bbec738e" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
W20260709 13:17:47.096704 18547 leader_election.cc:343] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.100515 18583 raft_consensus.cc:2468] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 1.
I20260709 13:17:47.102126 18782 leader_election.cc:290] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:47.102260 18624 leader_election.cc:304] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 5885e806f30545dd870389d2f5029618
I20260709 13:17:47.109047 18797 raft_consensus.cc:2804] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.109549 18797 raft_consensus.cc:697] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:47.111127 18797 consensus_queue.cc:237] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.111923 18775 ts_tablet_manager.cc:1434] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.068s	user 0.025s	sys 0.036s
I20260709 13:17:47.113674 18774 ts_tablet_manager.cc:1434] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:17:47.118861 18775 tablet_bootstrap.cc:492] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:47.118892 18774 tablet_bootstrap.cc:492] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:47.122007 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8564fa436704b018e1fc017bbec738e" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.122628 18732 raft_consensus.cc:2468] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 0.
I20260709 13:17:47.123778 18548 leader_election.cc:304] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:47.124850 18778 raft_consensus.cc:2804] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.125228 18778 raft_consensus.cc:493] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.125546 18778 raft_consensus.cc:3060] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.129029 18774 tablet_bootstrap.cc:654] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.116832 18781 raft_consensus.cc:515] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.134531 18775 tablet_bootstrap.cc:654] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:47.142412 18530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:47.144553 18778 raft_consensus.cc:515] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.149324 18798 raft_consensus.cc:493] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.149739 18778 leader_election.cc:290] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.150022 18659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8564fa436704b018e1fc017bbec738e" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:47.149780 18798 raft_consensus.cc:515] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
W20260709 13:17:47.151278 18547 leader_election.cc:343] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.152796 18798 leader_election.cc:290] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815), ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559)
I20260709 13:17:47.153239 18782 raft_consensus.cc:493] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.153429 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8564fa436704b018e1fc017bbec738e" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:47.154284 18732 raft_consensus.cc:3060] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.154031 18782 raft_consensus.cc:515] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.154558 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.155321 18773 tablet_bootstrap.cc:492] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:47.155772 18773 ts_tablet_manager.cc:1403] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.083s	user 0.028s	sys 0.040s
I20260709 13:17:47.155633 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
W20260709 13:17:47.157051 18624 leader_election.cc:343] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.157195 18782 leader_election.cc:290] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
W20260709 13:17:47.157768 18623 leader_election.cc:343] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.158174 18623 leader_election.cc:304] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:47.158993 18781 leader_election.cc:290] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.159531 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd0bb72b17f4c3483242e36ccc46162" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:47.160089 18583 raft_consensus.cc:3060] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.162237 18773 raft_consensus.cc:359] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.162998 18773 raft_consensus.cc:385] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.163311 18773 raft_consensus.cc:740] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.163587 18775 tablet_bootstrap.cc:492] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:47.164080 18775 ts_tablet_manager.cc:1403] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.010s
I20260709 13:17:47.164048 18773 consensus_queue.cc:260] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.166452 18773 ts_tablet_manager.cc:1434] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:17:47.166740 18583 raft_consensus.cc:2468] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 1.
I20260709 13:17:47.167368 18773 tablet_bootstrap.cc:492] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:47.167565 18482 catalog_manager.cc:5697] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.171267 18659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
I20260709 13:17:47.172564 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
I20260709 13:17:47.174155 18773 tablet_bootstrap.cc:654] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:47.174285 18696 leader_election.cc:343] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.177706 18781 raft_consensus.cc:2749] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:47.179271 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd0bb72b17f4c3483242e36ccc46162" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
W20260709 13:17:47.180068 18696 leader_election.cc:343] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.179832 18775 raft_consensus.cc:359] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.180500 18775 raft_consensus.cc:385] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.180794 18775 raft_consensus.cc:740] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.181237 18624 leader_election.cc:304] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.181510 18775 consensus_queue.cc:260] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.182905 18797 raft_consensus.cc:2804] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.183468 18797 raft_consensus.cc:697] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:47.184533 18797 consensus_queue.cc:237] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
W20260709 13:17:47.188064 18623 leader_election.cc:343] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.190210 18775 ts_tablet_manager.cc:1434] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:17:47.190438 18732 raft_consensus.cc:2468] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 1.
I20260709 13:17:47.191147 18775 tablet_bootstrap.cc:492] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:47.191771 18548 leader_election.cc:304] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:47.192940 18778 raft_consensus.cc:2804] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.196786 18774 tablet_bootstrap.cc:492] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:47.197474 18774 ts_tablet_manager.cc:1403] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.006s
I20260709 13:17:47.198288 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.199424 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.200519 18774 raft_consensus.cc:359] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
W20260709 13:17:47.201066 18698 leader_election.cc:343] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.201311 18774 raft_consensus.cc:385] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.201601 18774 raft_consensus.cc:740] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.201509 18698 leader_election.cc:304] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5885e806f30545dd870389d2f5029618; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59
W20260709 13:17:47.202620 18698 leader_election.cc:343] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.202453 18774 consensus_queue.cc:260] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.203011 18698 leader_election.cc:304] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5885e806f30545dd870389d2f5029618; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:47.203789 18782 raft_consensus.cc:2749] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:47.205363 18782 raft_consensus.cc:2749] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:47.208165 18773 tablet_bootstrap.cc:492] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:47.208611 18773 ts_tablet_manager.cc:1403] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.011s
I20260709 13:17:47.210983 18778 raft_consensus.cc:697] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:47.211323 18773 raft_consensus.cc:359] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.212302 18773 raft_consensus.cc:385] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.211982 18778 consensus_queue.cc:237] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.212769 18773 raft_consensus.cc:740] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.212558 18775 tablet_bootstrap.cc:654] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.213964 18773 consensus_queue.cc:260] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.216041 18807 raft_consensus.cc:493] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.216647 18807 raft_consensus.cc:515] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.220271 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
I20260709 13:17:47.221021 18658 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 0.
I20260709 13:17:47.221503 18807 leader_election.cc:290] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.222491 18547 leader_election.cc:304] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.222779 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.223444 18807 raft_consensus.cc:2804] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.223567 18732 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 0.
I20260709 13:17:47.223887 18807 raft_consensus.cc:493] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.224354 18807 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.226918 18773 ts_tablet_manager.cc:1434] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:17:47.228230 18773 tablet_bootstrap.cc:492] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:47.230468 18774 ts_tablet_manager.cc:1434] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 13:17:47.232214 18807 raft_consensus.cc:515] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.233666 18775 tablet_bootstrap.cc:492] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:47.234128 18775 ts_tablet_manager.cc:1403] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.005s
I20260709 13:17:47.234891 18774 tablet_bootstrap.cc:492] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:47.236285 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:47.236896 18658 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.237800 18773 tablet_bootstrap.cc:654] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.241889 18775 raft_consensus.cc:359] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.242821 18775 raft_consensus.cc:385] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.243196 18775 raft_consensus.cc:740] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.243772 18479 catalog_manager.cc:5697] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.244097 18775 consensus_queue.cc:260] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.247560 18775 ts_tablet_manager.cc:1434] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:17:47.248817 18775 tablet_bootstrap.cc:492] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:47.250686 18774 tablet_bootstrap.cc:654] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.253309 18778 raft_consensus.cc:493] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.253867 18778 raft_consensus.cc:515] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.258256 18659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34876c3dddbe455db3c699b7635e2a64" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
W20260709 13:17:47.259758 18547 leader_election.cc:343] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.260321 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34876c3dddbe455db3c699b7635e2a64" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.261129 18732 raft_consensus.cc:2468] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 0.
I20260709 13:17:47.260334 18778 leader_election.cc:290] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.262395 18548 leader_election.cc:304] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:47.263386 18775 tablet_bootstrap.cc:654] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.263942 18778 raft_consensus.cc:2804] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.264477 18778 raft_consensus.cc:493] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.264963 18778 raft_consensus.cc:3060] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.273176 18658 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 1.
I20260709 13:17:47.275410 18547 leader_election.cc:304] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.275470 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:47.276194 18732 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.276293 18812 raft_consensus.cc:2804] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.272830 18774 tablet_bootstrap.cc:492] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:47.276239 18807 leader_election.cc:290] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.277467 18774 ts_tablet_manager.cc:1403] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.004s
I20260709 13:17:47.280498 18778 raft_consensus.cc:515] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.283284 18778 leader_election.cc:290] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.280345 18774 raft_consensus.cc:359] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.284718 18774 raft_consensus.cc:385] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.285058 18774 raft_consensus.cc:740] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.285768 18774 consensus_queue.cc:260] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.286651 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34876c3dddbe455db3c699b7635e2a64" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:47.286208 18773 tablet_bootstrap.cc:492] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:47.287470 18773 ts_tablet_manager.cc:1403] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.019s
I20260709 13:17:47.289925 18773 raft_consensus.cc:359] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.290526 18773 raft_consensus.cc:385] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.290771 18773 raft_consensus.cc:740] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
W20260709 13:17:47.291345 18547 leader_election.cc:343] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.291385 18773 consensus_queue.cc:260] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.292064 18732 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 1.
I20260709 13:17:47.287312 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34876c3dddbe455db3c699b7635e2a64" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:47.292776 18733 raft_consensus.cc:3060] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.293524 18479 catalog_manager.cc:5697] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.294881 18774 ts_tablet_manager.cc:1434] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:17:47.298666 18775 tablet_bootstrap.cc:492] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:47.299239 18775 ts_tablet_manager.cc:1403] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.007s
I20260709 13:17:47.300357 18773 ts_tablet_manager.cc:1434] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:47.301231 18773 tablet_bootstrap.cc:492] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59: Bootstrap starting.
I20260709 13:17:47.302685 18774 tablet_bootstrap.cc:492] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:47.305953 18778 raft_consensus.cc:493] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.304684 18733 raft_consensus.cc:2468] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 1.
I20260709 13:17:47.306440 18773 tablet_bootstrap.cc:654] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.306526 18778 raft_consensus.cc:515] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.307516 18548 leader_election.cc:304] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:47.308933 18807 raft_consensus.cc:2804] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.309299 18774 tablet_bootstrap.cc:654] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.309518 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
I20260709 13:17:47.309533 18807 raft_consensus.cc:697] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:47.310222 18658 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 0.
I20260709 13:17:47.310750 18807 consensus_queue.cc:237] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.311533 18547 leader_election.cc:304] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.314386 18778 leader_election.cc:290] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.314754 18823 raft_consensus.cc:2804] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.316593 18823 raft_consensus.cc:493] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.317004 18823 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.316780 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.317636 18732 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 0.
I20260709 13:17:47.322825 18775 raft_consensus.cc:359] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.323680 18775 raft_consensus.cc:385] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.323994 18775 raft_consensus.cc:740] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.325363 18775 consensus_queue.cc:260] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.326960 18774 tablet_bootstrap.cc:492] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:47.327453 18774 ts_tablet_manager.cc:1403] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.008s
I20260709 13:17:47.327921 18823 raft_consensus.cc:515] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.330199 18774 raft_consensus.cc:359] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.330677 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:47.330951 18774 raft_consensus.cc:385] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.331226 18658 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.331336 18774 raft_consensus.cc:740] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.332204 18774 consensus_queue.cc:260] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.334208 18774 ts_tablet_manager.cc:1434] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:47.335073 18774 tablet_bootstrap.cc:492] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:47.336076 18775 ts_tablet_manager.cc:1434] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.006s
I20260709 13:17:47.337133 18797 raft_consensus.cc:493] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.337684 18797 raft_consensus.cc:515] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.341447 18797 leader_election.cc:290] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.341712 18774 tablet_bootstrap.cc:654] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.342146 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
W20260709 13:17:47.343905 18624 leader_election.cc:343] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.345261 18732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.346431 18812 raft_consensus.cc:697] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:47.347503 18775 tablet_bootstrap.cc:492] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:47.347095 18732 raft_consensus.cc:2468] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 0.
I20260709 13:17:47.348974 18823 leader_election.cc:290] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.350817 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:47.350868 18623 leader_election.cc:304] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:47.351325 18733 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.351657 18797 raft_consensus.cc:2804] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.352031 18797 raft_consensus.cc:493] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.352373 18797 raft_consensus.cc:3060] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.354445 18781 raft_consensus.cc:493] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.354879 18781 raft_consensus.cc:515] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.355279 18658 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 1.
I20260709 13:17:47.356515 18547 leader_election.cc:304] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.356839 18781 leader_election.cc:290] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.357484 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.358131 18584 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 0.
I20260709 13:17:47.358462 18731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.359313 18731 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 0.
I20260709 13:17:47.359807 18624 leader_election.cc:304] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.359920 18797 raft_consensus.cc:515] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.360579 18781 raft_consensus.cc:2804] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.360949 18781 raft_consensus.cc:493] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.361286 18781 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.362282 18797 leader_election.cc:290] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.362654 18733 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 1.
I20260709 13:17:47.363452 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:47.364521 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:47.365103 18733 raft_consensus.cc:3060] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:47.365188 18624 leader_election.cc:343] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:47.366472 18773 tablet_bootstrap.cc:492] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59: No bootstrap required, opened a new log
I20260709 13:17:47.366962 18773 ts_tablet_manager.cc:1403] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.006s
I20260709 13:17:47.369520 18773 raft_consensus.cc:359] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.370383 18773 raft_consensus.cc:385] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.370707 18773 raft_consensus.cc:740] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.348073 18812 consensus_queue.cc:237] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.371411 18773 consensus_queue.cc:260] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.372258 18821 raft_consensus.cc:2804] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.371759 18733 raft_consensus.cc:2468] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 1.
I20260709 13:17:47.373476 18821 raft_consensus.cc:697] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:47.374002 18773 ts_tablet_manager.cc:1434] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:47.375586 18623 leader_election.cc:304] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:47.374302 18821 consensus_queue.cc:237] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.376502 18797 raft_consensus.cc:2804] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.371754 18781 raft_consensus.cc:515] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.377197 18797 raft_consensus.cc:697] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:47.377961 18797 consensus_queue.cc:237] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.379436 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:47.380031 18584 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.380038 18781 leader_election.cc:290] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.382889 18775 tablet_bootstrap.cc:654] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.384136 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:47.384701 18733 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.386626 18774 tablet_bootstrap.cc:492] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:47.387054 18774 ts_tablet_manager.cc:1403] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.004s
I20260709 13:17:47.387432 18584 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 1.
I20260709 13:17:47.388535 18624 leader_election.cc:304] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.389328 18797 raft_consensus.cc:2804] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.389778 18797 raft_consensus.cc:697] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:47.389654 18774 raft_consensus.cc:359] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.390282 18774 raft_consensus.cc:385] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.390563 18774 raft_consensus.cc:740] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.390129 18482 catalog_manager.cc:5697] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.390584 18797 consensus_queue.cc:237] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.391299 18775 tablet_bootstrap.cc:492] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:47.391916 18775 ts_tablet_manager.cc:1403] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.004s
I20260709 13:17:47.391294 18774 consensus_queue.cc:260] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.394439 18775 raft_consensus.cc:359] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.395023 18775 raft_consensus.cc:385] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.395282 18775 raft_consensus.cc:740] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.401934 18774 ts_tablet_manager.cc:1434] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:17:47.406196 18774 tablet_bootstrap.cc:492] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618: Bootstrap starting.
I20260709 13:17:47.409611 18813 raft_consensus.cc:493] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.410081 18813 raft_consensus.cc:515] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.412336 18813 leader_election.cc:290] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:47.413130 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.413918 18584 raft_consensus.cc:2393] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5885e806f30545dd870389d2f5029618 in current term 1: Already voted for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in this term.
I20260709 13:17:47.414077 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
I20260709 13:17:47.415292 18696 leader_election.cc:304] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5885e806f30545dd870389d2f5029618; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:47.416119 18813 raft_consensus.cc:3060] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.401714 18775 consensus_queue.cc:260] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.417745 18774 tablet_bootstrap.cc:654] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.417335 18479 catalog_manager.cc:5697] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.418659 18775 ts_tablet_manager.cc:1434] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:17:47.419620 18775 tablet_bootstrap.cc:492] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:47.421878 18479 catalog_manager.cc:5697] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.423195 18813 raft_consensus.cc:2749] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:47.425822 18775 tablet_bootstrap.cc:654] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.426206 18774 tablet_bootstrap.cc:492] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618: No bootstrap required, opened a new log
I20260709 13:17:47.426669 18774 ts_tablet_manager.cc:1403] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 13:17:47.429991 18774 raft_consensus.cc:359] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.430884 18774 raft_consensus.cc:385] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.431303 18774 raft_consensus.cc:740] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.432180 18774 consensus_queue.cc:260] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.433743 18775 tablet_bootstrap.cc:492] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:47.434015 18774 ts_tablet_manager.cc:1434] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:47.434190 18775 ts_tablet_manager.cc:1403] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.006s
I20260709 13:17:47.431052 18482 catalog_manager.cc:5697] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.436776 18775 raft_consensus.cc:359] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.437443 18775 raft_consensus.cc:385] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.437734 18775 raft_consensus.cc:740] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.438438 18775 consensus_queue.cc:260] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.440594 18775 ts_tablet_manager.cc:1434] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:17:47.441408 18775 tablet_bootstrap.cc:492] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5: Bootstrap starting.
I20260709 13:17:47.441658 18733 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 1.
I20260709 13:17:47.445127 18480 catalog_manager.cc:5697] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.447075 18775 tablet_bootstrap.cc:654] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:47.451476 18775 tablet_bootstrap.cc:492] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5: No bootstrap required, opened a new log
I20260709 13:17:47.451902 18775 ts_tablet_manager.cc:1403] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:17:47.454393 18775 raft_consensus.cc:359] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.455032 18775 raft_consensus.cc:385] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:47.455299 18775 raft_consensus.cc:740] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Initialized, Role: FOLLOWER
I20260709 13:17:47.455940 18775 consensus_queue.cc:260] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.457669 18775 ts_tablet_manager.cc:1434] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:47.539991 18813 raft_consensus.cc:493] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.540532 18813 raft_consensus.cc:515] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.542150 18797 consensus_queue.cc:1048] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.542555 18813 leader_election.cc:290] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559)
I20260709 13:17:47.543226 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
I20260709 13:17:47.543569 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.543859 18658 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 0.
I20260709 13:17:47.544232 18584 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 0.
I20260709 13:17:47.545071 18696 leader_election.cc:304] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:47.546026 18813 raft_consensus.cc:2804] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.546471 18813 raft_consensus.cc:493] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.546957 18813 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.553958 18813 raft_consensus.cc:515] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.556890 18797 consensus_queue.cc:1048] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.559651 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:47.560176 18658 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.569733 18813 leader_election.cc:290] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559)
I20260709 13:17:47.571201 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:47.571799 18583 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.575238 18658 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 1.
I20260709 13:17:47.576414 18696 leader_election.cc:304] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:47.576941 18583 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 1.
I20260709 13:17:47.577242 18813 raft_consensus.cc:2804] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.577749 18813 raft_consensus.cc:697] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 LEADER]: Becoming Leader. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:47.578536 18813 consensus_queue.cc:237] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:47.586064 18482 catalog_manager.cc:5697] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5885e806f30545dd870389d2f5029618 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "5885e806f30545dd870389d2f5029618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.633760 18821 consensus_queue.cc:1048] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.642112 18658 raft_consensus.cc:3060] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.649677 18823 consensus_queue.cc:1048] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.689517 18797 raft_consensus.cc:493] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.690097 18797 raft_consensus.cc:515] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.692445 18797 leader_election.cc:290] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.694146 18733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618" is_pre_election: true
I20260709 13:17:47.694962 18733 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 0.
I20260709 13:17:47.735764 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.736526 18583 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 0.
I20260709 13:17:47.784670 18624 leader_election.cc:304] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.786024 18797 raft_consensus.cc:2804] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:47.786516 18797 raft_consensus.cc:493] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.786937 18797 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.790776 18658 raft_consensus.cc:3060] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.791399 18584 raft_consensus.cc:3060] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.794258 18797 raft_consensus.cc:515] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.796689 18797 leader_election.cc:290] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:47.812915 18583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:47.814066 18843 consensus_queue.cc:1048] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.819798 18781 consensus_queue.cc:1048] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.820158 18583 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.834162 18583 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 1.
I20260709 13:17:47.835639 18781 consensus_queue.cc:1048] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.836751 18624 leader_election.cc:304] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:47.834676 18821 consensus_queue.cc:1048] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.839993 18781 raft_consensus.cc:2804] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:47.840468 18781 raft_consensus.cc:697] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:47.841552 18781 consensus_queue.cc:237] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.858012 18730 raft_consensus.cc:3060] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.865190 18807 consensus_queue.cc:1048] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:47.878288 18798 consensus_queue.cc:1048] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.881783 18731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:47.882378 18731 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:47.891522 18798 consensus_queue.cc:1048] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.891866 18807 consensus_queue.cc:1048] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:47.899791 18823 consensus_queue.cc:1048] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:47.917582 18823 consensus_queue.cc:1048] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:47.927896 18810 raft_consensus.cc:493] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.928377 18810 raft_consensus.cc:515] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:47.928869 18843 consensus_queue.cc:1048] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.946884 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd0bb72b17f4c3483242e36ccc46162" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef471ec398df4226b58133e90d9c2a59" is_pre_election: true
I20260709 13:17:47.959774 18731 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 1.
I20260709 13:17:47.960907 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd0bb72b17f4c3483242e36ccc46162" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" is_pre_election: true
I20260709 13:17:47.963030 18696 leader_election.cc:304] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5885e806f30545dd870389d2f5029618; no voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:47.964064 18810 leader_election.cc:290] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:47.973491 18807 consensus_queue.cc:1048] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:47.996592 18851 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:47.996840 18810 raft_consensus.cc:2749] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:48.001765 18480 catalog_manager.cc:5697] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.016711 18851 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.169174 18727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "5885e806f30545dd870389d2f5029618"
mode: GRACEFUL
new_leader_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:42708
I20260709 13:17:48.169685 18727 raft_consensus.cc:606] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 LEADER]: Received request to transfer leadership to TS ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:48.188977 18657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
mode: GRACEFUL
new_leader_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:17:48.189466 18657 raft_consensus.cc:606] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Received request to transfer leadership to TS ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:48.206513 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3879352733954380a925a48634dd5808"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
mode: GRACEFUL
new_leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
 from {username='slave'} at 127.0.0.1:53182
I20260709 13:17:48.207036 18582 raft_consensus.cc:606] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Received request to transfer leadership to TS becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:48.214407 18657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
mode: GRACEFUL
new_leader_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:17:48.214893 18657 raft_consensus.cc:606] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Received request to transfer leadership to TS 5885e806f30545dd870389d2f5029618
I20260709 13:17:48.353643 18797 raft_consensus.cc:993] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5: : Instructing follower ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:48.354094 18781 raft_consensus.cc:1081] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Signalling peer ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:48.355396 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:53162
I20260709 13:17:48.355832 18582 raft_consensus.cc:493] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.356129 18582 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.360671 18582 raft_consensus.cc:515] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.362324 18582 leader_election.cc:290] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:48.362998 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:48.363349 18727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:48.363549 18657 raft_consensus.cc:3055] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.363875 18657 raft_consensus.cc:740] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:48.363904 18727 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.364560 18657 consensus_queue.cc:260] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.365554 18657 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.369550 18727 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:48.370580 18548 leader_election.cc:304] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:48.371213 18657 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:48.371311 18823 raft_consensus.cc:2804] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.372604 18823 raft_consensus.cc:697] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:48.373430 18823 consensus_queue.cc:237] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.377170 18797 raft_consensus.cc:993] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5: : Instructing follower 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:48.377555 18781 raft_consensus.cc:1081] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Signalling peer 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:48.379065 18727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a"
dest_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:42700
I20260709 13:17:48.379534 18727 raft_consensus.cc:493] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.379849 18727 raft_consensus.cc:3060] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.382676 18480 catalog_manager.cc:5697] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 1 to 2, leader changed from becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2) to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.385969 18727 raft_consensus.cc:515] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.387897 18727 leader_election.cc:290] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 2 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:48.388161 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:48.388460 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a743f2612de41589b8386d67b0de55a" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:48.388733 18582 raft_consensus.cc:3060] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.389024 18657 raft_consensus.cc:3055] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.389405 18657 raft_consensus.cc:740] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:48.390290 18657 consensus_queue.cc:260] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.391428 18657 raft_consensus.cc:3060] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.395149 18582 raft_consensus.cc:2468] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 2.
I20260709 13:17:48.396289 18698 leader_election.cc:304] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:48.397111 18851 raft_consensus.cc:2804] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.398870 18657 raft_consensus.cc:2468] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 2.
I20260709 13:17:48.399178 18851 raft_consensus.cc:697] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 2 LEADER]: Becoming Leader. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:48.400127 18851 consensus_queue.cc:237] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.407130 18480 catalog_manager.cc:5697] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 reported cstate change: term changed from 1 to 2, leader changed from becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2) to 5885e806f30545dd870389d2f5029618 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "5885e806f30545dd870389d2f5029618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.410908 18823 raft_consensus.cc:993] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: : Instructing follower becc2c9e2b904d65bbf3a5a0a33d60f5 to start an election
I20260709 13:17:48.411371 18812 raft_consensus.cc:1081] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Signalling peer becc2c9e2b904d65bbf3a5a0a33d60f5 to start an election
I20260709 13:17:48.412925 18657 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3879352733954380a925a48634dd5808"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:17:48.413455 18657 raft_consensus.cc:493] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.413805 18657 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.417271 18781 consensus_queue.cc:1048] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.420176 18657 raft_consensus.cc:515] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.422880 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:48.423455 18582 raft_consensus.cc:3055] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.423550 18657 leader_election.cc:290] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 2 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:48.423805 18582 raft_consensus.cc:740] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:48.423890 18726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:48.424516 18726 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.424695 18582 consensus_queue.cc:260] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.426242 18582 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.429368 18843 consensus_queue.cc:1048] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:48.432451 18726 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 2.
I20260709 13:17:48.434084 18582 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 2.
I20260709 13:17:48.434230 18623 leader_election.cc:304] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:48.435107 18781 raft_consensus.cc:2804] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.435585 18781 raft_consensus.cc:697] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:48.436372 18781 consensus_queue.cc:237] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:48.449760 18482 catalog_manager.cc:5697] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 1 to 2, leader changed from ef471ec398df4226b58133e90d9c2a59 (127.17.139.1) to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.590227 18865 raft_consensus.cc:993] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: : Instructing follower ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:48.590642 18851 raft_consensus.cc:1081] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 LEADER]: Signalling peer ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:48.591997 18584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:53174
I20260709 13:17:48.592428 18584 raft_consensus.cc:493] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.592720 18584 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.598614 18584 raft_consensus.cc:515] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:48.600219 18584 leader_election.cc:290] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Requested vote from peers 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:48.600884 18726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:48.601222 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:48.601459 18726 raft_consensus.cc:3055] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.601734 18657 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.601783 18726 raft_consensus.cc:740] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:48.602569 18726 consensus_queue.cc:260] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:48.603427 18726 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.606304 18657 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:48.607218 18547 leader_election.cc:304] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:48.607957 18812 raft_consensus.cc:2804] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.608104 18726 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:48.608441 18812 raft_consensus.cc:697] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:48.609261 18812 consensus_queue.cc:237] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:48.615068 18482 catalog_manager.cc:5697] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 1 to 2, leader changed from 5885e806f30545dd870389d2f5029618 (127.17.139.3) to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.776907 18657 raft_consensus.cc:1275] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.778445 18812 consensus_queue.cc:1048] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.781193 18658 raft_consensus.cc:1275] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.782445 18851 consensus_queue.cc:1048] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.786355 18726 raft_consensus.cc:1275] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.790304 18812 consensus_queue.cc:1048] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.795825 18584 raft_consensus.cc:1275] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.804304 18866 consensus_queue.cc:1048] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:48.805725 18680 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7100 after lost signal to thread 17967
W20260709 13:17:48.806679 18680 debug-util.cc:398] Leaking SignalData structure 0x7b08000bfb00 after lost signal to thread 18516
I20260709 13:17:49.012849 18582 raft_consensus.cc:1275] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Refusing update from remote peer becc2c9e2b904d65bbf3a5a0a33d60f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.014324 18781 consensus_queue.cc:1048] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.026047 18726 raft_consensus.cc:1275] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Refusing update from remote peer becc2c9e2b904d65bbf3a5a0a33d60f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.027423 18781 consensus_queue.cc:1048] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.105976 18726 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.107203 18869 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.117846 18657 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.119339 18821 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:51.248890 17964 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:17:51.249617 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:51.265758 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
mode: GRACEFUL
new_leader_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:58014
I20260709 13:17:51.266448 18582 raft_consensus.cc:606] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Received request to transfer leadership to TS 5885e806f30545dd870389d2f5029618
I20260709 13:17:51.269131 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
mode: GRACEFUL
new_leader_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:58014
I20260709 13:17:51.269820 18582 raft_consensus.cc:606] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Received request to transfer leadership to TS 5885e806f30545dd870389d2f5029618
I20260709 13:17:51.270916 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:51.271335 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:51.416158 18821 raft_consensus.cc:993] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59: : Instructing follower 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:51.416584 18879 raft_consensus.cc:1081] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Signalling peer 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:51.418015 18726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7"
dest_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:42696
I20260709 13:17:51.418885 18726 raft_consensus.cc:493] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.419401 18726 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.424881 18726 raft_consensus.cc:515] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:51.426643 18726 leader_election.cc:290] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 2 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:51.427505 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:51.427536 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:51.428069 18584 raft_consensus.cc:3055] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.428196 18657 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.428370 18584 raft_consensus.cc:740] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:51.429128 18584 consensus_queue.cc:260] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:51.429986 18584 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.433065 18657 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 2.
I20260709 13:17:51.434069 18696 leader_election.cc:304] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:51.434719 18866 raft_consensus.cc:2804] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:51.434772 18584 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 2.
I20260709 13:17:51.436249 18866 raft_consensus.cc:697] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 LEADER]: Becoming Leader. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:51.437069 18866 consensus_queue.cc:237] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:51.443900 18480 catalog_manager.cc:5697] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 reported cstate change: term changed from 1 to 2, leader changed from ef471ec398df4226b58133e90d9c2a59 (127.17.139.1) to 5885e806f30545dd870389d2f5029618 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "5885e806f30545dd870389d2f5029618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.623392 18821 raft_consensus.cc:993] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: : Instructing follower 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:51.623827 18879 raft_consensus.cc:1081] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Signalling peer 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:51.625361 18726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:42696
I20260709 13:17:51.625837 18726 raft_consensus.cc:493] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.626159 18726 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.630540 18726 raft_consensus.cc:515] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:51.632253 18726 leader_election.cc:290] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 3 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559)
I20260709 13:17:51.632905 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:51.633342 18584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:51.633529 18657 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.633914 18584 raft_consensus.cc:3055] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.634231 18584 raft_consensus.cc:740] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:51.635012 18584 consensus_queue.cc:260] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:51.636186 18584 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.640156 18657 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 3.
I20260709 13:17:51.641330 18696 leader_election.cc:304] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:51.641989 18866 raft_consensus.cc:2804] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:51.642391 18584 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 3.
I20260709 13:17:51.642479 18866 raft_consensus.cc:697] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 LEADER]: Becoming Leader. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:51.643343 18866 consensus_queue.cc:237] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:51.652927 18480 catalog_manager.cc:5697] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 reported cstate change: term changed from 2 to 3, leader changed from ef471ec398df4226b58133e90d9c2a59 (127.17.139.1) to 5885e806f30545dd870389d2f5029618 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "5885e806f30545dd870389d2f5029618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.903906 18584 raft_consensus.cc:1275] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.905148 18866 consensus_queue.cc:1048] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:51.916206 18657 raft_consensus.cc:1275] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.919713 18866 consensus_queue.cc:1048] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:52.104820 18582 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.106060 18880 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.114025 18657 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.116063 18890 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.272079 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.285072 18726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "5885e806f30545dd870389d2f5029618"
mode: GRACEFUL
new_leader_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:42708
I20260709 13:17:52.285523 18726 raft_consensus.cc:606] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 LEADER]: Received request to transfer leadership to TS ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:52.294128 18726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7"
dest_uuid: "5885e806f30545dd870389d2f5029618"
mode: GRACEFUL
new_leader_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:42708
I20260709 13:17:52.294579 18726 raft_consensus.cc:606] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 LEADER]: Received request to transfer leadership to TS ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:52.300828 18657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
mode: GRACEFUL
new_leader_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:17:52.301326 18657 raft_consensus.cc:606] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Received request to transfer leadership to TS ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:52.305522 18657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637793f279834387b5e3483a7da00bd4"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
mode: GRACEFUL
new_leader_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:17:52.305974 18657 raft_consensus.cc:606] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Received request to transfer leadership to TS ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:52.310395 18895 raft_consensus.cc:993] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5: : Instructing follower ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.310560 18657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3879352733954380a925a48634dd5808"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
mode: GRACEFUL
new_leader_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:17:52.310825 18871 raft_consensus.cc:1081] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Signalling peer ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.311112 18657 raft_consensus.cc:606] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 LEADER]: Received request to transfer leadership to TS ef471ec398df4226b58133e90d9c2a59
I20260709 13:17:52.312390 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "637793f279834387b5e3483a7da00bd4"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:53162
I20260709 13:17:52.312945 18582 raft_consensus.cc:493] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.313316 18582 raft_consensus.cc:3060] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.319047 18582 raft_consensus.cc:515] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.320619 18582 leader_election.cc:290] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:52.321267 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:52.321764 18726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637793f279834387b5e3483a7da00bd4" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:52.321938 18657 raft_consensus.cc:3055] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.322325 18726 raft_consensus.cc:3060] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.322360 18657 raft_consensus.cc:740] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:52.323354 18657 consensus_queue.cc:260] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.324136 18657 raft_consensus.cc:3060] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.327132 18726 raft_consensus.cc:2468] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:52.327769 18727 raft_consensus.cc:1240] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Rejecting Update request from peer becc2c9e2b904d65bbf3a5a0a33d60f5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:52.328187 18548 leader_election.cc:304] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:52.328866 18821 raft_consensus.cc:2804] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.329007 18657 raft_consensus.cc:2468] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:52.331085 18821 raft_consensus.cc:697] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:52.331835 18821 consensus_queue.cc:237] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.337905 18482 catalog_manager.cc:5697] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 1 to 2, leader changed from becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2) to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.468678 18895 raft_consensus.cc:993] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5: : Instructing follower ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.469156 18871 raft_consensus.cc:1081] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 LEADER]: Signalling peer ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.470422 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3879352733954380a925a48634dd5808"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:53162
I20260709 13:17:52.470826 18582 raft_consensus.cc:493] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.471086 18582 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.476856 18582 raft_consensus.cc:515] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.478945 18582 leader_election.cc:290] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 3 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:52.479344 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:52.479480 18727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:52.479964 18657 raft_consensus.cc:3055] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.480024 18727 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.480414 18657 raft_consensus.cc:740] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:52.481288 18657 consensus_queue.cc:260] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.482528 18657 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.486828 18727 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 3.
I20260709 13:17:52.487892 18548 leader_election.cc:304] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:52.488585 18821 raft_consensus.cc:2804] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.489029 18657 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 3.
I20260709 13:17:52.489132 18821 raft_consensus.cc:697] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:52.489929 18821 consensus_queue.cc:237] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.496348 18482 catalog_manager.cc:5697] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 2 to 3, leader changed from becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2) to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.522732 18866 raft_consensus.cc:993] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618: : Instructing follower ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.523155 18866 raft_consensus.cc:1081] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 LEADER]: Signalling peer ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.524468 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:53174
I20260709 13:17:52.524998 18582 raft_consensus.cc:493] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.525308 18582 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.529570 18582 raft_consensus.cc:515] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.531164 18582 leader_election.cc:290] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 3 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:52.531934 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:52.532158 18727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727b544e776a48979f8d948b991d1cc7" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:52.532393 18657 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.532737 18727 raft_consensus.cc:3055] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.533090 18727 raft_consensus.cc:740] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:52.533828 18727 consensus_queue.cc:260] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.534703 18727 raft_consensus.cc:3060] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.536648 18657 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 3.
I20260709 13:17:52.537668 18547 leader_election.cc:304] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:52.538496 18821 raft_consensus.cc:2804] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.538904 18821 raft_consensus.cc:697] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 3 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:52.539652 18727 raft_consensus.cc:2468] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 3.
I20260709 13:17:52.539610 18821 consensus_queue.cc:237] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.545392 18482 catalog_manager.cc:5697] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 2 to 3, leader changed from 5885e806f30545dd870389d2f5029618 (127.17.139.3) to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.563441 18890 raft_consensus.cc:993] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: : Instructing follower ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.563861 18866 raft_consensus.cc:1081] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 LEADER]: Signalling peer ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.564951 18895 raft_consensus.cc:993] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5: : Instructing follower ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.565328 18871 raft_consensus.cc:1081] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Signalling peer ef471ec398df4226b58133e90d9c2a59 to start an election
I20260709 13:17:52.565413 18582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:53174
I20260709 13:17:52.565920 18582 raft_consensus.cc:493] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.566234 18582 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.566687 18584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
 from {username='slave'} at 127.0.0.1:53162
I20260709 13:17:52.567122 18584 raft_consensus.cc:493] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.567416 18584 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.571593 18582 raft_consensus.cc:515] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:52.571729 18584 raft_consensus.cc:515] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.573237 18582 leader_election.cc:290] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 4 election: Requested vote from peers 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:52.573544 18584 leader_election.cc:290] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:52.574632 18727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:52.574843 18657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:52.574855 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:52.575032 18726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "ef471ec398df4226b58133e90d9c2a59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:52.575246 18727 raft_consensus.cc:3055] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:52.575569 18657 raft_consensus.cc:3055] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.575634 18658 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.575707 18727 raft_consensus.cc:740] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:52.575698 18726 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.576037 18657 raft_consensus.cc:740] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:52.576920 18657 consensus_queue.cc:260] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.576987 18727 consensus_queue.cc:260] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:52.578016 18657 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.578212 18727 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.582192 18726 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:52.582348 18658 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 4.
I20260709 13:17:52.583257 18548 leader_election.cc:304] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:52.583498 18547 leader_election.cc:304] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: becc2c9e2b904d65bbf3a5a0a33d60f5, ef471ec398df4226b58133e90d9c2a59; no voters: 
I20260709 13:17:52.584154 18821 raft_consensus.cc:2804] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.584260 18896 raft_consensus.cc:2804] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:52.584635 18727 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 4.
I20260709 13:17:52.584681 18821 raft_consensus.cc:697] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:52.586036 18821 consensus_queue.cc:237] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:52.589826 18657 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef471ec398df4226b58133e90d9c2a59 in term 2.
I20260709 13:17:52.590720 18896 raft_consensus.cc:697] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 LEADER]: Becoming Leader. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:52.591423 18896 consensus_queue.cc:237] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:52.597155 18482 catalog_manager.cc:5697] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 1 to 2, leader changed from becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2) to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.598176 18482 catalog_manager.cc:5697] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 reported cstate change: term changed from 3 to 4, leader changed from 5885e806f30545dd870389d2f5029618 (127.17.139.3) to ef471ec398df4226b58133e90d9c2a59 (127.17.139.1). New cstate: current_term: 4 leader_uuid: "ef471ec398df4226b58133e90d9c2a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.878134 18657 raft_consensus.cc:1275] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.879040 18727 raft_consensus.cc:1275] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.879299 18896 consensus_queue.cc:1048] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.880337 18902 consensus_queue.cc:1048] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.902379 18657 raft_consensus.cc:1275] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.903491 18902 consensus_queue.cc:1048] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.906729 18727 raft_consensus.cc:1275] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.908078 18902 consensus_queue.cc:1048] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.926657 18727 raft_consensus.cc:1275] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.928803 18896 consensus_queue.cc:1048] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:52.937577 18657 raft_consensus.cc:1275] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:52.939733 18879 consensus_queue.cc:1048] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:52.981346 18727 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:52.982897 18879 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:52.991904 18657 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:52.994505 18879 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:53.145763 18657 raft_consensus.cc:1275] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.147006 18879 consensus_queue.cc:1048] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.155418 18727 raft_consensus.cc:1275] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Refusing update from remote peer ef471ec398df4226b58133e90d9c2a59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.156736 18821 consensus_queue.cc:1048] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:55.320158 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:55.328548 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
mode: GRACEFUL
new_leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
 from {username='slave'} at 127.0.0.1:58014
I20260709 13:17:55.329275 18582 raft_consensus.cc:606] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Received request to transfer leadership to TS becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:55.331723 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3879352733954380a925a48634dd5808"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
mode: GRACEFUL
new_leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
 from {username='slave'} at 127.0.0.1:58014
I20260709 13:17:55.332130 18582 raft_consensus.cc:606] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 LEADER]: Received request to transfer leadership to TS becc2c9e2b904d65bbf3a5a0a33d60f5
I20260709 13:17:55.334372 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
mode: GRACEFUL
new_leader_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:58014
I20260709 13:17:55.334774 18582 raft_consensus.cc:606] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Received request to transfer leadership to TS 5885e806f30545dd870389d2f5029618
I20260709 13:17:55.336769 18582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
mode: GRACEFUL
new_leader_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:58014
I20260709 13:17:55.337195 18582 raft_consensus.cc:606] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 LEADER]: Received request to transfer leadership to TS 5885e806f30545dd870389d2f5029618
I20260709 13:17:55.337989 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:55.338433 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:55.447582 18918 raft_consensus.cc:993] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: : Instructing follower 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:55.448128 18902 raft_consensus.cc:1081] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 LEADER]: Signalling peer 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:55.449512 18726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb"
dest_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:42696
I20260709 13:17:55.449975 18726 raft_consensus.cc:493] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.450343 18726 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.456151 18726 raft_consensus.cc:515] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:55.457609 18726 leader_election.cc:290] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 5 election: Requested vote from peers becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365), ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559)
I20260709 13:17:55.458689 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:55.458599 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c381efa54e4946f082f5902a07b7aedb" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:55.459331 18582 raft_consensus.cc:3055] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:55.459412 18658 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.459609 18582 raft_consensus.cc:740] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:55.460434 18582 consensus_queue.cc:260] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:55.461369 18582 raft_consensus.cc:3060] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.464541 18658 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 5.
I20260709 13:17:55.465708 18696 leader_election.cc:304] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:55.465956 18582 raft_consensus.cc:2468] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 5.
I20260709 13:17:55.466503 18916 raft_consensus.cc:2804] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:55.467636 18916 raft_consensus.cc:697] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 5 LEADER]: Becoming Leader. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:55.468493 18916 consensus_queue.cc:237] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } }
I20260709 13:17:55.474546 18482 catalog_manager.cc:5697] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 reported cstate change: term changed from 4 to 5, leader changed from ef471ec398df4226b58133e90d9c2a59 (127.17.139.1) to 5885e806f30545dd870389d2f5029618 (127.17.139.3). New cstate: current_term: 5 leader_uuid: "5885e806f30545dd870389d2f5029618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.505630 18918 raft_consensus.cc:993] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59: : Instructing follower 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:55.506053 18902 raft_consensus.cc:1081] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Signalling peer 5885e806f30545dd870389d2f5029618 to start an election
I20260709 13:17:55.507387 18726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26"
dest_uuid: "5885e806f30545dd870389d2f5029618"
 from {username='slave'} at 127.0.0.1:42696
I20260709 13:17:55.507759 18726 raft_consensus.cc:493] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.507970 18726 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.511787 18726 raft_consensus.cc:515] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.513170 18726 leader_election.cc:290] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 3 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365)
I20260709 13:17:55.513906 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:55.514220 18658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9832810216c4c83a5ab7e91f50e7c26" candidate_uuid: "5885e806f30545dd870389d2f5029618" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
I20260709 13:17:55.514453 18582 raft_consensus.cc:3055] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:55.514755 18582 raft_consensus.cc:740] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:55.514773 18658 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.515585 18582 consensus_queue.cc:260] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.516710 18582 raft_consensus.cc:3060] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.521152 18658 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 3.
I20260709 13:17:55.522181 18696 leader_election.cc:304] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:55.522866 18582 raft_consensus.cc:2468] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5885e806f30545dd870389d2f5029618 in term 3.
I20260709 13:17:55.522925 18916 raft_consensus.cc:2804] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:55.523439 18916 raft_consensus.cc:697] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 3 LEADER]: Becoming Leader. State: Replica: 5885e806f30545dd870389d2f5029618, State: Running, Role: LEADER
I20260709 13:17:55.524322 18916 consensus_queue.cc:237] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.530597 18482 catalog_manager.cc:5697] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 reported cstate change: term changed from 2 to 3, leader changed from ef471ec398df4226b58133e90d9c2a59 (127.17.139.1) to 5885e806f30545dd870389d2f5029618 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "5885e806f30545dd870389d2f5029618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.584790 18918 raft_consensus.cc:993] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59: : Instructing follower becc2c9e2b904d65bbf3a5a0a33d60f5 to start an election
I20260709 13:17:55.585245 18902 raft_consensus.cc:1081] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Signalling peer becc2c9e2b904d65bbf3a5a0a33d60f5 to start an election
I20260709 13:17:55.586768 18658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:17:55.587378 18658 raft_consensus.cc:493] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.587692 18658 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.592180 18658 raft_consensus.cc:515] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.593945 18658 leader_election.cc:290] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 3 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:55.594497 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:55.595022 18582 raft_consensus.cc:3055] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:55.594973 18726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1da13ccdb09c42a88b73b8b311e3e42d" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:55.595323 18582 raft_consensus.cc:740] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:55.595469 18726 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.596122 18582 consensus_queue.cc:260] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.597054 18582 raft_consensus.cc:3060] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.600320 18726 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 3.
I20260709 13:17:55.601328 18582 raft_consensus.cc:2468] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 3.
I20260709 13:17:55.601764 18623 leader_election.cc:304] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:55.602705 18917 raft_consensus.cc:2804] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:55.603945 18917 raft_consensus.cc:697] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:55.604655 18917 consensus_queue.cc:237] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.611838 18482 catalog_manager.cc:5697] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 2 to 3, leader changed from ef471ec398df4226b58133e90d9c2a59 (127.17.139.1) to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 3 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.771880 18918 raft_consensus.cc:993] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: : Instructing follower becc2c9e2b904d65bbf3a5a0a33d60f5 to start an election
I20260709 13:17:55.772339 18902 raft_consensus.cc:1081] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 LEADER]: Signalling peer becc2c9e2b904d65bbf3a5a0a33d60f5 to start an election
I20260709 13:17:55.773658 18658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3879352733954380a925a48634dd5808"
dest_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5"
 from {username='slave'} at 127.0.0.1:60934
I20260709 13:17:55.774087 18658 raft_consensus.cc:493] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.774336 18658 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.778751 18658 raft_consensus.cc:515] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.780272 18658 leader_election.cc:290] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 4 election: Requested vote from peers ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559), 5885e806f30545dd870389d2f5029618 (127.17.139.3:36815)
I20260709 13:17:55.780989 18582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef471ec398df4226b58133e90d9c2a59"
I20260709 13:17:55.781236 18726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3879352733954380a925a48634dd5808" candidate_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5885e806f30545dd870389d2f5029618"
I20260709 13:17:55.781508 18582 raft_consensus.cc:3055] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:55.781726 18726 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.781818 18582 raft_consensus.cc:740] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef471ec398df4226b58133e90d9c2a59, State: Running, Role: LEADER
I20260709 13:17:55.782614 18582 consensus_queue.cc:260] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.783686 18582 raft_consensus.cc:3060] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.787676 18726 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 4.
I20260709 13:17:55.788657 18623 leader_election.cc:304] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5885e806f30545dd870389d2f5029618, becc2c9e2b904d65bbf3a5a0a33d60f5; no voters: 
I20260709 13:17:55.789240 18582 raft_consensus.cc:2468] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate becc2c9e2b904d65bbf3a5a0a33d60f5 in term 4.
I20260709 13:17:55.789378 18917 raft_consensus.cc:2804] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:55.789806 18917 raft_consensus.cc:697] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 LEADER]: Becoming Leader. State: Replica: becc2c9e2b904d65bbf3a5a0a33d60f5, State: Running, Role: LEADER
I20260709 13:17:55.790720 18917 consensus_queue.cc:237] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } }
I20260709 13:17:55.797487 18482 catalog_manager.cc:5697] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 reported cstate change: term changed from 3 to 4, leader changed from ef471ec398df4226b58133e90d9c2a59 (127.17.139.1) to becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2). New cstate: current_term: 4 leader_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.864055 18582 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 5 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:55.865249 18916 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:55.874727 18658 raft_consensus.cc:1275] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 5 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:55.876437 18916 consensus_queue.cc:1048] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:56.053153 18582 raft_consensus.cc:1275] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Refusing update from remote peer becc2c9e2b904d65bbf3a5a0a33d60f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.054265 18917 consensus_queue.cc:1048] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:56.063622 18726 raft_consensus.cc:1275] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Refusing update from remote peer becc2c9e2b904d65bbf3a5a0a33d60f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.065064 18936 consensus_queue.cc:1048] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:56.104310 18584 raft_consensus.cc:1275] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.105624 18916 consensus_queue.cc:1048] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef471ec398df4226b58133e90d9c2a59" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:56.114006 18658 raft_consensus.cc:1275] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Refusing update from remote peer 5885e806f30545dd870389d2f5029618: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.115926 18939 consensus_queue.cc:1048] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "becc2c9e2b904d65bbf3a5a0a33d60f5" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 46365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:56.339313 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:56.346172 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
I20260709 13:17:56.372741 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:56.373587 17964 tablet_replica.cc:333] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.374257 17964 raft_consensus.cc:2243] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.374797 17964 raft_consensus.cc:2272] T 5a743f2612de41589b8386d67b0de55a P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.376773 17964 tablet_replica.cc:333] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.377322 17964 raft_consensus.cc:2243] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.377727 17964 raft_consensus.cc:2272] T 1da13ccdb09c42a88b73b8b311e3e42d P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.379598 17964 tablet_replica.cc:333] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.380066 17964 raft_consensus.cc:2243] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.380823 17964 raft_consensus.cc:2272] T 34876c3dddbe455db3c699b7635e2a64 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.382496 17964 tablet_replica.cc:333] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.383008 17964 raft_consensus.cc:2243] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.383389 17964 raft_consensus.cc:2272] T c381efa54e4946f082f5902a07b7aedb P ef471ec398df4226b58133e90d9c2a59 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.385743 17964 tablet_replica.cc:333] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.386267 17964 raft_consensus.cc:2243] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.386981 17964 raft_consensus.cc:2272] T 637793f279834387b5e3483a7da00bd4 P ef471ec398df4226b58133e90d9c2a59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.388608 17964 tablet_replica.cc:333] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.389154 17964 raft_consensus.cc:2243] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.389537 17964 raft_consensus.cc:2272] T cfd0bb72b17f4c3483242e36ccc46162 P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.391076 17964 tablet_replica.cc:333] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.391611 17964 raft_consensus.cc:2243] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.392413 17964 raft_consensus.cc:2272] T 727b544e776a48979f8d948b991d1cc7 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:56.392760 18624 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:17:56.394222 17964 tablet_replica.cc:333] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.394723 17964 raft_consensus.cc:2243] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.395699 17964 raft_consensus.cc:2272] T d8564fa436704b018e1fc017bbec738e P ef471ec398df4226b58133e90d9c2a59 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:56.395829 18624 consensus_peers.cc:597] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 -> Peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Couldn't send request to peer ef471ec398df4226b58133e90d9c2a59. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.397229 18726 raft_consensus.cc:1275] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Refusing update from remote peer becc2c9e2b904d65bbf3a5a0a33d60f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:56.398051 17964 tablet_replica.cc:333] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.398522 17964 raft_consensus.cc:2243] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.398479 18936 consensus_queue.cc:1048] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5885e806f30545dd870389d2f5029618" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 36815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:56.399019 17964 raft_consensus.cc:2272] T 3879352733954380a925a48634dd5808 P ef471ec398df4226b58133e90d9c2a59 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.401059 17964 tablet_replica.cc:333] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59: stopping tablet replica
I20260709 13:17:56.401818 17964 raft_consensus.cc:2243] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.402364 17964 raft_consensus.cc:2272] T a9832810216c4c83a5ab7e91f50e7c26 P ef471ec398df4226b58133e90d9c2a59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.438230 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
I20260709 13:17:56.457839 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
W20260709 13:17:56.471490 18698 consensus_peers.cc:597] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 -> Peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Couldn't send request to peer ef471ec398df4226b58133e90d9c2a59. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:41559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.485517 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:56.486323 17964 tablet_replica.cc:333] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.487347 17964 raft_consensus.cc:2243] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.488052 17964 raft_consensus.cc:2272] T 34876c3dddbe455db3c699b7635e2a64 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:56.490967 18696 consensus_peers.cc:597] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 -> Peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Couldn't send request to peer becc2c9e2b904d65bbf3a5a0a33d60f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.491003 17964 tablet_replica.cc:333] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.491889 17964 raft_consensus.cc:2243] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.492451 17964 raft_consensus.cc:2272] T a9832810216c4c83a5ab7e91f50e7c26 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.495265 17964 tablet_replica.cc:333] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.496008 17964 raft_consensus.cc:2243] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.496758 17964 raft_consensus.cc:2272] T 1da13ccdb09c42a88b73b8b311e3e42d P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.498739 17964 tablet_replica.cc:333] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.499269 17964 raft_consensus.cc:2243] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.499682 17964 raft_consensus.cc:2272] T 5a743f2612de41589b8386d67b0de55a P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.501441 17964 tablet_replica.cc:333] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.501940 17964 raft_consensus.cc:2243] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.502341 17964 raft_consensus.cc:2272] T d8564fa436704b018e1fc017bbec738e P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.503973 17964 tablet_replica.cc:333] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.504525 17964 raft_consensus.cc:2243] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.505497 17964 raft_consensus.cc:2272] T 3879352733954380a925a48634dd5808 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.508347 17964 tablet_replica.cc:333] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
W20260709 13:17:56.508581 18696 consensus_peers.cc:597] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 -> Peer becc2c9e2b904d65bbf3a5a0a33d60f5 (127.17.139.2:46365): Couldn't send request to peer becc2c9e2b904d65bbf3a5a0a33d60f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.508992 17964 raft_consensus.cc:2243] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.509457 17964 raft_consensus.cc:2272] T 727b544e776a48979f8d948b991d1cc7 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.511480 17964 tablet_replica.cc:333] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.512005 17964 raft_consensus.cc:2243] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.512782 17964 raft_consensus.cc:2272] T cfd0bb72b17f4c3483242e36ccc46162 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.514530 17964 tablet_replica.cc:333] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.515020 17964 raft_consensus.cc:2243] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.515424 17964 raft_consensus.cc:2272] T 637793f279834387b5e3483a7da00bd4 P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.517131 17964 tablet_replica.cc:333] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5: stopping tablet replica
I20260709 13:17:56.517599 17964 raft_consensus.cc:2243] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.517987 17964 raft_consensus.cc:2272] T c381efa54e4946f082f5902a07b7aedb P becc2c9e2b904d65bbf3a5a0a33d60f5 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:56.555749 18698 consensus_peers.cc:597] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 -> Peer ef471ec398df4226b58133e90d9c2a59 (127.17.139.1:41559): Couldn't send request to peer ef471ec398df4226b58133e90d9c2a59. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:41559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.566824 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
I20260709 13:17:56.584149 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
I20260709 13:17:56.607656 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:56.608338 17964 tablet_replica.cc:333] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.609025 17964 raft_consensus.cc:2243] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.609827 17964 raft_consensus.cc:2272] T a9832810216c4c83a5ab7e91f50e7c26 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.612139 17964 tablet_replica.cc:333] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.612676 17964 raft_consensus.cc:2243] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.613502 17964 raft_consensus.cc:2272] T c381efa54e4946f082f5902a07b7aedb P 5885e806f30545dd870389d2f5029618 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.615593 17964 tablet_replica.cc:333] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.616129 17964 raft_consensus.cc:2243] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.616577 17964 raft_consensus.cc:2272] T cfd0bb72b17f4c3483242e36ccc46162 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.618381 17964 tablet_replica.cc:333] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.618886 17964 raft_consensus.cc:2243] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.619295 17964 raft_consensus.cc:2272] T 637793f279834387b5e3483a7da00bd4 P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.620966 17964 tablet_replica.cc:333] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.621567 17964 raft_consensus.cc:2243] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.622398 17964 raft_consensus.cc:2272] T 5a743f2612de41589b8386d67b0de55a P 5885e806f30545dd870389d2f5029618 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.624169 17964 tablet_replica.cc:333] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.624727 17964 raft_consensus.cc:2243] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.625208 17964 raft_consensus.cc:2272] T 34876c3dddbe455db3c699b7635e2a64 P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.626863 17964 tablet_replica.cc:333] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.627368 17964 raft_consensus.cc:2243] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.627772 17964 raft_consensus.cc:2272] T 1da13ccdb09c42a88b73b8b311e3e42d P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.629911 17964 tablet_replica.cc:333] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.630399 17964 raft_consensus.cc:2243] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.630841 17964 raft_consensus.cc:2272] T 3879352733954380a925a48634dd5808 P 5885e806f30545dd870389d2f5029618 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.633028 17964 tablet_replica.cc:333] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.633509 17964 raft_consensus.cc:2243] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.633946 17964 raft_consensus.cc:2272] T 727b544e776a48979f8d948b991d1cc7 P 5885e806f30545dd870389d2f5029618 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.635607 17964 tablet_replica.cc:333] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618: stopping tablet replica
I20260709 13:17:56.636224 17964 raft_consensus.cc:2243] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.636708 17964 raft_consensus.cc:2272] T d8564fa436704b018e1fc017bbec738e P 5885e806f30545dd870389d2f5029618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.665256 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
I20260709 13:17:56.684577 17964 master.cc:562] Master@127.17.139.62:32819 shutting down...
I20260709 13:17:56.703318 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.703850 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.704185 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1054e390f9fe4841824ace4df83c23fe: stopping tablet replica
I20260709 13:17:56.724004 17964 master.cc:584] Master@127.17.139.62:32819 shutdown complete.
5885e806f30545dd870389d2f5029618  1
becc2c9e2b904d65bbf3a5a0a33d60f5  4
ef471ec398df4226b58133e90d9c2a59  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10737 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:17:56.763558 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:35345
I20260709 13:17:56.764755 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:56.770468 18945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:56.770583 18946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:56.772042 18948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:56.775164 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:56.778753 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:56.778975 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:56.779145 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603076779126 us; error 0 us; skew 500 ppm
I20260709 13:17:56.779672 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:56.782120 17964 webserver.cc:533] Webserver started at http://127.17.139.62:40843/ using document root <none> and password file <none>
I20260709 13:17:56.782600 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:56.782805 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:56.783082 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:56.784186 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "1b2c4f6d390c49c387cc446ceb8d00e4"
format_stamp: "Formatted at 2026-07-09 13:17:56 on dist-test-slave-z675"
I20260709 13:17:56.788496 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:56.791781 18953 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:56.792572 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:56.792917 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "1b2c4f6d390c49c387cc446ceb8d00e4"
format_stamp: "Formatted at 2026-07-09 13:17:56 on dist-test-slave-z675"
I20260709 13:17:56.793279 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:56.811575 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:56.812841 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:56.851487 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:35345
I20260709 13:17:56.851608 19004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:35345 every 8 connection(s)
I20260709 13:17:56.855401 19005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:56.865033 19005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Bootstrap starting.
I20260709 13:17:56.869771 19005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.874066 19005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: No bootstrap required, opened a new log
I20260709 13:17:56.876067 19005 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" member_type: VOTER }
I20260709 13:17:56.876488 19005 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.876700 19005 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b2c4f6d390c49c387cc446ceb8d00e4, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.877723 19005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" member_type: VOTER }
I20260709 13:17:56.878237 19005 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:56.878479 19005 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:56.878746 19005 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.882992 19005 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" member_type: VOTER }
I20260709 13:17:56.883580 19005 leader_election.cc:304] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b2c4f6d390c49c387cc446ceb8d00e4; no voters: 
I20260709 13:17:56.884758 19005 leader_election.cc:290] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:56.885161 19008 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.886528 19008 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 1 LEADER]: Becoming Leader. State: Replica: 1b2c4f6d390c49c387cc446ceb8d00e4, State: Running, Role: LEADER
I20260709 13:17:56.887208 19008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" member_type: VOTER }
I20260709 13:17:56.888005 19005 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:56.892443 19010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b2c4f6d390c49c387cc446ceb8d00e4. Latest consensus state: current_term: 1 leader_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" member_type: VOTER } }
I20260709 13:17:56.893250 19010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:56.894232 19009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b2c4f6d390c49c387cc446ceb8d00e4" member_type: VOTER } }
I20260709 13:17:56.894809 19009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:56.896082 19016 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:56.901082 19016 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:56.904099 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:56.909610 19016 catalog_manager.cc:1383] Generated new cluster ID: b7fdfccffb484d77ba0f48dcb1d229cb
I20260709 13:17:56.909886 19016 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:56.929215 19016 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:56.930454 19016 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:56.941452 19016 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Generated new TSK 0
I20260709 13:17:56.942045 19016 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:56.970934 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:56.976923 19026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:56.977814 19027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:56.978981 19029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:56.980770 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:56.981618 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:56.981838 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:56.982012 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603076981989 us; error 0 us; skew 500 ppm
I20260709 13:17:56.982563 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:56.984702 17964 webserver.cc:533] Webserver started at http://127.17.139.1:43141/ using document root <none> and password file <none>
I20260709 13:17:56.985186 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:56.985394 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:56.985668 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:56.986689 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
format_stamp: "Formatted at 2026-07-09 13:17:56 on dist-test-slave-z675"
I20260709 13:17:56.991397 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:56.994656 19034 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:56.995414 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:17:56.995720 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
format_stamp: "Formatted at 2026-07-09 13:17:56 on dist-test-slave-z675"
I20260709 13:17:56.995970 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:57.014798 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:57.016023 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:57.017511 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:57.019706 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:57.019919 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.020161 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:57.020347 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.059512 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:33919
I20260709 13:17:57.059626 19096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:33919 every 8 connection(s)
I20260709 13:17:57.064340 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:57.071452 19101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:57.071859 19102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:57.074584 19104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:57.074644 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:57.075897 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:57.076159 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:57.076352 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603077076335 us; error 0 us; skew 500 ppm
I20260709 13:17:57.077073 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:57.077769 19097 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35345
I20260709 13:17:57.078172 19097 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:57.078884 19097 heartbeater.cc:507] Master 127.17.139.62:35345 requested a full tablet report, sending...
I20260709 13:17:57.079411 17964 webserver.cc:533] Webserver started at http://127.17.139.2:40127/ using document root <none> and password file <none>
I20260709 13:17:57.079896 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:57.080106 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:57.080365 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:57.081101 18970 ts_manager.cc:194] Registered new tserver with Master: 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:17:57.081590 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "0f833abfb3544031bee566e655b7fedc"
format_stamp: "Formatted at 2026-07-09 13:17:57 on dist-test-slave-z675"
I20260709 13:17:57.082859 18970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60506
I20260709 13:17:57.086061 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:57.089691 19109 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.090487 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:17:57.090780 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "0f833abfb3544031bee566e655b7fedc"
format_stamp: "Formatted at 2026-07-09 13:17:57 on dist-test-slave-z675"
I20260709 13:17:57.091061 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:57.112095 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:57.113411 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:57.114845 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:57.117136 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:57.117359 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.117592 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:57.117767 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.156101 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:40307
I20260709 13:17:57.156226 19171 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:40307 every 8 connection(s)
I20260709 13:17:57.160768 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:57.167171 19175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:57.168689 19176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:57.169996 19178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:57.172282 17964 server_base.cc:1061] running on GCE node
I20260709 13:17:57.172825 19172 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35345
I20260709 13:17:57.173247 19172 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:57.173349 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:57.173614 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:57.173826 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603077173807 us; error 0 us; skew 500 ppm
I20260709 13:17:57.174113 19172 heartbeater.cc:507] Master 127.17.139.62:35345 requested a full tablet report, sending...
I20260709 13:17:57.174571 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:57.176424 18970 ts_manager.cc:194] Registered new tserver with Master: 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:57.177462 17964 webserver.cc:533] Webserver started at http://127.17.139.3:44793/ using document root <none> and password file <none>
I20260709 13:17:57.177965 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:57.177953 18970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60510
I20260709 13:17:57.178313 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:57.178617 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:57.180040 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "55991c1f7f474a9888725d00438d8a83"
format_stamp: "Formatted at 2026-07-09 13:17:57 on dist-test-slave-z675"
I20260709 13:17:57.184386 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:57.187614 19183 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.188342 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:57.188638 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "55991c1f7f474a9888725d00438d8a83"
format_stamp: "Formatted at 2026-07-09 13:17:57 on dist-test-slave-z675"
I20260709 13:17:57.188939 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:57.204107 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:57.205340 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:57.206740 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:57.208829 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:57.209096 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.209339 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:57.209507 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:57.247903 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:39345
I20260709 13:17:57.248020 19245 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:39345 every 8 connection(s)
I20260709 13:17:57.261346 19246 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35345
I20260709 13:17:57.261703 19246 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:57.262391 19246 heartbeater.cc:507] Master 127.17.139.62:35345 requested a full tablet report, sending...
I20260709 13:17:57.264271 18970 ts_manager.cc:194] Registered new tserver with Master: 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:57.265093 17964 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014185192s
I20260709 13:17:57.265677 18970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60514
I20260709 13:17:57.289970 18970 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60522:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:57.298393 18970 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:57.510097 19061 tablet_service.cc:1511] Processing CreateTablet for tablet 66ce6ec243d4436da3c96c55bba7244a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:57.511610 19061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ce6ec243d4436da3c96c55bba7244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.511399 19060 tablet_service.cc:1511] Processing CreateTablet for tablet adf40f6b88894de8b62437b0a878c787 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:57.512259 19062 tablet_service.cc:1511] Processing CreateTablet for tablet 716382b8056843a8ac2701a2242b5834 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:57.512724 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf40f6b88894de8b62437b0a878c787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.513548 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716382b8056843a8ac2701a2242b5834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.518049 19059 tablet_service.cc:1511] Processing CreateTablet for tablet d57ee419ffa74c87b2c5eb26b930d9ef (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:57.519326 19059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57ee419ffa74c87b2c5eb26b930d9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.521934 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 228b0a2048a3451cbfd947fa97eb2d8e (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:57.523200 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228b0a2048a3451cbfd947fa97eb2d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.526007 19057 tablet_service.cc:1511] Processing CreateTablet for tablet d7347527d150466586ce647078eff8bb (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:57.527292 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7347527d150466586ce647078eff8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.530408 19056 tablet_service.cc:1511] Processing CreateTablet for tablet d52b625596354c7f9589dc83d8b49ce5 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:57.531283 19206 tablet_service.cc:1511] Processing CreateTablet for tablet d7347527d150466586ce647078eff8bb (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:57.532080 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52b625596354c7f9589dc83d8b49ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.532601 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7347527d150466586ce647078eff8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.534056 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 66ce6ec243d4436da3c96c55bba7244a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:57.534397 19055 tablet_service.cc:1511] Processing CreateTablet for tablet c1b4ebbb026847c7a47a03402902ca2a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:57.535365 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ce6ec243d4436da3c96c55bba7244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.535697 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b4ebbb026847c7a47a03402902ca2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.536065 19261 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:57.538055 19205 tablet_service.cc:1511] Processing CreateTablet for tablet d52b625596354c7f9589dc83d8b49ce5 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:57.538476 19061 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5c24584b054af68fe8fe327bad2e5b (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:57.539389 19205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52b625596354c7f9589dc83d8b49ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.539197 19208 tablet_service.cc:1511] Processing CreateTablet for tablet d57ee419ffa74c87b2c5eb26b930d9ef (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:57.539916 19061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5c24584b054af68fe8fe327bad2e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.540449 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57ee419ffa74c87b2c5eb26b930d9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.541383 19204 tablet_service.cc:1511] Processing CreateTablet for tablet c1b4ebbb026847c7a47a03402902ca2a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:57.542662 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b4ebbb026847c7a47a03402902ca2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.546049 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 228b0a2048a3451cbfd947fa97eb2d8e (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:57.547437 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228b0a2048a3451cbfd947fa97eb2d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.547113 19202 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6b40b78ed348b0ad0b2c0f3d648061 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:57.548414 19202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6b40b78ed348b0ad0b2c0f3d648061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.548802 19211 tablet_service.cc:1511] Processing CreateTablet for tablet 716382b8056843a8ac2701a2242b5834 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:57.550148 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716382b8056843a8ac2701a2242b5834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.549911 19054 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6b40b78ed348b0ad0b2c0f3d648061 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:57.551177 19054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6b40b78ed348b0ad0b2c0f3d648061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.553949 19053 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1b18b0ec57435da3325e677d1b8741 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:57.554945 19261 tablet_bootstrap.cc:654] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.555240 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1b18b0ec57435da3325e677d1b8741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.546049 19203 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5c24584b054af68fe8fe327bad2e5b (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:57.558224 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5c24584b054af68fe8fe327bad2e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.538057 19209 tablet_service.cc:1511] Processing CreateTablet for tablet adf40f6b88894de8b62437b0a878c787 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:57.562230 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf40f6b88894de8b62437b0a878c787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.566092 19061 tablet_service.cc:1511] Processing CreateTablet for tablet c405ec9a50f54a4fa80ed27adf421c09 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:57.569588 19061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c405ec9a50f54a4fa80ed27adf421c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.583184 19136 tablet_service.cc:1511] Processing CreateTablet for tablet 66ce6ec243d4436da3c96c55bba7244a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:57.584503 19136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ce6ec243d4436da3c96c55bba7244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.585522 19132 tablet_service.cc:1511] Processing CreateTablet for tablet d7347527d150466586ce647078eff8bb (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:57.585934 19135 tablet_service.cc:1511] Processing CreateTablet for tablet adf40f6b88894de8b62437b0a878c787 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:57.586838 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7347527d150466586ce647078eff8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.588104 19134 tablet_service.cc:1511] Processing CreateTablet for tablet d57ee419ffa74c87b2c5eb26b930d9ef (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:57.589501 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57ee419ffa74c87b2c5eb26b930d9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.590027 19131 tablet_service.cc:1511] Processing CreateTablet for tablet d52b625596354c7f9589dc83d8b49ce5 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:57.591262 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52b625596354c7f9589dc83d8b49ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.593942 19130 tablet_service.cc:1511] Processing CreateTablet for tablet c1b4ebbb026847c7a47a03402902ca2a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:57.594842 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf40f6b88894de8b62437b0a878c787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.596195 19137 tablet_service.cc:1511] Processing CreateTablet for tablet 716382b8056843a8ac2701a2242b5834 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:57.597440 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716382b8056843a8ac2701a2242b5834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.599467 19129 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5c24584b054af68fe8fe327bad2e5b (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:57.600981 19261 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:57.602466 19128 tablet_service.cc:1511] Processing CreateTablet for tablet 0d6b40b78ed348b0ad0b2c0f3d648061 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:57.607250 19261 ts_tablet_manager.cc:1403] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.000s
I20260709 13:17:57.593945 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 228b0a2048a3451cbfd947fa97eb2d8e (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:57.600729 19129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5c24584b054af68fe8fe327bad2e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.613207 19130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b4ebbb026847c7a47a03402902ca2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.617188 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228b0a2048a3451cbfd947fa97eb2d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.618266 19060 tablet_service.cc:1511] Processing CreateTablet for tablet 8433d8c678614c00ad69faf57a9363de (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:57.619457 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8433d8c678614c00ad69faf57a9363de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.621191 19128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6b40b78ed348b0ad0b2c0f3d648061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.624663 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1b18b0ec57435da3325e677d1b8741 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:57.626132 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1b18b0ec57435da3325e677d1b8741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.625980 19261 raft_consensus.cc:359] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:57.627708 19261 raft_consensus.cc:385] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.628141 19261 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.629005 19208 tablet_service.cc:1511] Processing CreateTablet for tablet c405ec9a50f54a4fa80ed27adf421c09 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:57.630563 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c405ec9a50f54a4fa80ed27adf421c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.630162 19261 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:57.633414 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 8433d8c678614c00ad69faf57a9363de (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:57.634783 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8433d8c678614c00ad69faf57a9363de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.656419 19263 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:57.667521 19053 tablet_service.cc:1511] Processing CreateTablet for tablet 3627cae163084c338404a5153ef0efb9 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:57.669325 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3627cae163084c338404a5153ef0efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.684756 19266 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:57.686299 19135 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1b18b0ec57435da3325e677d1b8741 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:57.687635 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1b18b0ec57435da3325e677d1b8741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.690567 19134 tablet_service.cc:1511] Processing CreateTablet for tablet c405ec9a50f54a4fa80ed27adf421c09 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:57.691957 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c405ec9a50f54a4fa80ed27adf421c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.694609 19211 tablet_service.cc:1511] Processing CreateTablet for tablet 3627cae163084c338404a5153ef0efb9 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:57.696266 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3627cae163084c338404a5153ef0efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.746645 19135 tablet_service.cc:1511] Processing CreateTablet for tablet 8433d8c678614c00ad69faf57a9363de (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:57.749708 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8433d8c678614c00ad69faf57a9363de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.749969 19263 tablet_bootstrap.cc:654] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.748420 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 3627cae163084c338404a5153ef0efb9 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:57.750883 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3627cae163084c338404a5153ef0efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.782450 19056 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4e5f111c104ea4adb5e45cd00f1db6 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:57.784138 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4e5f111c104ea4adb5e45cd00f1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.792344 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4e5f111c104ea4adb5e45cd00f1db6 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:57.794813 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4e5f111c104ea4adb5e45cd00f1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.804687 19097 heartbeater.cc:499] Master 127.17.139.62:35345 was elected leader, sending a full tablet report...
I20260709 13:17:57.811884 19204 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4e5f111c104ea4adb5e45cd00f1db6 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:57.813172 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4e5f111c104ea4adb5e45cd00f1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.818591 19203 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9eca38a1164c2293be5a949d3526b3 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:57.819849 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9eca38a1164c2293be5a949d3526b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.816597 19137 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9eca38a1164c2293be5a949d3526b3 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:57.821508 19060 tablet_service.cc:1511] Processing CreateTablet for tablet 263ce615af6646ada8e5f6d61d990dee (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:57.822213 19132 tablet_service.cc:1511] Processing CreateTablet for tablet 263ce615af6646ada8e5f6d61d990dee (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:57.822671 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263ce615af6646ada8e5f6d61d990dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.826263 19266 tablet_bootstrap.cc:654] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.822788 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9eca38a1164c2293be5a949d3526b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.829433 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263ce615af6646ada8e5f6d61d990dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.833178 19264 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.833649 19264 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:57.835852 19208 tablet_service.cc:1511] Processing CreateTablet for tablet 263ce615af6646ada8e5f6d61d990dee (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:57.836220 19264 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:57.837195 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263ce615af6646ada8e5f6d61d990dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.844229 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9eca38a1164c2293be5a949d3526b3 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:57.845500 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9eca38a1164c2293be5a949d3526b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.863386 19054 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7ecd70203b43ca9b21a47be75683e4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:57.864677 19054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7ecd70203b43ca9b21a47be75683e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.864836 19263 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:57.867588 19261 ts_tablet_manager.cc:1434] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.259s	user 0.052s	sys 0.093s
I20260709 13:17:57.869609 19261 tablet_bootstrap.cc:492] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:57.879235 19208 tablet_service.cc:1511] Processing CreateTablet for tablet c284b8edf0ca4032aeac36d9cbcb9925 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:57.872825 19055 tablet_service.cc:1511] Processing CreateTablet for tablet c284b8edf0ca4032aeac36d9cbcb9925 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:57.880491 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c284b8edf0ca4032aeac36d9cbcb9925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.883204 19202 tablet_service.cc:1511] Processing CreateTablet for tablet af41c4af8a294a729613e88856c064ac (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:57.883540 19137 tablet_service.cc:1511] Processing CreateTablet for tablet af41c4af8a294a729613e88856c064ac (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:57.884796 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af41c4af8a294a729613e88856c064ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.884431 19202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af41c4af8a294a729613e88856c064ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.877172 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7ecd70203b43ca9b21a47be75683e4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:57.887040 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7ecd70203b43ca9b21a47be75683e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.877825 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7ecd70203b43ca9b21a47be75683e4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:57.901610 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7ecd70203b43ca9b21a47be75683e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.901832 19128 tablet_service.cc:1511] Processing CreateTablet for tablet 21c9cfe67c8c483e9edc1da47107fd2f (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:57.884414 19061 tablet_service.cc:1511] Processing CreateTablet for tablet 21c9cfe67c8c483e9edc1da47107fd2f (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:57.908648 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 90cdd87d3b9846a1a1863432e72d2d75 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:57.913216 19128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c9cfe67c8c483e9edc1da47107fd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.915669 19204 tablet_service.cc:1511] Processing CreateTablet for tablet 90cdd87d3b9846a1a1863432e72d2d75 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:57.916909 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cdd87d3b9846a1a1863432e72d2d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.875626 19135 tablet_service.cc:1511] Processing CreateTablet for tablet c284b8edf0ca4032aeac36d9cbcb9925 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:57.887584 19263 ts_tablet_manager.cc:1403] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.231s	user 0.026s	sys 0.010s
I20260709 13:17:57.922340 19263 raft_consensus.cc:359] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:57.923034 19263 raft_consensus.cc:385] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.923333 19263 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.887669 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c284b8edf0ca4032aeac36d9cbcb9925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.924464 19061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c9cfe67c8c483e9edc1da47107fd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.906226 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 21c9cfe67c8c483e9edc1da47107fd2f (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:57.925732 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c9cfe67c8c483e9edc1da47107fd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.929255 19263 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:57.929901 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 90cdd87d3b9846a1a1863432e72d2d75 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:57.934104 19060 tablet_service.cc:1511] Processing CreateTablet for tablet debddc2dd9264017aeda9f1cad516f83 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:57.934897 19261 tablet_bootstrap.cc:654] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:57.935314 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debddc2dd9264017aeda9f1cad516f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.937163 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cdd87d3b9846a1a1863432e72d2d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.888826 19056 tablet_service.cc:1511] Processing CreateTablet for tablet af41c4af8a294a729613e88856c064ac (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:57.889873 19266 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:57.941363 19266 ts_tablet_manager.cc:1403] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.257s	user 0.012s	sys 0.000s
I20260709 13:17:57.942296 19202 tablet_service.cc:1511] Processing CreateTablet for tablet debddc2dd9264017aeda9f1cad516f83 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:57.943516 19202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debddc2dd9264017aeda9f1cad516f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.944200 19266 raft_consensus.cc:359] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:57.899183 19018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:57.918869 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:57.945080 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c284b8edf0ca4032aeac36d9cbcb9925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.946075 19266 raft_consensus.cc:385] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.946493 19266 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.947443 19266 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:57.949088 19038 leader_election.cc:343] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.949265 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cdd87d3b9846a1a1863432e72d2d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.952286 19261 tablet_bootstrap.cc:492] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:57.952739 19261 ts_tablet_manager.cc:1403] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.004s
I20260709 13:17:57.953043 19057 tablet_service.cc:1511] Processing CreateTablet for tablet c875508da24d49ae8496600c3e674b63 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:57.954595 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c875508da24d49ae8496600c3e674b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.955628 19261 raft_consensus.cc:359] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:57.956364 19261 raft_consensus.cc:385] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:57.956714 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af41c4af8a294a729613e88856c064ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.956655 19261 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:57.962092 19261 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:57.966346 19129 tablet_service.cc:1511] Processing CreateTablet for tablet c875508da24d49ae8496600c3e674b63 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:57.982978 19129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c875508da24d49ae8496600c3e674b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.989573 19137 tablet_service.cc:1511] Processing CreateTablet for tablet debddc2dd9264017aeda9f1cad516f83 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:57.990948 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debddc2dd9264017aeda9f1cad516f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.995131 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:57.995554 19132 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9f9257bc714987a2bba35964a315cf (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:17:57.996804 19035 leader_election.cc:343] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:57.996613 19203 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9f9257bc714987a2bba35964a315cf (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:57.997277 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:57.997874 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9f9257bc714987a2bba35964a315cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.998245 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9f9257bc714987a2bba35964a315cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.999136 19059 tablet_service.cc:1511] Processing CreateTablet for tablet 941387979c524e4c8b05785609c3d3c4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:58.000344 19059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941387979c524e4c8b05785609c3d3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:57.993795 19055 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9f9257bc714987a2bba35964a315cf (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:58.001223 19265 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.002079 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9f9257bc714987a2bba35964a315cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.010916 19128 tablet_service.cc:1511] Processing CreateTablet for tablet 941387979c524e4c8b05785609c3d3c4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:58.012154 19128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941387979c524e4c8b05785609c3d3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.014082 19207 tablet_service.cc:1511] Processing CreateTablet for tablet c875508da24d49ae8496600c3e674b63 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:58.015748 19204 tablet_service.cc:1511] Processing CreateTablet for tablet 941387979c524e4c8b05785609c3d3c4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:58.013955 19261 ts_tablet_manager.cc:1434] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.000s
I20260709 13:17:58.017160 19062 tablet_service.cc:1511] Processing CreateTablet for tablet 14973b885f3f4ff1833ff0e215658aa9 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:58.018841 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14973b885f3f4ff1833ff0e215658aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.017714 19261 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:58.040822 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 14973b885f3f4ff1833ff0e215658aa9 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:58.042423 19209 tablet_service.cc:1511] Processing CreateTablet for tablet 14973b885f3f4ff1833ff0e215658aa9 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:58.043530 19053 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:58.044803 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.044992 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c875508da24d49ae8496600c3e674b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.042412 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14973b885f3f4ff1833ff0e215658aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.051095 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941387979c524e4c8b05785609c3d3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.058261 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14973b885f3f4ff1833ff0e215658aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.062888 19263 ts_tablet_manager.cc:1434] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.143s	user 0.026s	sys 0.013s
I20260709 13:17:58.063668 19246 heartbeater.cc:499] Master 127.17.139.62:35345 was elected leader, sending a full tablet report...
I20260709 13:17:58.066272 19172 heartbeater.cc:499] Master 127.17.139.62:35345 was elected leader, sending a full tablet report...
I20260709 13:17:58.067718 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:58.068995 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.074645 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:58.075906 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.077534 19271 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.078001 19271 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.080725 19271 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:58.086899 19054 tablet_service.cc:1511] Processing CreateTablet for tablet 28952387f86d4e5892a88c9c3e0173c8 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:58.093698 19054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28952387f86d4e5892a88c9c3e0173c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.094372 19131 tablet_service.cc:1511] Processing CreateTablet for tablet 28952387f86d4e5892a88c9c3e0173c8 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:58.095582 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28952387f86d4e5892a88c9c3e0173c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.113503 19263 tablet_bootstrap.cc:492] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:58.115073 19266 ts_tablet_manager.cc:1434] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.173s	user 0.021s	sys 0.019s
I20260709 13:17:58.115890 19261 tablet_bootstrap.cc:654] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.116024 19266 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:58.121881 19266 tablet_bootstrap.cc:654] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.155194 19202 tablet_service.cc:1511] Processing CreateTablet for tablet 28952387f86d4e5892a88c9c3e0173c8 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:58.132655 19054 tablet_service.cc:1511] Processing CreateTablet for tablet ec63bca0af2942e1b88ac12d090c139c (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:58.156672 19202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28952387f86d4e5892a88c9c3e0173c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.156770 19054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec63bca0af2942e1b88ac12d090c139c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.161589 19132 tablet_service.cc:1511] Processing CreateTablet for tablet 701310a5195343c081bea195df509e65 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:58.162791 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701310a5195343c081bea195df509e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.159315 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 1e32daa1d5e3443eaaf7b1e03100b270 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:58.170915 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32daa1d5e3443eaaf7b1e03100b270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.179559 19204 tablet_service.cc:1511] Processing CreateTablet for tablet ec63bca0af2942e1b88ac12d090c139c (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:58.180852 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec63bca0af2942e1b88ac12d090c139c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.181565 19273 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.182009 19273 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.182237 19208 tablet_service.cc:1511] Processing CreateTablet for tablet 701310a5195343c081bea195df509e65 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:58.184476 19273 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.208930 19137 tablet_service.cc:1511] Processing CreateTablet for tablet c1b84fdcb260415b9e65e72540fe1841 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:58.209501 19131 tablet_service.cc:1511] Processing CreateTablet for tablet 1e32daa1d5e3443eaaf7b1e03100b270 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:58.210821 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b84fdcb260415b9e65e72540fe1841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.211730 19055 tablet_service.cc:1511] Processing CreateTablet for tablet c1b84fdcb260415b9e65e72540fe1841 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:58.211623 19062 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8c498b148c4d5db7c4a7d0e2b24360 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:58.213092 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b84fdcb260415b9e65e72540fe1841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.213752 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8c498b148c4d5db7c4a7d0e2b24360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.215096 19134 tablet_service.cc:1511] Processing CreateTablet for tablet ec63bca0af2942e1b88ac12d090c139c (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:58.216533 19263 tablet_bootstrap.cc:654] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.212960 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32daa1d5e3443eaaf7b1e03100b270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.225395 19057 tablet_service.cc:1511] Processing CreateTablet for tablet 701310a5195343c081bea195df509e65 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:58.225944 19203 tablet_service.cc:1511] Processing CreateTablet for tablet c1b84fdcb260415b9e65e72540fe1841 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:58.226665 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701310a5195343c081bea195df509e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.229362 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec63bca0af2942e1b88ac12d090c139c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.209000 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701310a5195343c081bea195df509e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.234535 19266 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:58.235018 19266 ts_tablet_manager.cc:1403] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.119s	user 0.023s	sys 0.028s
I20260709 13:17:58.237484 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b84fdcb260415b9e65e72540fe1841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.174801 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 1e32daa1d5e3443eaaf7b1e03100b270 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:58.241751 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32daa1d5e3443eaaf7b1e03100b270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.251739 19266 raft_consensus.cc:359] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.252506 19266 raft_consensus.cc:385] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.252791 19266 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.264447 19266 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.266485 19266 ts_tablet_manager.cc:1434] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:17:58.267395 19266 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:58.274644 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8c498b148c4d5db7c4a7d0e2b24360 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:58.275872 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8c498b148c4d5db7c4a7d0e2b24360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.295732 19265 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.301697 19265 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.304008 19265 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.304997 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:58.305745 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8c498b148c4d5db7c4a7d0e2b24360 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:17:58.308801 19035 leader_election.cc:343] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.319813 19266 tablet_bootstrap.cc:654] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.321201 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:58.323510 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:17:58.324966 19038 leader_election.cc:343] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.325394 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:58.326725 19265 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.329437 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:58.329427 19273 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.330888 19273 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.332952 19273 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.333884 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:58.334489 19261 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:58.334964 19261 ts_tablet_manager.cc:1403] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.317s	user 0.005s	sys 0.027s
W20260709 13:17:58.335464 19113 leader_election.cc:343] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.336063 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:17:58.338225 19113 leader_election.cc:343] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:58.339618 19184 leader_election.cc:343] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:58.340278 19184 leader_election.cc:343] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.340636 19184 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:58.341545 19274 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.343976 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:58.344765 19055 tablet_service.cc:1511] Processing CreateTablet for tablet 41fc665fafb64d08b393d9c8a77d2608 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:58.345427 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:58.346040 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fc665fafb64d08b393d9c8a77d2608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.346562 19263 tablet_bootstrap.cc:492] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
W20260709 13:17:58.346771 19110 leader_election.cc:343] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.347080 19263 ts_tablet_manager.cc:1403] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.234s	user 0.018s	sys 0.004s
I20260709 13:17:58.347239 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:58.348091 19273 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:58.349630 19110 leader_election.cc:343] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.350342 19110 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:58.352473 19273 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.350893 19263 raft_consensus.cc:359] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.353408 19263 raft_consensus.cc:385] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.349846 19261 raft_consensus.cc:359] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.353729 19263 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.359262 19261 raft_consensus.cc:385] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.359663 19261 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.359767 19263 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.360622 19261 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.363114 19261 ts_tablet_manager.cc:1434] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:17:58.364051 19261 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:58.353847 19266 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:58.367892 19266 ts_tablet_manager.cc:1403] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.003s
I20260709 13:17:58.370030 19263 ts_tablet_manager.cc:1434] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.006s
I20260709 13:17:58.370100 19261 tablet_bootstrap.cc:654] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.371078 19263 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:58.374707 19261 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:58.375120 19261 ts_tablet_manager.cc:1403] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:17:58.377310 19261 raft_consensus.cc:359] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.378050 19261 raft_consensus.cc:385] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.378336 19261 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.379141 19261 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.379549 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 41fc665fafb64d08b393d9c8a77d2608 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:58.380757 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fc665fafb64d08b393d9c8a77d2608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.381497 19261 ts_tablet_manager.cc:1434] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:58.379550 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8c498b148c4d5db7c4a7d0e2b24360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.382490 19261 tablet_bootstrap.cc:492] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:58.386507 19203 tablet_service.cc:1511] Processing CreateTablet for tablet 41fc665fafb64d08b393d9c8a77d2608 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:58.388283 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fc665fafb64d08b393d9c8a77d2608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.400794 19266 raft_consensus.cc:359] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.401839 19266 raft_consensus.cc:385] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.402215 19266 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.408037 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:58.409469 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.409848 19261 tablet_bootstrap.cc:654] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.410342 19208 tablet_service.cc:1511] Processing CreateTablet for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:58.411621 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.413440 19266 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.414351 19131 tablet_service.cc:1511] Processing CreateTablet for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:58.416174 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.423805 19204 tablet_service.cc:1511] Processing CreateTablet for tablet e77b4d72a0734e868e23b83a18a0f6a8 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:58.425159 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77b4d72a0734e868e23b83a18a0f6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.428512 19134 tablet_service.cc:1511] Processing CreateTablet for tablet e77b4d72a0734e868e23b83a18a0f6a8 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:58.429842 19055 tablet_service.cc:1511] Processing CreateTablet for tablet e77b4d72a0734e868e23b83a18a0f6a8 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:58.431026 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77b4d72a0734e868e23b83a18a0f6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.434608 19261 tablet_bootstrap.cc:492] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:58.435140 19261 ts_tablet_manager.cc:1403] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.032s
I20260709 13:17:58.438493 19261 raft_consensus.cc:359] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.439304 19261 raft_consensus.cc:385] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.439627 19261 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.440456 19261 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.442267 19266 ts_tablet_manager.cc:1434] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:17:58.446250 19263 tablet_bootstrap.cc:654] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.429837 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77b4d72a0734e868e23b83a18a0f6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.448307 19057 tablet_service.cc:1511] Processing CreateTablet for tablet 79274c20a7fb4e3dbf6355e5d4a28751 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:58.449484 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79274c20a7fb4e3dbf6355e5d4a28751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.450350 19266 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:58.452170 19137 tablet_service.cc:1511] Processing CreateTablet for tablet 79274c20a7fb4e3dbf6355e5d4a28751 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:58.453429 19137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79274c20a7fb4e3dbf6355e5d4a28751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.460183 19203 tablet_service.cc:1511] Processing CreateTablet for tablet 75fa1003f49c4855bf92d61c4fc4e4ed (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:58.461452 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fa1003f49c4855bf92d61c4fc4e4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.470112 19204 tablet_service.cc:1511] Processing CreateTablet for tablet 79274c20a7fb4e3dbf6355e5d4a28751 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:58.470619 19055 tablet_service.cc:1511] Processing CreateTablet for tablet 75fa1003f49c4855bf92d61c4fc4e4ed (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:58.471427 19266 tablet_bootstrap.cc:654] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.471484 19261 ts_tablet_manager.cc:1434] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:17:58.472925 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fa1003f49c4855bf92d61c4fc4e4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.480561 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 13256a1f86494f9f812c2c4162cec4f7 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:58.481617 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13256a1f86494f9f812c2c4162cec4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.483340 19208 tablet_service.cc:1511] Processing CreateTablet for tablet 13256a1f86494f9f812c2c4162cec4f7 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:58.480571 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 13256a1f86494f9f812c2c4162cec4f7 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:58.485183 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13256a1f86494f9f812c2c4162cec4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.485734 19261 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:58.474020 19131 tablet_service.cc:1511] Processing CreateTablet for tablet 75fa1003f49c4855bf92d61c4fc4e4ed (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:58.473076 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79274c20a7fb4e3dbf6355e5d4a28751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.489559 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fa1003f49c4855bf92d61c4fc4e4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.493748 19054 tablet_service.cc:1511] Processing CreateTablet for tablet 5f49755f447d4bfba9fb1a68e2fedfa3 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:58.494942 19054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f49755f447d4bfba9fb1a68e2fedfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.496414 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 5f49755f447d4bfba9fb1a68e2fedfa3 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:58.498585 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f49755f447d4bfba9fb1a68e2fedfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.492110 19261 tablet_bootstrap.cc:654] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.504501 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13256a1f86494f9f812c2c4162cec4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.505833 19133 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf1d0079a1c47338b7cf7be4cdcf505 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:58.506958 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf1d0079a1c47338b7cf7be4cdcf505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.498883 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 5f49755f447d4bfba9fb1a68e2fedfa3 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:58.510601 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f49755f447d4bfba9fb1a68e2fedfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.511065 19202 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf1d0079a1c47338b7cf7be4cdcf505 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:58.512231 19202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf1d0079a1c47338b7cf7be4cdcf505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.513762 19209 tablet_service.cc:1511] Processing CreateTablet for tablet c3bb7a633516455782a998ee89832b55 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:58.514885 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bb7a633516455782a998ee89832b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.520126 19057 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf1d0079a1c47338b7cf7be4cdcf505 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:58.521729 19057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf1d0079a1c47338b7cf7be4cdcf505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.535344 19263 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:58.535806 19263 ts_tablet_manager.cc:1403] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.004s
I20260709 13:17:58.538741 19135 tablet_service.cc:1511] Processing CreateTablet for tablet c3bb7a633516455782a998ee89832b55 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:58.538910 19132 tablet_service.cc:1511] Processing CreateTablet for tablet b07ef65c060943509b105c2f74e22ff5 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:58.539477 19129 tablet_service.cc:1511] Processing CreateTablet for tablet 33ef0d891f7b462bafaf9441fbf19e37 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:58.539996 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bb7a633516455782a998ee89832b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.539848 19130 tablet_service.cc:1511] Processing CreateTablet for tablet e7fd9d26dc9f47ba92b818f308617d95 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:58.540536 19128 tablet_service.cc:1511] Processing CreateTablet for tablet 49d828ebf4a6479ca74fbb76d8536b5a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:58.541543 19129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ef0d891f7b462bafaf9441fbf19e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.542586 19053 tablet_service.cc:1511] Processing CreateTablet for tablet b07ef65c060943509b105c2f74e22ff5 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:58.543751 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07ef65c060943509b105c2f74e22ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.543444 19062 tablet_service.cc:1511] Processing CreateTablet for tablet e7fd9d26dc9f47ba92b818f308617d95 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:58.544618 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fd9d26dc9f47ba92b818f308617d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.545123 19059 tablet_service.cc:1511] Processing CreateTablet for tablet 49d828ebf4a6479ca74fbb76d8536b5a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:58.545532 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 49d828ebf4a6479ca74fbb76d8536b5a (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:58.546277 19059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d828ebf4a6479ca74fbb76d8536b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.546737 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d828ebf4a6479ca74fbb76d8536b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.549822 19203 tablet_service.cc:1511] Processing CreateTablet for tablet 33ef0d891f7b462bafaf9441fbf19e37 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:58.551000 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ef0d891f7b462bafaf9441fbf19e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.550786 19211 tablet_service.cc:1511] Processing CreateTablet for tablet e7fd9d26dc9f47ba92b818f308617d95 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:58.542217 19055 tablet_service.cc:1511] Processing CreateTablet for tablet c3bb7a633516455782a998ee89832b55 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:58.551963 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fd9d26dc9f47ba92b818f308617d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.549850 19056 tablet_service.cc:1511] Processing CreateTablet for tablet 33ef0d891f7b462bafaf9441fbf19e37 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:58.552781 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bb7a633516455782a998ee89832b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.553176 19128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d828ebf4a6479ca74fbb76d8536b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.553767 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07ef65c060943509b105c2f74e22ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.554378 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ef0d891f7b462bafaf9441fbf19e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.556190 19130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fd9d26dc9f47ba92b818f308617d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.555984 19208 tablet_service.cc:1511] Processing CreateTablet for tablet b07ef65c060943509b105c2f74e22ff5 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:58.559991 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07ef65c060943509b105c2f74e22ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.561766 19265 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.562196 19265 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.564162 19265 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.566120 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:58.566191 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:17:58.567556 19038 leader_election.cc:343] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:58.568053 19035 leader_election.cc:343] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.568645 19035 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:58.575132 19265 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.574532 19263 raft_consensus.cc:359] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.597674 19263 raft_consensus.cc:385] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.598011 19263 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.598745 19263 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.617337 19265 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.610368 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:58.620780 19265 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.600844 19263 ts_tablet_manager.cc:1434] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.065s	user 0.002s	sys 0.007s
I20260709 13:17:58.621603 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.622680 19263 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:58.627425 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:58.628064 19147 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:17:58.629161 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:58.629845 19209 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:58.631062 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.633194 19265 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.634624 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:58.636372 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 7af214f1f7324aef8b59a1b91a41d317 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:58.639115 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af214f1f7324aef8b59a1b91a41d317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.641189 19060 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6c3fb3159248429932b08d8bc9f222 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:58.642366 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6c3fb3159248429932b08d8bc9f222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.642844 19265 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.637840 19062 tablet_service.cc:1511] Processing CreateTablet for tablet 7af214f1f7324aef8b59a1b91a41d317 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:17:58.641202 19038 leader_election.cc:343] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.650552 19134 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:58.651619 19134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.645936 19265 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.651650 19202 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6c3fb3159248429932b08d8bc9f222 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:58.659539 19202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6c3fb3159248429932b08d8bc9f222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.659687 19129 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6c3fb3159248429932b08d8bc9f222 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:58.660905 19129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6c3fb3159248429932b08d8bc9f222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.657145 19265 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.667765 19061 tablet_service.cc:1511] Processing CreateTablet for tablet 409c2d9a573f4e408b732ebafda96921 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:58.658185 19132 tablet_service.cc:1511] Processing CreateTablet for tablet 7af214f1f7324aef8b59a1b91a41d317 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:58.669116 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af214f1f7324aef8b59a1b91a41d317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.669461 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 409c2d9a573f4e408b732ebafda96921 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:58.649327 19263 tablet_bootstrap.cc:654] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.670750 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409c2d9a573f4e408b732ebafda96921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.675040 19266 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:58.675609 19266 ts_tablet_manager.cc:1403] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.225s	user 0.024s	sys 0.014s
I20260709 13:17:58.677565 19055 tablet_service.cc:1511] Processing CreateTablet for tablet 736ce293ef884a9d97ae4efb914752f6 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:58.678213 19135 tablet_service.cc:1511] Processing CreateTablet for tablet 736ce293ef884a9d97ae4efb914752f6 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:58.679566 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736ce293ef884a9d97ae4efb914752f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.681087 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 736ce293ef884a9d97ae4efb914752f6 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:58.682243 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736ce293ef884a9d97ae4efb914752f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.682729 19266 raft_consensus.cc:359] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.683456 19266 raft_consensus.cc:385] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.683761 19266 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.675005 19261 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:58.691000 19261 ts_tablet_manager.cc:1403] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.205s	user 0.006s	sys 0.034s
I20260709 13:17:58.694011 19261 raft_consensus.cc:359] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.694672 19261 raft_consensus.cc:385] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.694962 19261 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.695192 19133 tablet_service.cc:1511] Processing CreateTablet for tablet ddcb71ca04ee449ba3db37be4900a2cd (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:58.695660 19261 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.696411 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcb71ca04ee449ba3db37be4900a2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.690186 19265 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.701426 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af214f1f7324aef8b59a1b91a41d317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.702553 19128 tablet_service.cc:1511] Processing CreateTablet for tablet 409c2d9a573f4e408b732ebafda96921 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:58.705443 19061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409c2d9a573f4e408b732ebafda96921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.708560 19055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736ce293ef884a9d97ae4efb914752f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.736177 19204 tablet_service.cc:1511] Processing CreateTablet for tablet ddcb71ca04ee449ba3db37be4900a2cd (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:58.737465 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcb71ca04ee449ba3db37be4900a2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.684620 19266 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:58.739154 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 110078us
I20260709 13:17:58.739331 19266 ts_tablet_manager.cc:1434] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:17:58.743023 19266 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:58.754951 19273 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.755424 19273 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.757447 19273 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.757812 19053 tablet_service.cc:1511] Processing CreateTablet for tablet 61d460e2151b412d8e1e8208d00679bc (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:58.759001 19263 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:58.758939 19290 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.759524 19263 ts_tablet_manager.cc:1403] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.017s
I20260709 13:17:58.759582 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:58.759447 19290 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.761423 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:58.762461 19274 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.762670 19290 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.762357 19263 raft_consensus.cc:359] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.763139 19263 raft_consensus.cc:385] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.762948 19274 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.763458 19263 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.764128 19263 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.765885 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d460e2151b412d8e1e8208d00679bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:58.766819 19113 leader_election.cc:343] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.767486 19071 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:58.769044 19128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409c2d9a573f4e408b732ebafda96921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.770726 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:58.772356 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:17:58.773825 19038 leader_election.cc:343] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.773927 19265 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.776118 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:17:58.777422 19038 leader_election.cc:343] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.778101 19274 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:58.778955 19054 tablet_service.cc:1511] Processing CreateTablet for tablet ddcb71ca04ee449ba3db37be4900a2cd (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:58.780143 19054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddcb71ca04ee449ba3db37be4900a2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.782431 19273 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.782809 19273 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.783129 19273 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.785068 19274 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.785735 19261 ts_tablet_manager.cc:1434] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
I20260709 13:17:58.785540 19274 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.785218 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:58.786866 19071 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:58.793406 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:58.793687 19129 tablet_service.cc:1511] Processing CreateTablet for tablet 61d460e2151b412d8e1e8208d00679bc (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:58.796756 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:58.799592 19129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d460e2151b412d8e1e8208d00679bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:58.802390 19184 leader_election.cc:343] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.803125 19273 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.805316 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:58.805559 19266 tablet_bootstrap.cc:654] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.806181 19274 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:58.788849 19261 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:58.810746 19294 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.813858 19294 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.823630 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:58.825227 19147 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:17:58.825167 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 61d460e2151b412d8e1e8208d00679bc (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:58.825461 19061 tablet_service.cc:1511] Processing CreateTablet for tablet 2653a1baca71467dbf9167aede923a9c (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:58.826567 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d460e2151b412d8e1e8208d00679bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.820096 19294 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:58.821084 19184 leader_election.cc:343] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.826678 19061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2653a1baca71467dbf9167aede923a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.830119 19204 tablet_service.cc:1511] Processing CreateTablet for tablet 2653a1baca71467dbf9167aede923a9c (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:58.832789 19263 ts_tablet_manager.cc:1434] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.073s	user 0.016s	sys 0.010s
I20260709 13:17:58.833822 19263 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:58.835404 19053 tablet_service.cc:1511] Processing CreateTablet for tablet ef2bd04462cb41488ea5d3a18b899972 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:58.836400 19133 tablet_service.cc:1511] Processing CreateTablet for tablet ef2bd04462cb41488ea5d3a18b899972 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:58.826620 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:58.837736 19133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2bd04462cb41488ea5d3a18b899972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.836796 19132 tablet_service.cc:1511] Processing CreateTablet for tablet 61d161ec86f94a4eaf383729c1ddbc87 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:58.838716 19060 tablet_service.cc:1511] Processing CreateTablet for tablet 61d161ec86f94a4eaf383729c1ddbc87 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:58.837740 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:58.840696 19135 tablet_service.cc:1511] Processing CreateTablet for tablet 2653a1baca71467dbf9167aede923a9c (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:58.845016 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:17:58.845527 19184 leader_election.cc:343] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.846071 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:58.846774 19053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2bd04462cb41488ea5d3a18b899972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.847152 19274 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.845598 19147 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.840999 19292 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.847728 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2653a1baca71467dbf9167aede923a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.849411 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d161ec86f94a4eaf383729c1ddbc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.853976 19060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d161ec86f94a4eaf383729c1ddbc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.857424 19135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2653a1baca71467dbf9167aede923a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.870190 19062 tablet_service.cc:1511] Processing CreateTablet for tablet 3cafb40f37ca439fa093060d6ba342f0 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:58.871508 19062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cafb40f37ca439fa093060d6ba342f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.873535 19294 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.874317 19204 tablet_service.cc:1511] Processing CreateTablet for tablet ef2bd04462cb41488ea5d3a18b899972 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:58.875181 19202 tablet_service.cc:1511] Processing CreateTablet for tablet 61d161ec86f94a4eaf383729c1ddbc87 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:58.876220 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2bd04462cb41488ea5d3a18b899972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.874980 19263 tablet_bootstrap.cc:654] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.875039 19261 tablet_bootstrap.cc:654] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:58.882118 19202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d161ec86f94a4eaf383729c1ddbc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.882272 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:58.884675 19293 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.885174 19293 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.888060 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:17:58.889474 19184 leader_election.cc:343] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.891760 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:58.892375 19146 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:58.893761 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:58.894671 19274 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:58.895040 19274 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.895388 19274 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.895445 19273 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.900600 19294 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:58.902895 19130 tablet_service.cc:1511] Processing CreateTablet for tablet 3cafb40f37ca439fa093060d6ba342f0 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:58.904166 19130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cafb40f37ca439fa093060d6ba342f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.905694 19292 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.905859 19058 tablet_service.cc:1511] Processing CreateTablet for tablet 3846ceb53ab145bfa0ae536aa51f05d0 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:58.914075 19131 tablet_service.cc:1511] Processing CreateTablet for tablet 3846ceb53ab145bfa0ae536aa51f05d0 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:58.915295 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3846ceb53ab145bfa0ae536aa51f05d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.916277 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:58.917405 19058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3846ceb53ab145bfa0ae536aa51f05d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:58.917755 19184 leader_election.cc:343] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.914099 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:58.907197 19293 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:58.921618 19072 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.925634 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:58.927533 19204 tablet_service.cc:1511] Processing CreateTablet for tablet 3cafb40f37ca439fa093060d6ba342f0 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:58.928665 19204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cafb40f37ca439fa093060d6ba342f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.937723 19203 tablet_service.cc:1511] Processing CreateTablet for tablet 3846ceb53ab145bfa0ae536aa51f05d0 (DEFAULT_TABLE table=test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:58.938920 19203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3846ceb53ab145bfa0ae536aa51f05d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:58.939175 19273 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.940452 19113 leader_election.cc:343] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.941484 19273 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:58.948966 19018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:58.950182 19273 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:58.951038 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:58.951772 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:17:58.952513 19110 leader_election.cc:343] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:58.953111 19113 leader_election.cc:343] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:58.953572 19113 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:58.954377 19273 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:58.957828 19072 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:58.958874 19261 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:58.959029 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:17:58.959378 19261 ts_tablet_manager.cc:1403] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.171s	user 0.005s	sys 0.009s
I20260709 13:17:58.960196 19293 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.960706 19293 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:17:58.961572 19293 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.962656 19071 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:58.963312 19261 raft_consensus.cc:359] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.964010 19261 raft_consensus.cc:385] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:58.964321 19261 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:58.965272 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:58.966517 19273 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.965288 19261 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.971577 19274 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.973690 19147 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:17:58.975029 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:58.976446 19292 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:58.977053 19292 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:17:58.978108 19292 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.984359 19261 ts_tablet_manager.cc:1434] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.005s
I20260709 13:17:58.989025 19263 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:58.989573 19263 ts_tablet_manager.cc:1403] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.010s
I20260709 13:17:58.990509 19273 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:17:58.992694 19273 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:58.994385 19274 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:58.996532 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:58.997465 19266 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:58.997843 19147 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:58.997988 19266 ts_tablet_manager.cc:1403] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.255s	user 0.042s	sys 0.020s
I20260709 13:17:59.001178 19265 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.001641 19265 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.001659 19266 raft_consensus.cc:359] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.002735 19266 raft_consensus.cc:385] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.003108 19266 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.003912 19265 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.003996 19266 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.005647 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.006455 19221 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:17:59.008600 19299 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.000587 18969 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.012086 19292 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.012564 19292 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.013005 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.013734 19072 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.014364 19147 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.009104 19299 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.015592 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:17:59.016448 19274 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.016942 19274 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:17:59.017264 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.018011 19071 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:17:59.017773 19274 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.021581 19266 ts_tablet_manager.cc:1434] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:17:59.021492 19263 raft_consensus.cc:359] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.022281 19263 raft_consensus.cc:385] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.023885 19263 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.029881 19072 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.029822 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.031584 19263 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:59.032017 19035 leader_election.cc:343] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.029178 19261 tablet_bootstrap.cc:492] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.034745 19266 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.035084 19292 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.036226 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.036906 19221 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:17:59.034869 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.038199 19038 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:17:59.039033 19292 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.039423 19292 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.039819 19292 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.033567 18968 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.040223 19299 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.041384 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.042973 19113 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.043522 18967 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.038223 19147 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:17:59.046221 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:59.046860 19263 ts_tablet_manager.cc:1434] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.002s
I20260709 13:17:59.047354 19265 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.047891 19263 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.048228 19299 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.051414 19292 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.054629 19292 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.055725 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:59.056329 19221 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.057128 19261 tablet_bootstrap.cc:654] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.057619 19266 tablet_bootstrap.cc:654] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.058000 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:17:59.059353 19035 leader_election.cc:343] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.060130 19274 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.060626 19274 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.062757 19274 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.064110 19221 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:17:59.065115 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.065299 19038 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:17:59.066419 19292 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:59.066517 19184 leader_election.cc:343] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.066978 19292 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:17:59.067886 19292 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.069984 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:17:59.071383 19184 leader_election.cc:343] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.071851 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.073140 19274 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.077921 19263 tablet_bootstrap.cc:654] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.081598 19266 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.082053 19266 ts_tablet_manager.cc:1403] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.012s
I20260709 13:17:59.084390 19266 raft_consensus.cc:359] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.085130 19266 raft_consensus.cc:385] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.085400 19266 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.086180 19266 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.087448 19299 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.088164 19266 ts_tablet_manager.cc:1434] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:59.089073 19266 tablet_bootstrap.cc:492] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.089663 19261 tablet_bootstrap.cc:492] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.090282 19261 ts_tablet_manager.cc:1403] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.008s
I20260709 13:17:59.093223 19261 raft_consensus.cc:359] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.093886 19261 raft_consensus.cc:385] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.094185 19261 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.095047 19261 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.096071 19266 tablet_bootstrap.cc:654] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.096331 19263 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.096748 19261 ts_tablet_manager.cc:1434] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:59.096809 19263 ts_tablet_manager.cc:1403] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 13:17:59.097616 19261 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.100033 19263 raft_consensus.cc:359] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.100824 19263 raft_consensus.cc:385] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.101307 19263 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.102267 19263 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.105492 19261 tablet_bootstrap.cc:654] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.107199 19263 ts_tablet_manager.cc:1434] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:59.111419 19266 tablet_bootstrap.cc:492] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.111877 19266 ts_tablet_manager.cc:1403] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.007s
I20260709 13:17:59.114619 19266 raft_consensus.cc:359] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.115302 19266 raft_consensus.cc:385] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.115576 19266 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.116334 19266 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.118686 19266 ts_tablet_manager.cc:1434] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:17:59.119613 19266 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.120630 18969 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.125780 19266 tablet_bootstrap.cc:654] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.126689 18968 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.136701 19266 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.137142 19266 ts_tablet_manager.cc:1403] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:17:59.137733 19263 tablet_bootstrap.cc:492] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.139505 19266 raft_consensus.cc:359] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.140137 19266 raft_consensus.cc:385] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.140398 19266 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.141222 19266 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.147883 19266 ts_tablet_manager.cc:1434] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:17:59.148700 19266 tablet_bootstrap.cc:492] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.154564 19266 tablet_bootstrap.cc:654] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.155570 19263 tablet_bootstrap.cc:654] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.162684 19261 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.163087 19261 ts_tablet_manager.cc:1403] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.045s
I20260709 13:17:59.164811 19266 tablet_bootstrap.cc:492] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.165293 19266 ts_tablet_manager.cc:1403] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:17:59.165114 19261 raft_consensus.cc:359] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.165807 19261 raft_consensus.cc:385] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.166134 19261 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.167018 19263 tablet_bootstrap.cc:492] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.166927 19261 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.167500 19263 ts_tablet_manager.cc:1403] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:17:59.167820 19266 raft_consensus.cc:359] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.168439 19266 raft_consensus.cc:385] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.168820 19266 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.169502 19266 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.170538 19263 raft_consensus.cc:359] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.171274 19266 ts_tablet_manager.cc:1434] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:59.171296 19263 raft_consensus.cc:385] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.171916 19263 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.172580 19261 ts_tablet_manager.cc:1434] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:59.172605 19263 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.173681 19261 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.175582 19266 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.180112 19261 tablet_bootstrap.cc:654] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.185271 19266 tablet_bootstrap.cc:654] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.189760 19266 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.190213 19266 ts_tablet_manager.cc:1403] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:17:59.190328 19263 ts_tablet_manager.cc:1434] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:17:59.190881 19261 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.191314 19261 ts_tablet_manager.cc:1403] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:17:59.191393 19263 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.192921 19266 raft_consensus.cc:359] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.193590 19266 raft_consensus.cc:385] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.193845 19266 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.194034 19261 raft_consensus.cc:359] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.194782 19261 raft_consensus.cc:385] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.194618 19266 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.195101 19261 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.196002 19274 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.195827 19261 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.196635 19266 ts_tablet_manager.cc:1434] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:59.196450 19274 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.197691 19266 tablet_bootstrap.cc:492] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.198021 19261 ts_tablet_manager.cc:1434] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:59.198585 19274 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.200358 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.202080 19261 tablet_bootstrap.cc:492] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.203764 19266 tablet_bootstrap.cc:654] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.204126 19263 tablet_bootstrap.cc:654] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.204955 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.209030 19261 tablet_bootstrap.cc:654] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.214564 19072 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 1: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:17:59.216061 19263 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.216506 19263 ts_tablet_manager.cc:1403] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:17:59.217263 19184 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.218087 19274 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.219059 19263 raft_consensus.cc:359] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.219679 19263 raft_consensus.cc:385] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.219929 19263 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.222237 19266 tablet_bootstrap.cc:492] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.222671 19266 ts_tablet_manager.cc:1403] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.003s
I20260709 13:17:59.225131 19274 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.225281 19266 raft_consensus.cc:359] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.225940 19266 raft_consensus.cc:385] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.226226 19266 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.220558 19263 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.226899 19266 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.227438 19293 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.227929 19293 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.228699 19263 ts_tablet_manager.cc:1434] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:17:59.228929 19266 ts_tablet_manager.cc:1434] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:17:59.230958 19261 tablet_bootstrap.cc:492] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.231458 19261 ts_tablet_manager.cc:1403] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.013s
I20260709 13:17:59.233300 19266 tablet_bootstrap.cc:492] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.233736 19263 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.234189 19261 raft_consensus.cc:359] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.234923 19261 raft_consensus.cc:385] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.235229 19261 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.236035 19261 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.238117 19261 ts_tablet_manager.cc:1434] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:59.238963 19261 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.239409 19266 tablet_bootstrap.cc:654] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.243912 19263 tablet_bootstrap.cc:654] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.243999 19299 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.244783 19261 tablet_bootstrap.cc:654] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.244529 19299 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.246834 19299 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.249300 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.252014 19292 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.252660 19292 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:59.259801 19113 leader_election.cc:343] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.256407 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.260942 19147 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:17:59.261981 19266 tablet_bootstrap.cc:492] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.262569 19266 ts_tablet_manager.cc:1403] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 13:17:59.262609 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.267284 19263 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.267452 19266 raft_consensus.cc:359] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.267787 19263 ts_tablet_manager.cc:1403] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.009s
I20260709 13:17:59.267629 19290 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.268093 19266 raft_consensus.cc:385] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.268362 19290 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.268972 19290 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.269955 19292 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.270833 19261 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.270735 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.271324 19261 ts_tablet_manager.cc:1403] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.017s
I20260709 13:17:59.271009 19263 raft_consensus.cc:359] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.271930 19263 raft_consensus.cc:385] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.272279 19263 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.273074 19263 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.273413 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.268410 19266 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.275009 19263 ts_tablet_manager.cc:1434] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:59.275318 19266 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.275986 19263 tablet_bootstrap.cc:492] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.277316 19266 ts_tablet_manager.cc:1434] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:17:59.271450 19221 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:17:59.274461 19261 raft_consensus.cc:359] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.278062 19261 raft_consensus.cc:385] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.278337 19261 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.278947 19261 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:59.279966 19110 leader_election.cc:343] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.281008 19261 ts_tablet_manager.cc:1434] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:17:59.281231 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.280464 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.281831 19261 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.281844 19072 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:59.282940 19263 tablet_bootstrap.cc:654] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.282799 19290 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.285624 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:59.286188 19147 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.289259 19261 tablet_bootstrap.cc:654] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.290714 19299 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.281958 19266 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.292322 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.293251 19274 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.293623 19274 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.293967 19274 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.294224 19147 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:17:59.298105 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.299275 19265 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.299762 19265 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:17:59.300608 19265 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.305027 19299 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.305513 19299 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.306892 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:59.312422 19221 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.308506 19290 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.309361 19302 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.313191 19302 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.315569 19302 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.317180 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:17:59.318990 19113 leader_election.cc:343] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.320274 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.311764 19293 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.321820 19299 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.322876 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:17:59.323227 19110 leader_election.cc:343] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.323720 19220 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 1: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:17:59.323712 19110 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.326404 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.327437 19299 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.328564 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.329623 19299 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.338404 19274 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.342370 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.343042 19147 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:59.344291 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.344931 19072 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.348037 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:59.348647 19146 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.349046 19293 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.349514 19293 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.352973 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.353611 19293 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.354916 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.355646 19145 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:59.356890 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:17:59.353581 19071 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:59.357853 19072 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.359071 19266 tablet_bootstrap.cc:654] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.362088 19299 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:59.365918 19293 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.366297 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.367245 19294 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.367950 19146 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.369807 19266 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.370117 19294 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:17:59.370327 19266 ts_tablet_manager.cc:1403] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.001s
I20260709 13:17:59.371045 19274 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.371078 19294 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.373391 19221 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:17:59.366334 19293 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.376133 19293 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.375488 18967 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.375737 19266 raft_consensus.cc:359] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.378916 19266 raft_consensus.cc:385] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.379738 19266 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.381482 19266 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.385864 19266 ts_tablet_manager.cc:1434] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:59.388935 19266 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.391834 19293 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.393150 19274 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.397388 19299 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.397886 19299 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.398921 19293 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.399366 19263 tablet_bootstrap.cc:492] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.399839 19263 ts_tablet_manager.cc:1403] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.124s	user 0.040s	sys 0.049s
I20260709 13:17:59.399900 19299 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.401535 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.401603 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.401476 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.402246 19071 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.402426 19072 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:59.404729 19266 tablet_bootstrap.cc:654] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.403910 19261 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.404000 19263 raft_consensus.cc:359] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.405764 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:59.406292 19261 ts_tablet_manager.cc:1403] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.125s	user 0.049s	sys 0.065s
I20260709 13:17:59.406591 19146 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.407088 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.407639 19263 raft_consensus.cc:385] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.407912 19299 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.408001 19263 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.408306 19299 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.408694 19299 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.409070 19263 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.411216 19263 ts_tablet_manager.cc:1434] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:17:59.412844 19071 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.414170 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.414534 19221 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:59.415081 19293 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.415567 19293 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:17:59.416338 19293 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.413534 19146 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.418814 19263 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.421758 19299 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.422726 18969 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.424278 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.424831 19071 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.425100 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:59.425637 19221 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.428151 19294 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.428617 19294 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.431633 19071 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.431955 19263 tablet_bootstrap.cc:654] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.433419 19261 raft_consensus.cc:359] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.443852 19261 raft_consensus.cc:385] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.444128 19261 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.436033 19302 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.444476 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.445374 19273 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.445822 19273 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:17:59.446668 19273 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.437666 19294 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.438370 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.451426 19072 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:59.451546 19261 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.452584 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.453598 19294 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.454044 19294 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.454457 19294 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.440167 19221 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.440539 19265 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.440713 19299 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.442270 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.443135 19266 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.455390 19265 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.456058 19266 ts_tablet_manager.cc:1403] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.006s
I20260709 13:17:59.457363 19261 ts_tablet_manager.cc:1434] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:17:59.458509 19261 tablet_bootstrap.cc:492] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.458623 19266 raft_consensus.cc:359] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.459359 19266 raft_consensus.cc:385] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.459630 19266 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.459779 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.459797 19293 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.460682 19266 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:59.462630 19038 leader_election.cc:343] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.463614 19266 ts_tablet_manager.cc:1434] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:59.465132 19261 tablet_bootstrap.cc:654] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.465776 19266 tablet_bootstrap.cc:492] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.464118 19294 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:59.464442 19184 leader_election.cc:343] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.471446 19263 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.471905 19263 ts_tablet_manager.cc:1403] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.006s
I20260709 13:17:59.457408 19265 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.474663 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.475063 19263 raft_consensus.cc:359] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.478165 19263 raft_consensus.cc:385] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.478112 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:59.478536 19263 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.479184 19263 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:59.479710 19184 leader_election.cc:343] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.480729 19266 tablet_bootstrap.cc:654] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.481186 19263 ts_tablet_manager.cc:1434] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:59.475451 19146 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:17:59.482128 19263 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.482532 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:59.477041 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.483605 19071 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.484607 19265 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.485033 19265 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.485390 19265 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.475826 19294 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.491567 19071 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.497406 18969 catalog_manager.cc:5697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.498991 19263 tablet_bootstrap.cc:654] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.499243 19290 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.499375 19294 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.500754 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:17:59.502133 19294 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.502395 19261 tablet_bootstrap.cc:492] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.502661 19294 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:17:59.503533 19294 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.502842 19261 ts_tablet_manager.cc:1403] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.008s
I20260709 13:17:59.506713 19266 tablet_bootstrap.cc:492] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.508060 19266 ts_tablet_manager.cc:1403] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.001s
I20260709 13:17:59.510707 19302 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.516614 19266 raft_consensus.cc:359] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.517573 19266 raft_consensus.cc:385] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.517962 19266 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.521868 19266 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.528070 19266 ts_tablet_manager.cc:1434] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:17:59.527788 18967 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.529250 19265 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.531085 19263 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.531350 19221 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.531528 19263 ts_tablet_manager.cc:1403] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.005s
I20260709 13:17:59.532296 19265 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.534125 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:59.535027 19266 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
W20260709 13:17:59.535429 19038 leader_election.cc:343] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.535562 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:59.536137 19147 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.540843 19274 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.551889 19147 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:17:59.553040 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:59.554211 19290 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.554689 19290 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:17:59.555469 19290 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.556269 19266 tablet_bootstrap.cc:654] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.557819 19273 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.557300 19261 raft_consensus.cc:359] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.558403 19273 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.534799 19263 raft_consensus.cc:359] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.559985 19263 raft_consensus.cc:385] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.560251 19263 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.561506 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.562695 19070 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:59.562407 19263 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.563174 19265 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.563854 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.564725 19302 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.565086 19302 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.565413 19302 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.565737 19263 ts_tablet_manager.cc:1434] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:17:59.566607 19263 tablet_bootstrap.cc:492] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.574740 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.575567 19220 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:59.577155 19273 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.578313 19302 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.579269 19263 tablet_bootstrap.cc:654] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.558430 19261 raft_consensus.cc:385] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.580621 19261 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.581284 19261 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.583760 19261 ts_tablet_manager.cc:1434] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.000s
I20260709 13:17:59.586297 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.587018 19070 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.591966 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:59.592506 19220 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.593163 19292 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.592439 19263 tablet_bootstrap.cc:492] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.597735 19263 ts_tablet_manager.cc:1403] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:17:59.599483 19220 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.600263 19263 raft_consensus.cc:359] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.600901 19263 raft_consensus.cc:385] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.600914 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:17:59.601294 19263 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.601831 19273 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.601951 19263 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.602311 19273 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:17:59.603297 19273 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.604964 19263 ts_tablet_manager.cc:1434] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:59.606238 19263 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.606611 18970 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.608240 19302 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.612358 19070 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.614239 19263 tablet_bootstrap.cc:654] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.617483 19261 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.621692 19265 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.625481 19263 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.625927 19263 ts_tablet_manager.cc:1403] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:17:59.628633 19263 raft_consensus.cc:359] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.624727 19261 tablet_bootstrap.cc:654] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.629174 19266 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.629427 19263 raft_consensus.cc:385] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.629666 19266 ts_tablet_manager.cc:1403] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.095s	user 0.003s	sys 0.008s
I20260709 13:17:59.629690 19263 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.630964 19263 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.632517 19266 raft_consensus.cc:359] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.633067 19263 ts_tablet_manager.cc:1434] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:59.633180 19266 raft_consensus.cc:385] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.633477 19266 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.633970 19263 tablet_bootstrap.cc:492] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.634841 19266 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.636909 19266 ts_tablet_manager.cc:1434] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:59.637992 18969 catalog_manager.cc:5697] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.640264 19263 tablet_bootstrap.cc:654] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.640367 19266 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.644416 18970 catalog_manager.cc:5697] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.651221 19273 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.651705 19273 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.652246 19266 tablet_bootstrap.cc:654] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.653667 19273 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.655975 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:17:59.657397 19110 leader_election.cc:343] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.658738 19261 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.659194 19261 ts_tablet_manager.cc:1403] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.007s
I20260709 13:17:59.659763 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.660167 19266 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.660394 19220 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:59.660717 19266 ts_tablet_manager.cc:1403] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.001s
I20260709 13:17:59.661550 19113 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.662864 19273 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.663223 19273 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.663563 19273 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.663508 19266 raft_consensus.cc:359] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.664381 19266 raft_consensus.cc:385] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.664673 19266 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.664527 19261 raft_consensus.cc:359] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.665460 19266 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.666055 19261 raft_consensus.cc:385] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.666723 19261 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.667701 19266 ts_tablet_manager.cc:1434] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:59.668167 19261 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.668586 19266 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.671819 19302 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.672266 19302 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.674248 19302 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.675735 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.676193 19266 tablet_bootstrap.cc:654] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.676322 19070 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:59.678400 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.679203 19302 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.679559 19302 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.679893 19302 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.681157 19261 ts_tablet_manager.cc:1434] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:17:59.682339 19261 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.685204 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:17:59.686419 19113 leader_election.cc:343] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.671136 19273 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.693436 19266 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.694231 19266 ts_tablet_manager.cc:1403] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.001s
I20260709 13:17:59.697046 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.697121 19273 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.697630 19070 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.699643 19266 raft_consensus.cc:359] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.700115 19266 raft_consensus.cc:385] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.700337 19266 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.700829 19266 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.702337 19266 ts_tablet_manager.cc:1434] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:17:59.702991 19266 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.703298 19274 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.703712 19274 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.705158 19070 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.705976 19274 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.706447 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.707521 19261 tablet_bootstrap.cc:654] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.707406 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:59.707790 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.708043 19220 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.708415 19146 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:17:59.709618 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.709648 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:17:59.710698 19274 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.711045 19274 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.711097 19184 leader_election.cc:343] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.711477 19274 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.712267 19273 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.695521 19302 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.714092 19263 tablet_bootstrap.cc:492] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.715453 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.715696 19263 ts_tablet_manager.cc:1403] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.021s
I20260709 13:17:59.715996 19070 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.717098 19220 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.714951 19273 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:17:59.718307 19263 raft_consensus.cc:359] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.718972 19263 raft_consensus.cc:385] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.719290 19263 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.719333 19273 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.720084 19263 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.721288 19274 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.722229 19070 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.723209 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.725464 19265 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.725828 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:59.726815 19266 tablet_bootstrap.cc:654] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.723409 19274 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:17:59.725911 19265 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.728430 19263 ts_tablet_manager.cc:1434] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:17:59.729209 19263 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.727511 19146 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.730625 19302 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.730958 19265 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.733744 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:17:59.734356 19145 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:17:59.735298 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.735906 19219 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:17:59.728366 19299 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.737097 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.737397 19299 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:17:59.738749 19265 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.739126 19265 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.738533 19299 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.739473 19265 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.749105 19261 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.749271 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.750124 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:17:59.750524 19184 leader_election.cc:343] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:59.751317 19113 leader_election.cc:343] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.755802 18969 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.752321 19265 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.756484 19146 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:17:59.760905 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:17:59.762233 19274 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.763363 19274 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:17:59.764135 19274 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:17:59.805832 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54536.5us
I20260709 13:17:59.807085 19261 ts_tablet_manager.cc:1403] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.023s
I20260709 13:17:59.807493 19265 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.807363 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:17:59.808161 19220 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.767946 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:17:59.813444 19146 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.815182 19263 tablet_bootstrap.cc:654] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.815586 19329 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.817536 19220 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:17:59.824923 19261 raft_consensus.cc:359] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.824781 18969 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.825835 19261 raft_consensus.cc:385] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.826236 19261 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.826143 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.828953 19265 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.828907 19261 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.829465 19265 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:17:59.829667 19146 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:17:59.830376 19265 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.836023 19273 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.838481 19266 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.838974 19266 ts_tablet_manager.cc:1403] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.025s
I20260709 13:17:59.837931 19352 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:17:59.838543 19273 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.841948 19266 raft_consensus.cc:359] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.842723 19273 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.842825 19266 raft_consensus.cc:385] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.842442 18967 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.843250 19266 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.844661 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:17:59.835216 19261 ts_tablet_manager.cc:1434] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:17:59.845820 19266 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.848526 19266 ts_tablet_manager.cc:1434] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:17:59.849014 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:17:59.849421 19266 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.849582 19070 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:17:59.851703 19263 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.852152 19263 ts_tablet_manager.cc:1403] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.005s
W20260709 13:17:59.853412 19113 leader_election.cc:343] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.854734 19263 raft_consensus.cc:359] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.855353 19263 raft_consensus.cc:385] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.855598 19263 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.856212 19263 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.847249 19261 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.860489 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:17:59.861634 19273 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:59.861979 19273 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.862282 19273 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.862818 19263 ts_tablet_manager.cc:1434] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:59.863632 19263 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.867918 19261 tablet_bootstrap.cc:654] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.870451 19266 tablet_bootstrap.cc:654] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.871774 19274 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.874248 19263 tablet_bootstrap.cc:654] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.874276 19273 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.879597 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:17:59.880323 19071 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:59.887751 19261 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:17:59.888206 19261 ts_tablet_manager.cc:1403] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:17:59.890246 19293 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.893420 19071 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:17:59.894040 19265 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:59.895537 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:17:59.896631 19299 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:59.897123 19299 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:17:59.898022 19299 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.900625 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:17:59.902302 19113 leader_election.cc:343] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:59.903293 19273 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:17:59.904587 18969 catalog_manager.cc:5697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.897091 19261 raft_consensus.cc:359] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.913326 19261 raft_consensus.cc:385] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.916980 19263 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:17:59.917376 19263 ts_tablet_manager.cc:1403] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.007s
I20260709 13:17:59.914094 19261 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.918889 19274 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.919230 19261 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.920195 19266 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:17:59.920643 19266 ts_tablet_manager.cc:1403] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.017s
I20260709 13:17:59.922034 19261 ts_tablet_manager.cc:1434] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:17:59.923103 19266 raft_consensus.cc:359] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.923631 19261 tablet_bootstrap.cc:492] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:17:59.924961 19263 raft_consensus.cc:359] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.925580 19263 raft_consensus.cc:385] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.925839 19263 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.926573 19263 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.923724 19266 raft_consensus.cc:385] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:59.927482 19266 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:17:59.928326 19266 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:17:59.930552 19261 tablet_bootstrap.cc:654] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.932085 19266 ts_tablet_manager.cc:1434] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:59.932987 19266 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:17:59.930444 19263 ts_tablet_manager.cc:1434] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:17:59.936645 19263 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:17:59.937739 19274 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.944073 19263 tablet_bootstrap.cc:654] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.950340 19266 tablet_bootstrap.cc:654] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:59.979949 19299 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:59.979938 19147 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.000201 18970 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.004180 19299 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.025162 19261 tablet_bootstrap.cc:492] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.025861 19261 ts_tablet_manager.cc:1403] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.103s	user 0.056s	sys 0.033s
I20260709 13:18:00.028632 19261 raft_consensus.cc:359] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.029451 19261 raft_consensus.cc:385] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.029835 19261 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.030869 19261 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.032014 19265 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.034991 19261 ts_tablet_manager.cc:1434] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:00.036154 19261 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.036931 19273 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.037392 19273 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.040022 19273 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.040833 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.041563 19294 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.042645 19261 tablet_bootstrap.cc:654] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.044637 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:00.048214 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.049221 19273 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:00.057848 19266 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.059743 19299 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.060248 19299 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.062734 19299 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.064836 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.067332 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:00.067798 19110 leader_election.cc:343] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.068113 19219 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:00.069658 19113 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.070890 19294 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.071491 19294 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.073060 19273 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.073438 19273 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.073765 19273 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.074846 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.075620 19069 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 1: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:00.076992 19329 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.077471 19329 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.079411 19329 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.081202 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.084790 19266 ts_tablet_manager.cc:1403] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.003s
I20260709 13:18:00.085064 19273 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.088564 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:00.089798 19110 leader_election.cc:343] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.090054 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.091109 19263 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.091545 19263 ts_tablet_manager.cc:1403] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.155s	user 0.025s	sys 0.035s
I20260709 13:18:00.091640 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.092679 19329 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.094061 19263 raft_consensus.cc:359] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.094758 19263 raft_consensus.cc:385] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.095026 19263 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.095275 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:00.095911 19219 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.095677 19263 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.097139 19302 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.099030 19263 ts_tablet_manager.cc:1434] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:00.099601 19221 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.099926 19263 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.106375 19263 tablet_bootstrap.cc:654] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.088263 19266 raft_consensus.cc:359] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.108033 19266 raft_consensus.cc:385] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.108475 19266 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.110852 19266 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.111430 19294 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.113586 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.115070 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.116559 19294 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.116865 19266 ts_tablet_manager.cc:1434] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:18:00.119108 19299 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.119570 19299 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.120180 19265 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.121728 19299 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.124699 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:00.126256 19113 leader_election.cc:343] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.127447 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:00.127622 19018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:00.119424 19266 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
W20260709 13:18:00.129010 19110 leader_election.cc:343] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.129602 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.130519 19299 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.132045 19265 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.132516 19265 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.134716 19265 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.135274 19219 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:00.088578 19273 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.136327 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:00.137610 19263 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.138270 19113 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.139235 19263 ts_tablet_manager.cc:1403] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 13:18:00.138135 19294 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.141242 19384 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.141829 19384 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:00.142755 19384 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.145056 19302 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:00.148043 19038 leader_election.cc:343] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.151422 19299 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.153733 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:00.155462 19035 leader_election.cc:343] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.156030 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:00.158504 19265 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.163087 19263 raft_consensus.cc:359] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.163944 19263 raft_consensus.cc:385] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.164252 19263 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.165223 19263 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.169386 19263 ts_tablet_manager.cc:1434] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:18:00.170279 19263 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.170627 19266 tablet_bootstrap.cc:654] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.183017 19263 tablet_bootstrap.cc:654] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.203898 19261 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.204391 19261 ts_tablet_manager.cc:1403] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.168s	user 0.041s	sys 0.060s
I20260709 13:18:00.214150 19395 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:18:00.226603 18969 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.227950 19261 raft_consensus.cc:359] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.230104 19266 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.230597 19266 ts_tablet_manager.cc:1403] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.004s
I20260709 13:18:00.231652 19263 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.232088 19263 ts_tablet_manager.cc:1403] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.007s
I20260709 13:18:00.229257 19261 raft_consensus.cc:385] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.232839 19261 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.233592 19261 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.236733 19261 ts_tablet_manager.cc:1434] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:18:00.238431 19261 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.240514 19263 raft_consensus.cc:359] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.242177 19263 raft_consensus.cc:385] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.242512 19263 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.243235 19263 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.245260 19263 ts_tablet_manager.cc:1434] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:18:00.246052 19263 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.245842 19384 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.249410 19261 tablet_bootstrap.cc:654] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.249686 19266 raft_consensus.cc:359] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.250350 19266 raft_consensus.cc:385] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.250627 19266 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.251550 19263 tablet_bootstrap.cc:654] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.251361 19266 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.259577 19266 ts_tablet_manager.cc:1434] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:18:00.259442 19302 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.260457 19266 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.269951 19263 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.270520 19263 ts_tablet_manager.cc:1403] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.025s	user 0.001s	sys 0.019s
I20260709 13:18:00.273814 19263 raft_consensus.cc:359] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.274639 19263 raft_consensus.cc:385] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.274768 19069 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.274992 19263 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.276039 19263 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.278899 19263 ts_tablet_manager.cc:1434] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:00.280288 19329 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.280849 19329 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.283538 19329 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.285447 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.279991 19263 tablet_bootstrap.cc:492] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.286064 19147 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.286972 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.288540 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:00.289503 19329 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.289870 19329 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.290257 19329 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.290403 19261 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.290894 19261 ts_tablet_manager.cc:1403] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.000s
I20260709 13:18:00.291738 19263 tablet_bootstrap.cc:654] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.293412 19261 raft_consensus.cc:359] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:00.293798 19184 leader_election.cc:343] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.294097 19261 raft_consensus.cc:385] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.294404 19261 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.295127 19261 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.297394 19261 ts_tablet_manager.cc:1434] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:18:00.298338 19261 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.298488 19274 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.303464 19263 tablet_bootstrap.cc:492] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.303926 19263 ts_tablet_manager.cc:1403] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:18:00.303565 19329 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.306365 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:00.306481 19263 raft_consensus.cc:359] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.307052 19263 raft_consensus.cc:385] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.307337 19263 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
W20260709 13:18:00.307854 19184 leader_election.cc:343] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.307767 19352 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.308177 19263 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.309928 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:00.310362 19261 tablet_bootstrap.cc:654] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.310437 19147 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.310936 19329 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.314240 19329 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.314702 19329 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.317335 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.317937 19072 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.319293 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:00.310436 19263 ts_tablet_manager.cc:1434] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:00.320082 19274 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.320410 19274 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.320542 19263 tablet_bootstrap.cc:492] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.320760 19274 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.327011 19263 tablet_bootstrap.cc:654] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.327690 19274 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.330420 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:00.330972 19072 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.339499 19263 tablet_bootstrap.cc:492] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.339949 19263 ts_tablet_manager.cc:1403] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:18:00.343488 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:00.343824 19263 raft_consensus.cc:359] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.345086 19263 raft_consensus.cc:385] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.345366 19263 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.345978 19263 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.346712 19274 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.327735 19147 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.350368 19302 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.348356 19072 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.350972 19302 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.352538 19329 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.358063 19302 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.358294 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:00.359815 19113 leader_election.cc:343] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.370426 19290 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.383526 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:00.385108 19110 leader_election.cc:343] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.385586 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.386710 19302 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:00.407539 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 64809.6us
I20260709 13:18:00.413830 19266 tablet_bootstrap.cc:654] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.415488 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.416978 19274 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.417467 19274 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:00.419117 19184 leader_election.cc:343] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.419373 19274 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.420441 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.421556 19274 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.422225 19274 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:00.423552 19274 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.427119 19261 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.427560 19261 ts_tablet_manager.cc:1403] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.129s	user 0.028s	sys 0.045s
I20260709 13:18:00.429648 19294 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.430094 19261 raft_consensus.cc:359] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.430785 19261 raft_consensus.cc:385] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.431025 19261 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
W20260709 13:18:00.431768 19184 leader_election.cc:343] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.433087 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:00.433455 19263 ts_tablet_manager.cc:1434] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.093s	user 0.026s	sys 0.055s
I20260709 13:18:00.433619 19261 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.434450 19263 tablet_bootstrap.cc:492] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.434983 19410 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.435457 19410 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:00.436287 19410 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.439991 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.440636 19070 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.439407 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.442240 19145 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.442947 19261 ts_tablet_manager.cc:1434] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:18:00.443156 19294 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.443823 19261 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.443747 19294 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.446318 19294 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.454804 19266 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.455387 19266 ts_tablet_manager.cc:1403] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.195s	user 0.010s	sys 0.000s
I20260709 13:18:00.465186 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.470009 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.472267 19302 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.472296 19266 raft_consensus.cc:359] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.473039 19266 raft_consensus.cc:385] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.473320 19266 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.474157 19266 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.475596 19266 ts_tablet_manager.cc:1434] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:18:00.476390 19266 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.463367 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:00.481035 19274 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.481397 19274 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.481734 19274 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.482115 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.482903 19410 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.491046 19266 tablet_bootstrap.cc:654] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.496361 19263 tablet_bootstrap.cc:654] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.496435 19261 tablet_bootstrap.cc:654] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.496206 18969 catalog_manager.cc:5697] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.498991 18969 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.517143 19274 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.519135 19274 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.521903 19263 tablet_bootstrap.cc:492] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.522406 19263 ts_tablet_manager.cc:1403] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.008s
I20260709 13:18:00.525799 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:00.525434 19263 raft_consensus.cc:359] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.526412 19263 raft_consensus.cc:385] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.526675 19263 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.529009 19072 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.535291 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:00.535854 19145 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.536779 19263 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.542112 19221 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.543488 19072 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.544644 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:00.549849 19266 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.550158 19266 ts_tablet_manager.cc:1403] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.009s
I20260709 13:18:00.551551 19274 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.552040 19263 ts_tablet_manager.cc:1434] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:18:00.553038 19263 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.552306 19274 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:00.558035 19274 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.560137 19266 raft_consensus.cc:359] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.560173 19395 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.560645 19266 raft_consensus.cc:385] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.560950 19266 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.561534 19266 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.563519 19266 ts_tablet_manager.cc:1434] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:18:00.563616 19265 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.564390 19266 tablet_bootstrap.cc:492] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.564083 19265 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.566558 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.567297 19146 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:00.568687 19145 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.569231 19265 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.570287 19261 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.570706 19261 ts_tablet_manager.cc:1403] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.012s
I20260709 13:18:00.576696 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:00.581238 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:00.582860 19265 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.592519 19395 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.583950 19266 tablet_bootstrap.cc:654] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.584147 19263 tablet_bootstrap.cc:654] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.599992 19265 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.601600 19261 raft_consensus.cc:359] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.602094 19261 raft_consensus.cc:385] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.602320 19261 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.602926 19261 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.610301 19261 ts_tablet_manager.cc:1434] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 13:18:00.611135 19261 tablet_bootstrap.cc:492] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.619738 18969 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:00.620970 19110 consensus_peers.cc:597] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.624854 19261 tablet_bootstrap.cc:654] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.633309 19266 tablet_bootstrap.cc:492] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.642232 19266 ts_tablet_manager.cc:1403] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.000s
I20260709 13:18:00.626240 19263 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.644642 19266 raft_consensus.cc:359] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.645231 19266 raft_consensus.cc:385] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.645339 19263 ts_tablet_manager.cc:1403] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.003s
I20260709 13:18:00.645498 19266 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.646189 19266 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.648026 19266 ts_tablet_manager.cc:1434] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:00.647779 19263 raft_consensus.cc:359] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.648420 19263 raft_consensus.cc:385] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.648677 19263 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.648825 19266 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.649456 19263 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.651335 19263 ts_tablet_manager.cc:1434] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:00.652267 19263 tablet_bootstrap.cc:492] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.658170 19263 tablet_bootstrap.cc:654] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.661216 19266 tablet_bootstrap.cc:654] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.662158 19261 tablet_bootstrap.cc:492] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.662647 19261 ts_tablet_manager.cc:1403] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.009s
I20260709 13:18:00.663554 19410 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.663992 19410 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.665521 19261 raft_consensus.cc:359] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.666169 19410 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.666308 19261 raft_consensus.cc:385] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.666811 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.667178 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.667486 19072 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.667688 19147 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.668391 19266 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.668834 19266 ts_tablet_manager.cc:1403] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:18:00.668677 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:00.669438 19410 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.669673 19263 tablet_bootstrap.cc:492] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.669783 19410 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.666816 19261 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.670126 19263 ts_tablet_manager.cc:1403] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 13:18:00.670323 19410 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.670737 19261 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.672799 19261 ts_tablet_manager.cc:1434] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:18:00.672555 19263 raft_consensus.cc:359] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.674228 19263 raft_consensus.cc:385] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.674502 19263 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.675100 19263 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.675598 19261 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.677096 19263 ts_tablet_manager.cc:1434] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:00.681712 19410 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.684095 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:00.684650 19072 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.684793 19263 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.690408 19261 tablet_bootstrap.cc:654] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.690408 19263 tablet_bootstrap.cc:654] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.692314 19265 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.693027 19072 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.692762 19265 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.694767 19265 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.695763 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:00.695935 19266 raft_consensus.cc:359] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.696395 19217 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:00.696540 19266 raft_consensus.cc:385] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.697028 19266 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.697962 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.698045 19266 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.695763 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:00.700237 19294 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.700893 19294 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:00.701939 19294 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.703541 19410 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.705017 19266 ts_tablet_manager.cc:1434] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
W20260709 13:18:00.705364 19035 leader_election.cc:343] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.706138 19266 tablet_bootstrap.cc:492] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.705893 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:00.707175 19265 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.707506 19265 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.707828 19265 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.710690 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:00.711380 19147 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.712306 19266 tablet_bootstrap.cc:654] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.723042 19266 tablet_bootstrap.cc:492] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.723532 19266 ts_tablet_manager.cc:1403] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.011s
I20260709 13:18:00.723733 19147 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.724371 19265 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.726213 19263 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.726639 19263 ts_tablet_manager.cc:1403] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:18:00.726373 19266 raft_consensus.cc:359] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.727150 19266 raft_consensus.cc:385] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.727474 19266 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.728354 19266 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.728629 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:00.730026 19266 ts_tablet_manager.cc:1434] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:18:00.730213 19035 leader_election.cc:343] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.731108 19266 tablet_bootstrap.cc:492] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.732110 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:00.732645 19217 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.737567 19266 tablet_bootstrap.cc:654] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.739763 19217 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:00.741282 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:00.742383 19290 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.742972 19290 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:00.744004 19290 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.748661 19266 tablet_bootstrap.cc:492] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.748916 19265 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.749269 19266 ts_tablet_manager.cc:1403] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:18:00.752496 19263 raft_consensus.cc:359] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.753165 19263 raft_consensus.cc:385] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.753396 19263 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.753960 19263 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.756172 19263 ts_tablet_manager.cc:1434] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:18:00.756438 19266 raft_consensus.cc:359] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.757019 19263 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.757107 19266 raft_consensus.cc:385] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.757596 19266 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.757233 18969 catalog_manager.cc:5697] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.758332 18970 catalog_manager.cc:5697] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.758980 19384 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.759433 19384 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.761545 19384 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.763401 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.763410 19263 tablet_bootstrap.cc:654] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:00.764809 19110 leader_election.cc:343] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.765018 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:00.766291 19113 leader_election.cc:343] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.766748 19261 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.766712 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.767375 19261 ts_tablet_manager.cc:1403] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.092s	user 0.030s	sys 0.023s
I20260709 13:18:00.768115 19384 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:00.758416 19266 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.770200 19261 raft_consensus.cc:359] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.770869 19261 raft_consensus.cc:385] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.771229 19261 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.771903 19261 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.774283 19261 ts_tablet_manager.cc:1434] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:00.775241 19261 tablet_bootstrap.cc:492] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.770967 19266 ts_tablet_manager.cc:1434] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:18:00.777371 19266 tablet_bootstrap.cc:492] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.782691 19266 tablet_bootstrap.cc:654] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.788727 19261 tablet_bootstrap.cc:654] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.806159 19261 tablet_bootstrap.cc:492] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.806569 19261 ts_tablet_manager.cc:1403] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.012s
I20260709 13:18:00.806893 19263 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.807356 19263 ts_tablet_manager.cc:1403] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.033s
I20260709 13:18:00.808423 19266 tablet_bootstrap.cc:492] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.808840 19266 ts_tablet_manager.cc:1403] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.010s
I20260709 13:18:00.809566 19261 raft_consensus.cc:359] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.809764 19263 raft_consensus.cc:359] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.810273 19261 raft_consensus.cc:385] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.810452 19263 raft_consensus.cc:385] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.810616 19261 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.810791 19263 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.811539 19261 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.814005 19261 ts_tablet_manager.cc:1434] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:18:00.813998 19266 raft_consensus.cc:359] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.814795 19266 raft_consensus.cc:385] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.815066 19261 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.815053 19266 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.815904 19266 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.817767 19266 ts_tablet_manager.cc:1434] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:00.811496 19263 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.819422 19266 tablet_bootstrap.cc:492] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.824122 19384 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.819463 19263 ts_tablet_manager.cc:1434] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:18:00.821633 19261 tablet_bootstrap.cc:654] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.824733 19384 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.825348 19263 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.825788 19147 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.827514 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:00.829093 19110 leader_election.cc:343] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.831000 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:00.831578 19217 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:00.832767 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.833590 19395 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.833983 19395 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.834331 19395 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.835419 19266 tablet_bootstrap.cc:654] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.833760 19294 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.839895 19294 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.840435 19294 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.838222 19263 tablet_bootstrap.cc:654] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.842680 19294 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.843361 19261 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.843807 19261 ts_tablet_manager.cc:1403] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.010s
I20260709 13:18:00.847078 19261 raft_consensus.cc:359] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.847914 19261 raft_consensus.cc:385] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.847918 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.848536 19261 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.848781 19145 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.849418 19261 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.850557 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:00.850617 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.851419 19070 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:00.851804 19261 ts_tablet_manager.cc:1434] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:00.852707 19261 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:00.853730 19410 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.854102 19410 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.854430 19410 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.856983 19384 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.856503 19395 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.859391 19395 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.859504 19261 tablet_bootstrap.cc:654] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.860385 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:00.861397 19266 tablet_bootstrap.cc:492] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.862280 19266 ts_tablet_manager.cc:1403] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.005s
I20260709 13:18:00.862380 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:00.862924 19217 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.865254 19266 raft_consensus.cc:359] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.865860 19266 raft_consensus.cc:385] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.866082 19266 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.866818 19266 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:00.867245 19110 leader_election.cc:343] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:00.869587 19266 ts_tablet_manager.cc:1434] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:18:00.870432 19266 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.876163 19266 tablet_bootstrap.cc:654] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:00.880465 19263 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:00.881860 19263 ts_tablet_manager.cc:1403] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.004s
I20260709 13:18:00.881497 19274 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:00.885749 19274 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.886439 19410 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.887450 19217 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:00.888415 19410 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:00.888695 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:00.889793 19395 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.890374 19395 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:00.891454 19384 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.891912 19384 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.893838 19384 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.894922 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:00.895387 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:00.895334 19395 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.895752 19070 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:00.896075 19220 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:00.897389 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:00.889863 19266 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:00.898315 19384 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.898825 19266 ts_tablet_manager.cc:1403] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 13:18:00.899017 19384 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.899375 19384 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.900817 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:00.901597 19070 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.910135 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:00.910689 19145 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.909621 19263 raft_consensus.cc:359] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.914108 19263 raft_consensus.cc:385] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.914527 19263 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.919992 19266 raft_consensus.cc:359] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.921005 19263 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.921614 19266 raft_consensus.cc:385] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.922055 19266 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.923806 19266 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.928761 19070 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.938647 19384 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.943451 19410 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.943778 19145 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:00.944020 19263 ts_tablet_manager.cc:1434] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:18:00.945264 19263 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:00.945283 19266 ts_tablet_manager.cc:1434] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:18:00.946274 19266 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:00.948361 19292 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.949542 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:00.949507 19292 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.950279 19072 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.951483 19292 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.953052 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:00.955879 19261 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:00.956328 19261 ts_tablet_manager.cc:1403] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.104s	user 0.046s	sys 0.029s
I20260709 13:18:00.958326 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:00.957202 19410 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:00.958925 19220 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:00.959398 19410 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:00.960198 19410 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.961048 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:00.962324 19290 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:00.962715 19290 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.963048 19290 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.963908 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:00.964473 19217 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:00.956454 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:00.954867 19384 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.979095 19261 raft_consensus.cc:359] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.979596 19261 raft_consensus.cc:385] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:00.979803 19261 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:00.977217 18970 catalog_manager.cc:5697] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.985560 19261 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:00.976541 19145 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:00.997160 19261 ts_tablet_manager.cc:1434] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:18:00.999428 19261 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.006628 19294 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:00.988472 19072 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:01.006685 19384 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.010115 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:01.010949 19395 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.011428 19395 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:01.012238 19395 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.012585 19294 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.014722 19266 tablet_bootstrap.cc:654] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.015323 19384 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.018882 19290 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.021059 19290 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:00.999394 19217 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:01.024240 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:01.024724 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:01.027004 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.027509 19220 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.027915 19221 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:01.029505 19113 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:01.030596 19273 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.031066 19273 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.031486 19273 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.025241 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:01.033118 19384 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.007118 18968 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.033149 19071 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:01.027532 19147 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.037045 19263 tablet_bootstrap.cc:654] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.039726 19299 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.040196 19299 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.040637 19220 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:01.041766 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:01.042302 19299 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.043238 19147 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:01.044055 19290 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.044858 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:01.045161 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.058503 19220 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 1: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:01.060516 19265 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.060422 19110 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:01.061276 19265 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.061976 19299 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.063890 19265 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.082062 19273 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.083169 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.084403 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.085412 19299 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.085520 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:01.086352 19069 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.087720 19035 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:01.088490 19265 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.097043 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:01.097625 19220 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.101059 19273 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.090673 19290 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:01.102038 19071 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.104076 19290 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.108237 19220 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:01.113088 19113 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:01.119953 19302 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.120416 19302 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:01.121249 19302 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.121879 19384 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.122335 19384 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.124490 19384 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.129645 18968 catalog_manager.cc:5697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.133984 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:01.200453 19261 tablet_bootstrap.cc:654] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.211304 19069 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:01.213899 19410 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.214511 19410 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:01.216367 19110 leader_election.cc:343] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.216867 19410 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:01.194689 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 68372.1us
I20260709 13:18:01.223873 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.224505 19145 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:01.220428 19395 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.225572 19395 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.219340 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.229372 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:01.241912 19409 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.245590 19409 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.246031 19409 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.241525 19395 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.258162 19266 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:01.258841 19266 ts_tablet_manager.cc:1403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.313s	user 0.043s	sys 0.086s
I20260709 13:18:01.265211 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:01.284303 19263 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:01.284967 19263 ts_tablet_manager.cc:1403] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.340s	user 0.019s	sys 0.026s
W20260709 13:18:01.291528 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 79533.1us
I20260709 13:18:01.300392 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:01.301728 19263 raft_consensus.cc:359] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.302098 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.302459 19263 raft_consensus.cc:385] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.302744 19263 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.303400 19263 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.304196 19221 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:01.307828 19263 ts_tablet_manager.cc:1434] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:18:01.308507 19263 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:01.310400 19266 raft_consensus.cc:359] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.311084 19266 raft_consensus.cc:385] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.311410 19266 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.314324 19266 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.324920 19266 ts_tablet_manager.cc:1434] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.001s
I20260709 13:18:01.325790 19266 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
W20260709 13:18:01.314039 19113 leader_election.cc:343] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:01.330091 19110 leader_election.cc:343] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:01.331643 19110 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.324105 19184 leader_election.cc:343] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.333513 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:01.339556 19395 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.334837 19409 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.335633 19265 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.343657 19113 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:01.344429 19302 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.344779 19302 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.345134 19302 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.354907 19261 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.355522 19261 ts_tablet_manager.cc:1403] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.357s	user 0.021s	sys 0.005s
W20260709 13:18:01.358279 19457 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:18:01.361173 19294 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:01.361650 19409 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:01.377828 19018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:01.378798 18967 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.386690 18968 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.387528 19302 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.398542 19261 raft_consensus.cc:359] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.399251 19299 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.400506 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:01.403983 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:01.404314 19302 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.404596 19147 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.404527 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:01.405290 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:01.405746 19110 leader_election.cc:343] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.405820 19220 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.402575 19261 raft_consensus.cc:385] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.407970 19261 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.408618 19261 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.410591 19261 ts_tablet_manager.cc:1434] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:18:01.411442 19261 tablet_bootstrap.cc:492] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.414417 19147 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:01.417079 19292 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.434883 19261 tablet_bootstrap.cc:654] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.439740 19408 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.437989 19302 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:01.422200 19220 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:01.445637 19113 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:01.446784 19302 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.447371 19302 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:01.448311 19302 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:01.456276 19184 leader_election.cc:343] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.458547 19266 tablet_bootstrap.cc:654] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.458829 19299 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.465063 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:01.466809 19408 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.469197 19263 tablet_bootstrap.cc:654] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.476092 19408 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:01.479652 19408 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.522753 19292 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:01.529275 19261 tablet_bootstrap.cc:492] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.529851 19261 ts_tablet_manager.cc:1403] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.025s
I20260709 13:18:01.534849 18970 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.535858 19261 raft_consensus.cc:359] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.536494 19261 raft_consensus.cc:385] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.536867 19261 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.537576 19261 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.553146 19384 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:01.578375 19458 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:01.581278 19261 ts_tablet_manager.cc:1434] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.004s
I20260709 13:18:01.582206 19261 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.585230 19263 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:01.585665 19263 ts_tablet_manager.cc:1403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.277s	user 0.016s	sys 0.003s
I20260709 13:18:01.588830 19266 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:01.589268 19266 ts_tablet_manager.cc:1403] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.264s	user 0.011s	sys 0.005s
I20260709 13:18:01.596405 19461 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.596895 19461 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.598441 18968 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.598922 19461 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.600692 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.601792 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.603272 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:01.605389 19452 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.608829 19261 tablet_bootstrap.cc:654] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.611307 19294 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.613929 19294 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.614817 19263 raft_consensus.cc:359] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.615300 19263 raft_consensus.cc:385] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.615543 19263 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.617405 19263 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.628965 19266 raft_consensus.cc:359] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.629606 19266 raft_consensus.cc:385] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.629848 19266 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.630431 19266 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.632244 19266 ts_tablet_manager.cc:1434] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.000s
I20260709 13:18:01.633466 19266 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:01.659915 19263 ts_tablet_manager.cc:1434] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 13:18:01.667621 19263 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:01.677999 19263 tablet_bootstrap.cc:654] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.685871 19266 tablet_bootstrap.cc:654] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.688323 19384 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:01.695663 19070 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.708253 19261 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.708715 19261 ts_tablet_manager.cc:1403] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.008s
I20260709 13:18:01.710372 19266 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:01.711299 19261 raft_consensus.cc:359] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.711796 19266 ts_tablet_manager.cc:1403] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.000s
I20260709 13:18:01.712103 19261 raft_consensus.cc:385] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.712478 19263 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:01.713003 19263 ts_tablet_manager.cc:1403] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.046s	user 0.005s	sys 0.007s
I20260709 13:18:01.715044 19266 raft_consensus.cc:359] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.715929 19266 raft_consensus.cc:385] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.716248 19266 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.712405 19261 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.716447 19263 raft_consensus.cc:359] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.717352 19263 raft_consensus.cc:385] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.717730 19263 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.717358 19261 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.717371 19266 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.719379 19263 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.720726 19266 ts_tablet_manager.cc:1434] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:01.722046 19266 tablet_bootstrap.cc:492] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:01.723461 19261 ts_tablet_manager.cc:1434] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:18:01.724296 19261 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.728108 19263 ts_tablet_manager.cc:1434] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:18:01.729061 19263 tablet_bootstrap.cc:492] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:01.731258 19266 tablet_bootstrap.cc:654] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.736248 19261 tablet_bootstrap.cc:654] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.741077 19263 tablet_bootstrap.cc:654] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.757993 19261 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.758469 19261 ts_tablet_manager.cc:1403] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 13:18:01.761633 19261 raft_consensus.cc:359] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.762392 19261 raft_consensus.cc:385] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.762660 19261 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.764261 19261 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.767517 19263 tablet_bootstrap.cc:492] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:01.767942 19263 ts_tablet_manager.cc:1403] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.015s
I20260709 13:18:01.768060 19266 tablet_bootstrap.cc:492] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:01.768481 19266 ts_tablet_manager.cc:1403] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.013s
I20260709 13:18:01.770412 19263 raft_consensus.cc:359] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.770785 19266 raft_consensus.cc:359] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.771111 19263 raft_consensus.cc:385] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.771435 19266 raft_consensus.cc:385] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.771495 19263 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.771813 19266 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.772362 19263 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.772464 19266 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.774626 19266 ts_tablet_manager.cc:1434] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:01.774744 19261 ts_tablet_manager.cc:1434] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:01.775463 19266 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:01.775633 19261 tablet_bootstrap.cc:492] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.781145 19261 tablet_bootstrap.cc:654] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.781179 19409 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.781749 19266 tablet_bootstrap.cc:654] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.781708 19409 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.783969 19409 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:01.785957 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:01.786315 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.786581 19070 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:01.786970 19261 tablet_bootstrap.cc:492] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.786888 19146 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:01.787424 19261 ts_tablet_manager.cc:1403] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:18:01.787907 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:01.788724 19409 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.789069 19409 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.789377 19409 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.792290 19261 raft_consensus.cc:359] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.792941 19261 raft_consensus.cc:385] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.793202 19261 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.793891 19261 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.796078 19261 ts_tablet_manager.cc:1434] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:01.797251 19261 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.798110 19263 ts_tablet_manager.cc:1434] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:18:01.798964 19263 tablet_bootstrap.cc:492] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:01.799871 19266 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:01.800292 19266 ts_tablet_manager.cc:1403] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:18:01.802285 19266 raft_consensus.cc:359] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.802750 19266 raft_consensus.cc:385] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.802862 19261 tablet_bootstrap.cc:654] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.802987 19266 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.803702 19266 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.804622 19263 tablet_bootstrap.cc:654] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.805485 19266 ts_tablet_manager.cc:1434] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:18:01.806708 19266 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:01.808674 19409 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.811499 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:01.812069 19070 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.816599 19384 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.817091 19384 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.819020 19409 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:01.819552 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:01.820061 19146 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.820495 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.821105 19221 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:01.822436 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:01.823483 19395 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.823926 19395 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.824048 19070 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:01.824399 19395 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.826696 19266 tablet_bootstrap.cc:654] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.830840 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:01.831790 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:01.832916 19458 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.833142 19110 leader_election.cc:343] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.833554 19458 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.818992 19384 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.834069 19409 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.834549 19409 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:01.835341 19409 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.836786 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.837353 19147 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:01.839233 19261 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.839674 19261 ts_tablet_manager.cc:1403] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 13:18:01.842559 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:01.842821 19261 raft_consensus.cc:359] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.844853 19261 raft_consensus.cc:385] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.845170 19461 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.845297 19261 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.845767 19461 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.846230 19461 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.847457 19261 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.843622 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.848819 19221 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:01.851163 19261 ts_tablet_manager.cc:1434] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:18:01.844220 19458 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.852784 19261 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.859938 19261 tablet_bootstrap.cc:654] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.861603 19266 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:01.862042 19266 ts_tablet_manager.cc:1403] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.011s
I20260709 13:18:01.863765 19263 tablet_bootstrap.cc:492] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:01.864190 19263 ts_tablet_manager.cc:1403] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.008s
I20260709 13:18:01.864583 19266 raft_consensus.cc:359] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.865253 19266 raft_consensus.cc:385] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.865507 19266 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.866202 19266 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.866935 19263 raft_consensus.cc:359] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.867779 19263 raft_consensus.cc:385] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.868112 19263 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.868810 19266 ts_tablet_manager.cc:1434] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:18:01.869688 19266 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:01.872417 19263 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.874092 19261 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.874902 19263 ts_tablet_manager.cc:1434] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:01.875720 19263 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:01.876039 19261 ts_tablet_manager.cc:1403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.009s
I20260709 13:18:01.878437 19261 raft_consensus.cc:359] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.879105 19261 raft_consensus.cc:385] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.879401 19261 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.880710 19261 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.881862 19263 tablet_bootstrap.cc:654] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.882329 19146 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:01.882507 19395 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.887323 19395 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.883994 19261 ts_tablet_manager.cc:1434] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:18:01.888419 19261 tablet_bootstrap.cc:492] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.883615 18967 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.895370 19452 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.895802 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:01.896381 19068 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.896623 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:01.897280 19221 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.895808 19452 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.899947 19263 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:01.900413 19263 ts_tablet_manager.cc:1403] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:18:01.901316 19452 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.903143 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.902940 19263 raft_consensus.cc:359] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.903613 19263 raft_consensus.cc:385] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.903867 19263 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.904565 19263 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:01.905809 19038 leader_election.cc:343] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.907483 19261 tablet_bootstrap.cc:654] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.907557 19221 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:01.908061 19263 ts_tablet_manager.cc:1434] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:18:01.908794 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:01.909013 19263 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:01.906752 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.911243 19146 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:01.915056 19263 tablet_bootstrap.cc:654] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.915198 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:01.914065 19068 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:01.914510 19395 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.916291 19395 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:01.916493 19452 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:01.916867 19452 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.917196 19452 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.917150 19395 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.876732 19266 tablet_bootstrap.cc:654] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.885212 19461 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.923565 19452 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.927515 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:01.927809 19461 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.928196 19146 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.930588 19263 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:01.931015 19263 ts_tablet_manager.cc:1403] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:18:01.931694 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:01.932353 19221 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.931645 18967 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.933426 19263 raft_consensus.cc:359] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.934540 19461 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.934973 19461 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.936542 19458 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.937009 19458 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.937928 19461 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.934034 19263 raft_consensus.cc:385] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.938634 19263 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.938567 19480 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:01.938962 19458 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.939230 19261 tablet_bootstrap.cc:492] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:01.939646 19261 ts_tablet_manager.cc:1403] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:18:01.939467 19263 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.941732 19263 ts_tablet_manager.cc:1434] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:01.942165 19261 raft_consensus.cc:359] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.942564 19263 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:01.942636 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.943923 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:01.944733 19218 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:01.946794 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.949390 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:01.949535 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:01.950693 19461 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.954938 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:01.955322 19263 tablet_bootstrap.cc:654] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:01.956312 19038 leader_election.cc:343] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:01.956949 19452 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:01.942889 19261 raft_consensus.cc:385] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.957551 19261 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.957834 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:01.958385 19144 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.958930 19221 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:01.960132 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:01.955302 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:01.961076 19452 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.961611 19452 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:01.961993 19461 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.962496 19452 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.958391 19261 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:01.965963 19261 ts_tablet_manager.cc:1434] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:18:01.966895 19261 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:01.971346 19461 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:01.975598 19068 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.977077 19261 tablet_bootstrap.cc:654] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.000649 19410 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:02.010176 19146 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:01.975576 19144 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:02.015956 19261 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:02.015982 19263 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:02.016702 19263 ts_tablet_manager.cc:1403] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.074s	user 0.029s	sys 0.018s
I20260709 13:18:02.016667 19261 ts_tablet_manager.cc:1403] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.050s	user 0.003s	sys 0.017s
I20260709 13:18:02.015301 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:02.020869 19461 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.021512 19461 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:02.021570 19261 raft_consensus.cc:359] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.022363 19261 raft_consensus.cc:385] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.022676 19261 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.020020 19263 raft_consensus.cc:359] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.022514 19461 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.023936 19261 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.025769 19266 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:02.026279 19266 ts_tablet_manager.cc:1403] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.157s	user 0.008s	sys 0.005s
I20260709 13:18:02.026398 19261 ts_tablet_manager.cc:1434] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:02.028216 19261 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:02.033104 19458 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.033577 19458 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.035655 19458 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.036286 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.036700 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:02.043497 19263 raft_consensus.cc:385] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.043450 19221 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:02.040463 19261 tablet_bootstrap.cc:654] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.043915 19263 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.044834 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:02.044626 19263 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.045770 19146 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:02.047134 19263 ts_tablet_manager.cc:1434] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:18:02.055212 19263 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:02.049242 19510 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.056389 19395 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.056658 19510 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.057085 19510 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.056834 19395 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.058887 19395 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.059042 18970 catalog_manager.cc:5697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.060449 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:02.061158 19263 tablet_bootstrap.cc:654] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.061081 19221 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:02.063100 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:02.063833 19395 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.064180 19395 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.064095 19510 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.064594 19395 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.068249 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:02.068899 19069 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:02.069218 19510 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.069159 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:02.069804 19221 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.069792 19384 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.072351 19395 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.075661 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:02.076222 19069 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.077346 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:02.077919 19144 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.079360 19221 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:02.083191 19273 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.083935 19395 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.086247 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:02.086793 19218 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.086728 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:02.088079 19461 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.088546 19461 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:02.089339 19461 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.031672 19266 raft_consensus.cc:359] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.097272 19218 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:02.107293 19266 raft_consensus.cc:385] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.108124 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:02.109023 19395 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.109704 19395 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:02.110489 19395 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.114475 19069 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:02.108124 19266 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.115844 19266 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.117817 19266 ts_tablet_manager.cc:1434] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.091s	user 0.002s	sys 0.003s
I20260709 13:18:02.118661 19266 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:02.124821 19263 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:02.125288 19263 ts_tablet_manager.cc:1403] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.021s
I20260709 13:18:02.127733 19263 raft_consensus.cc:359] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.128347 19263 raft_consensus.cc:385] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.128614 19263 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.135941 19273 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.136644 19266 tablet_bootstrap.cc:654] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.132395 19263 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.136435 19273 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.138885 19263 ts_tablet_manager.cc:1434] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 13:18:02.139590 19273 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.139812 19263 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:02.141412 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:02.141659 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:02.142980 19110 leader_election.cc:343] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.143837 19480 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.144315 19480 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.146399 19263 tablet_bootstrap.cc:654] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.146499 19480 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:02.147171 19113 leader_election.cc:343] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.147822 19113 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.148303 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.148949 19146 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:02.149608 19273 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.150806 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:02.152817 19410 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.153380 19410 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.153836 19410 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.155252 19266 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:02.155706 19266 ts_tablet_manager.cc:1403] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:18:02.158174 19266 raft_consensus.cc:359] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.158789 19266 raft_consensus.cc:385] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.159030 19266 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.159649 19266 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.162722 19266 ts_tablet_manager.cc:1434] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:02.163611 19266 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:02.165958 19410 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.168675 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:02.170023 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:02.173205 19184 leader_election.cc:343] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:02.174218 19184 leader_election.cc:343] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:02.179661 19516 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:02.186698 19266 tablet_bootstrap.cc:654] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.192800 19263 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:02.193248 19263 ts_tablet_manager.cc:1403] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.002s
I20260709 13:18:02.194446 19144 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:02.195894 19410 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.195923 19263 raft_consensus.cc:359] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.196971 19263 raft_consensus.cc:385] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.197000 19261 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:02.197369 19263 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.197835 19261 ts_tablet_manager.cc:1403] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.170s	user 0.047s	sys 0.062s
I20260709 13:18:02.195182 18968 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.198167 19263 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.200201 19263 ts_tablet_manager.cc:1434] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:02.200804 19261 raft_consensus.cc:359] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.201548 19261 raft_consensus.cc:385] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.201867 19261 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.202491 19263 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:02.202483 19261 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.204289 19410 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.204769 19410 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.205439 19261 ts_tablet_manager.cc:1434] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:02.206404 19261 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:02.207566 19266 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:02.207482 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:02.208050 19266 ts_tablet_manager.cc:1403] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
W20260709 13:18:02.210160 19184 leader_election.cc:343] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.211127 19266 raft_consensus.cc:359] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.211813 19266 raft_consensus.cc:385] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.212105 19410 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.212112 19266 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.213213 19261 tablet_bootstrap.cc:654] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.213979 19266 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.216223 19266 ts_tablet_manager.cc:1434] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:02.217356 19266 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:02.217901 19263 tablet_bootstrap.cc:654] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.224120 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.225025 19146 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:02.226399 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.227372 19410 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.227735 19410 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.228063 19410 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.230463 19266 tablet_bootstrap.cc:654] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.234499 19410 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.236963 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:02.238188 19184 leader_election.cc:343] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.240401 19410 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.243427 19263 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:02.243685 19266 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:02.243839 19263 ts_tablet_manager.cc:1403] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.009s
I20260709 13:18:02.244302 19266 ts_tablet_manager.cc:1403] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 13:18:02.246351 19263 raft_consensus.cc:359] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.246991 19263 raft_consensus.cc:385] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.247255 19263 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.247640 19266 raft_consensus.cc:359] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.247887 19263 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.248485 19266 raft_consensus.cc:385] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.248862 19266 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.249699 19266 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.250320 19263 ts_tablet_manager.cc:1434] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:18:02.250571 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:02.251109 19146 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.251283 19263 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:02.253353 19266 ts_tablet_manager.cc:1434] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:18:02.254503 19266 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:02.258832 19263 tablet_bootstrap.cc:654] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.261724 19266 tablet_bootstrap.cc:654] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.269619 19263 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:02.270030 19263 ts_tablet_manager.cc:1403] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 13:18:02.274220 19410 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.272521 19263 raft_consensus.cc:359] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.276975 19263 raft_consensus.cc:385] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.278451 19263 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.279002 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:02.279561 19144 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.279328 19263 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.281744 19263 ts_tablet_manager.cc:1434] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:18:02.282675 19263 tablet_bootstrap.cc:492] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:02.288552 19302 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.289165 19302 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.292572 19302 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.293658 19263 tablet_bootstrap.cc:654] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.294471 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:02.295885 19110 leader_election.cc:343] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.295687 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:02.297341 19113 leader_election.cc:343] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.297765 19113 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.298522 19395 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.311302 19146 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:02.312649 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.313673 19266 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:02.314246 19266 ts_tablet_manager.cc:1403] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.007s
I20260709 13:18:02.314145 19410 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.315145 19410 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:02.316224 19410 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.322875 19266 raft_consensus.cc:359] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.323750 19266 raft_consensus.cc:385] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.324079 19266 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.326565 19266 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.328574 19409 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:02.333096 19395 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.333578 19395 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.335003 19266 ts_tablet_manager.cc:1434] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:18:02.336668 19266 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:02.336915 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:02.337556 19218 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:02.339043 19113 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:02.339828 19302 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.339917 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:02.340230 19302 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.340593 19302 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:02.341133 19110 leader_election.cc:343] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.344583 19266 tablet_bootstrap.cc:654] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.346187 19395 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.353389 19302 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.356513 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:02.357957 19110 leader_election.cc:343] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.359997 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:02.360399 19266 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:02.360576 19218 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.360998 19266 ts_tablet_manager.cc:1403] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.012s
I20260709 13:18:02.365074 19266 raft_consensus.cc:359] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.365916 19266 raft_consensus.cc:385] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.366261 19266 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.367480 19395 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.368063 19395 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.370795 19395 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.371762 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:02.372289 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:02.373255 19113 leader_election.cc:343] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.375100 19218 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:02.376284 19113 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.377235 19395 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.377916 19395 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:02.378786 19395 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.371652 19266 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:02.379899 19110 leader_election.cc:343] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.380676 19302 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.303975 18967 catalog_manager.cc:5697] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.380816 19110 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.381634 19266 ts_tablet_manager.cc:1434] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:18:02.382666 19266 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:02.382159 19273 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.383919 18967 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.390301 19478 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.392375 19478 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.394842 19478 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.397166 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:02.398600 19184 leader_election.cc:343] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.384934 19144 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:02.399926 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.400998 19478 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:02.402120 19478 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:02.402978 19478 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.414122 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:02.415385 19184 leader_election.cc:343] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.416589 19184 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.415812 19509 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.423518 19263 tablet_bootstrap.cc:492] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:02.424523 19263 ts_tablet_manager.cc:1403] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.142s	user 0.025s	sys 0.019s
I20260709 13:18:02.424291 19410 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.425750 19509 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.430235 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.430948 19146 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:02.437831 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:02.438442 19266 tablet_bootstrap.cc:654] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.439757 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:02.440565 19292 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.444268 19273 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.439548 19509 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.451786 19261 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:02.452261 19261 ts_tablet_manager.cc:1403] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.246s	user 0.059s	sys 0.105s
I20260709 13:18:02.452442 19292 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.459406 19261 raft_consensus.cc:359] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.460050 19261 raft_consensus.cc:385] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.460330 19261 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.462652 19261 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.464619 19261 ts_tablet_manager.cc:1434] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:18:02.465488 19261 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:02.473618 19409 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.474100 19409 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.475265 19263 raft_consensus.cc:359] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.475988 19409 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.475970 19263 raft_consensus.cc:385] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.479866 19263 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.481575 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:02.487118 19261 tablet_bootstrap.cc:654] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.486791 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.485069 19263 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.500433 19218 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.500995 19146 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 1: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:02.506640 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.507784 19292 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.508247 19292 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.510872 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.511888 19480 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:02.512413 19035 leader_election.cc:343] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.514070 19263 ts_tablet_manager.cc:1434] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.001s
I20260709 13:18:02.514750 19263 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:02.515843 19509 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.520180 19292 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.523365 19395 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:02.530978 18969 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.533912 19292 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.540565 19266 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:02.541085 19266 ts_tablet_manager.cc:1403] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.159s	user 0.017s	sys 0.026s
I20260709 13:18:02.560021 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:02.563599 19395 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:02.565047 19509 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:02.558708 19266 raft_consensus.cc:359] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.545281 19292 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:02.566530 19266 raft_consensus.cc:385] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.567811 19266 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.571179 19266 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:02.566406 19018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:02.574759 19292 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:02.578593 19038 leader_election.cc:343] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.579083 19038 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:02.580371 19266 ts_tablet_manager.cc:1434] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:18:02.581074 19509 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.581820 19410 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.583650 19266 tablet_bootstrap.cc:492] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:02.582309 19410 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.593298 19409 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.607169 19410 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.607914 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:02.593823 19409 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.609154 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.609930 19144 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:02.610972 19409 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.612828 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:02.618548 19263 tablet_bootstrap.cc:654] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.612315 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:02.621834 19410 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.630122 19261 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
W20260709 13:18:02.630256 19184 leader_election.cc:343] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.630851 19261 ts_tablet_manager.cc:1403] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.007s
I20260709 13:18:02.627516 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:02.632395 19410 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.640763 19410 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:02.645077 19184 leader_election.cc:343] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.651615 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:02.650882 19261 raft_consensus.cc:359] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.653033 19261 raft_consensus.cc:385] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.653460 19261 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.654076 19261 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.657104 19261 ts_tablet_manager.cc:1434] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:18:02.658490 19266 tablet_bootstrap.cc:654] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.655447 19480 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.667603 19261 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:02.672441 19273 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:02.673903 19184 leader_election.cc:343] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.699453 19263 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:02.699940 19263 ts_tablet_manager.cc:1403] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.185s	user 0.008s	sys 0.010s
I20260709 13:18:02.709376 19395 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.723750 19458 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260709 13:18:02.792126 19395 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.907104 19461 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.912146 19461 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:02.928265 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 224502us
I20260709 13:18:02.966405 19410 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.971244 19070 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.972395 19461 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:02.808565 18969 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.986805 18969 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:02.988373 19261 tablet_bootstrap.cc:654] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.968413 19263 raft_consensus.cc:359] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:02.989283 19263 raft_consensus.cc:385] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.968441 19410 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:02.989580 19263 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.009239 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:03.009842 19147 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.008922 19263 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:02.987587 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 81935.7us
I20260709 13:18:03.032761 19147 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:03.041914 19302 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.042501 19302 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.044523 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:03.045442 19302 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:03.052904 19266 tablet_bootstrap.cc:492] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:03.053551 19266 ts_tablet_manager.cc:1403] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.470s	user 0.014s	sys 0.013s
I20260709 13:18:03.029768 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:03.073709 19263 ts_tablet_manager.cc:1434] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.373s	user 0.030s	sys 0.025s
I20260709 13:18:03.096998 19263 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:03.104612 19395 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:03.071832 19252 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.17.139.62:35345, user_credentials={real_user=slave}} blocked reactor thread for 267825us
I20260709 13:18:03.128090 19266 raft_consensus.cc:359] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.129128 19266 raft_consensus.cc:385] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.129424 19266 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.130125 19266 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:03.133549 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 63966.5us
I20260709 13:18:03.139297 19266 ts_tablet_manager.cc:1434] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:18:03.141985 19266 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:03.122381 19548 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:18:03.144469 19549 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:03.150454 19184 leader_election.cc:343] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.150609 19549 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.152555 19549 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:03.157789 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:03.160100 19261 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:03.160537 19261 ts_tablet_manager.cc:1403] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.493s	user 0.055s	sys 0.041s
I20260709 13:18:03.162429 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:03.163038 19218 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:03.164214 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:03.168251 19261 raft_consensus.cc:359] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.171104 19261 raft_consensus.cc:385] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.171393 19261 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.172036 19261 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.173547 19261 ts_tablet_manager.cc:1434] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:18:03.174015 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:03.174427 19261 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:03.174746 19147 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:03.179478 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:03.182102 19478 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.182533 19478 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:03.183020 19299 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:03.183326 19478 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.185506 19480 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:03.188822 19545 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:18:03.193773 19113 leader_election.cc:343] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.225368 19546 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.241814 19035 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:03.276573 19266 tablet_bootstrap.cc:654] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.237949 19545 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
W20260709 13:18:03.338498 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69968.4us
I20260709 13:18:03.342407 19560 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.261603 19546 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.342937 19560 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.340163 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:03.380635 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 43886us
I20260709 13:18:03.384491 19556 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.384927 19556 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.385267 19556 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.386191 19261 tablet_bootstrap.cc:654] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.382416 19550 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.394299 19546 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:03.399752 19113 leader_election.cc:343] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:03.419032 19559 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.088s	user 0.004s	sys 0.009s
W20260709 13:18:03.425264 19558 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:18:03.433121 19560 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:03.431478 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 160692us
I20260709 13:18:03.432619 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:03.469376 19263 tablet_bootstrap.cc:654] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:03.491513 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 145280us
I20260709 13:18:03.518898 19261 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:03.519398 19261 ts_tablet_manager.cc:1403] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.345s	user 0.007s	sys 0.026s
I20260709 13:18:03.521552 19266 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:03.521994 19266 ts_tablet_manager.cc:1403] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.380s	user 0.034s	sys 0.013s
I20260709 13:18:03.527788 19266 raft_consensus.cc:359] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.528455 19266 raft_consensus.cc:385] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.528716 19266 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.529768 19266 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.583720 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:03.585768 19141 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:03.587393 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:03.588548 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:03.629710 19110 leader_election.cc:343] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.630451 19110 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:03.633275 19566 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.634464 19266 ts_tablet_manager.cc:1434] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.000s
I20260709 13:18:03.531780 19556 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.660221 19556 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:03.665158 19266 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:03.666011 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:03.670266 19544 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.062s	user 0.003s	sys 0.007s
I20260709 13:18:03.672185 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:03.668597 18969 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60514 (request call id 68) took 1023 ms. Trace:
I20260709 13:18:03.686394 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:03.687492 19216 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:03.696059 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:03.696920 19038 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:03.698966 19509 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.699398 19509 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.699805 19509 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:03.703465 19110 consensus_peers.cc:597] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:03.711470 19110 leader_election.cc:343] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.712069 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:03.713992 19110 leader_election.cc:343] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.716008 19273 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.677728 18969 rpcz_store.cc:276] 0709 13:18:02.645641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.645820 (+   179us) service_pool.cc:224] Handling call
0709 13:18:03.668411 (+1022591us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:03.015196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:03.015744 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:03.015789 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:18:03.015802 (+    13us) tablet.cc:662] Decoding operations
0709 13:18:03.016204 (+   402us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:03.016271 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:03.016299 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:03.046788 (+ 30489us) tablet.cc:701] Row locks acquired
0709 13:18:03.049687 (+  2899us) write_op.cc:260] PREPARE: finished
0709 13:18:03.057095 (+  7408us) write_op.cc:270] Start()
0709 13:18:03.071558 (+ 14463us) write_op.cc:276] Timestamp: P: 1783603083056210 usec, L: 0
0709 13:18:03.071594 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:18:03.139687 (+ 68093us) log.cc:844] Serialized 922 byte log entry
0709 13:18:03.289843 (+150156us) op_driver.cc:464] REPLICATION: finished
0709 13:18:03.427896 (+138053us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f61004800ac 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f6106fc0ef0
0709 13:18:03.502011 (+ 74115us) write_op.cc:301] APPLY: starting
0709 13:18:03.504810 (+  2799us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:03.509155 (+  4345us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:03.509648 (+   493us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:03.520202 (+ 10554us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:03.530256 (+ 10054us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:03.530744 (+   488us) write_op.cc:312] APPLY: finished
0709 13:18:03.531484 (+   740us) log.cc:844] Serialized 28 byte log entry
0709 13:18:03.531659 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.531747 (+    88us) write_op.cc:454] Released schema lock
0709 13:18:03.531791 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:03.532165 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.532216 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41934,"reported_tablets":6,"spinlock_wait_cycles":115200,"child_traces":[["op",{"apply.queue_time_us":154521,"apply.run_cpu_time_us":2066,"apply.run_wall_time_us":37856,"num_ops":2,"prepare.queue_time_us":3611,"prepare.run_cpu_time_us":3502,"prepare.run_wall_time_us":132378,"replication_time_us":215004,"spinlock_wait_cycles":7661952,"thread_start_us":112520,"threads_started":1}]]}
W20260709 13:18:03.723963 19110 leader_election.cc:343] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.724313 19261 raft_consensus.cc:359] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.725764 19261 raft_consensus.cc:385] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.726280 19261 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.727305 19261 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:03.733604 19035 leader_election.cc:343] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.758193 19509 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.759449 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:03.760113 19266 tablet_bootstrap.cc:654] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.760178 19218 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.763492 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:03.764916 19035 leader_election.cc:343] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.769858 19509 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:03.777848 19263 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:03.778515 19263 ts_tablet_manager.cc:1403] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.682s	user 0.037s	sys 0.026s
I20260709 13:18:03.794199 19263 raft_consensus.cc:359] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.794921 19263 raft_consensus.cc:385] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.795168 19263 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.795075 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:03.795842 19215 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.796005 19263 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.805907 19218 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:03.842728 19215 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:03.844637 19038 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:03.847910 19263 ts_tablet_manager.cc:1434] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:18:03.849285 19263 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:03.853096 19509 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.853750 19509 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:03.854732 19509 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:03.858023 19184 leader_election.cc:343] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:03.865481 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54824.8us
I20260709 13:18:03.865875 19261 ts_tablet_manager.cc:1434] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.346s	user 0.011s	sys 0.007s
I20260709 13:18:03.867077 19261 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:03.868443 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:03.872332 19266 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
W20260709 13:18:03.872401 19184 consensus_peers.cc:597] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:03.872852 19266 ts_tablet_manager.cc:1403] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.218s	user 0.004s	sys 0.014s
I20260709 13:18:03.874158 19549 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.875670 19549 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:03.877032 19549 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.882243 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:03.885360 19263 tablet_bootstrap.cc:654] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.885588 19561 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.885938 19561 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.886276 19561 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.877135 19266 raft_consensus.cc:359] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.888373 19266 raft_consensus.cc:385] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.888701 19266 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.889539 19266 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.891734 19266 ts_tablet_manager.cc:1434] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:18:03.892818 19266 tablet_bootstrap.cc:492] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:03.894990 19561 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.882247 19261 tablet_bootstrap.cc:654] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.901245 18969 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.903455 19561 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:03.911084 19266 tablet_bootstrap.cc:654] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.911345 19263 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
W20260709 13:18:03.912240 19018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:03.911751 19263 ts_tablet_manager.cc:1403] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.006s
I20260709 13:18:03.921813 18968 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.922501 19263 raft_consensus.cc:359] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.923192 19263 raft_consensus.cc:385] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.923462 19263 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.924594 19263 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.937311 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:03.938640 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:03.939254 19140 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.942057 18967 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.948472 19545 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:03.950269 19261 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:03.950711 19261 ts_tablet_manager.cc:1403] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.008s
I20260709 13:18:03.953889 19263 ts_tablet_manager.cc:1434] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:18:03.954885 19263 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:03.958853 19140 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:03.963155 19261 raft_consensus.cc:359] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.968200 19261 raft_consensus.cc:385] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.968608 19261 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.969385 19261 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.966375 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:03.974814 19547 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.975329 19547 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:03.975598 19184 leader_election.cc:343] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.976275 19547 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.979290 19261 ts_tablet_manager.cc:1434] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:18:03.982950 19261 tablet_bootstrap.cc:492] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:03.987819 19263 tablet_bootstrap.cc:654] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.990483 19261 tablet_bootstrap.cc:654] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.990852 19549 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.991304 19549 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:03.993407 19549 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:03.994853 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:03.996584 19113 leader_election.cc:343] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.997769 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:03.998482 19071 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:03.999770 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:04.000919 19266 tablet_bootstrap.cc:492] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:04.000869 19549 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.001464 19549 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.001631 19266 ts_tablet_manager.cc:1403] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.008s
I20260709 13:18:04.002048 19549 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.006430 19266 raft_consensus.cc:359] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.007395 19266 raft_consensus.cc:385] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.007733 19266 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.009222 19266 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.012223 19266 ts_tablet_manager.cc:1434] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:04.022374 19266 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:04.028640 19549 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.032575 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:04.032667 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:04.033245 19071 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.032289 19549 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:04.037195 19113 leader_election.cc:343] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.047602 19071 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:04.048689 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:04.049927 19549 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.052304 19549 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:04.051589 19263 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.053215 19292 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.051694 19261 tablet_bootstrap.cc:492] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:04.054018 19261 ts_tablet_manager.cc:1403] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.030s
I20260709 13:18:04.053769 19292 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.057412 19560 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.053373 19549 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.057817 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.057909 19560 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.060062 19560 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.059571 18968 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.057597 19261 raft_consensus.cc:359] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.061043 19273 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.061414 19261 raft_consensus.cc:385] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.061784 19261 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.062614 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.062500 19261 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.061514 19273 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.063244 19063 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:04.066367 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:04.066566 19273 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.066941 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:04.064184 19292 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.068589 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.068970 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:04.070402 19261 ts_tablet_manager.cc:1434] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:18:04.073900 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:04.074931 19218 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 1: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:04.076251 19261 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:04.076582 19113 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.077438 19273 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.077586 19509 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.053304 19263 ts_tablet_manager.cc:1403] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.005s
I20260709 13:18:04.086062 19273 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.060207 19266 tablet_bootstrap.cc:654] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.064419 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.067987 19561 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.089491 19561 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.089906 19561 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:04.090682 19184 leader_election.cc:343] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.097155 19561 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.099264 19561 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.099967 19261 tablet_bootstrap.cc:654] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.101169 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:04.102949 19184 leader_election.cc:343] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.105392 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:04.105981 19071 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.083393 19263 raft_consensus.cc:359] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.109170 19263 raft_consensus.cc:385] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.109477 19263 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.110175 19263 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.112394 19263 ts_tablet_manager.cc:1434] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.000s
I20260709 13:18:04.115722 19261 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:04.116207 19261 ts_tablet_manager.cc:1403] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.006s
I20260709 13:18:04.116417 19266 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:04.116851 19266 ts_tablet_manager.cc:1403] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.004s
I20260709 13:18:04.119150 19261 raft_consensus.cc:359] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.120025 19266 raft_consensus.cc:359] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.120345 19263 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:04.120721 19266 raft_consensus.cc:385] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.121582 19266 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.122354 19266 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.123121 19261 raft_consensus.cc:385] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.123490 19261 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.126853 19261 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.127978 18970 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.134423 19261 ts_tablet_manager.cc:1434] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:18:04.138706 19261 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:04.137636 19263 tablet_bootstrap.cc:654] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.145503 19266 ts_tablet_manager.cc:1434] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 13:18:04.146610 19266 tablet_bootstrap.cc:492] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:04.151396 19261 tablet_bootstrap.cc:654] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.159018 19063 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.161192 19263 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.161711 19263 ts_tablet_manager.cc:1403] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.002s
I20260709 13:18:04.166640 19549 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.167167 19549 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.170429 19261 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:04.171329 19261 ts_tablet_manager.cc:1403] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.005s
I20260709 13:18:04.164637 19263 raft_consensus.cc:359] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.173028 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.173516 19263 raft_consensus.cc:385] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.173902 19263 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.174642 19263 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.177948 19263 ts_tablet_manager.cc:1434] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:18:04.176235 19261 raft_consensus.cc:359] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.178395 19261 raft_consensus.cc:385] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.178743 19261 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
W20260709 13:18:04.179011 19110 leader_election.cc:343] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.179549 19261 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.179893 19071 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:04.181973 19261 ts_tablet_manager.cc:1434] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:04.184338 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:04.188798 19561 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.189368 19561 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:04.189559 19261 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:04.190416 19549 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.190284 19561 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.196491 19261 tablet_bootstrap.cc:654] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.197688 19292 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.198174 19292 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.202396 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:04.203859 19038 leader_election.cc:343] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.204190 19263 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:04.207864 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.208474 19140 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:04.209764 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:04.210047 19263 tablet_bootstrap.cc:654] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.210870 19562 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.211232 19562 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.211568 19562 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.212450 19547 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.212950 19547 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.215013 19547 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.218060 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:04.218750 19215 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:04.221133 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.222011 19549 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.222219 19292 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.222662 19549 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.223227 19549 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.223363 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:04.224628 19184 leader_election.cc:343] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.226405 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.227026 19140 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:04.228228 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.229249 19547 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.229599 19547 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.229928 19547 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.230899 19562 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.237720 19266 tablet_bootstrap.cc:654] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.239368 19547 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.242604 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:04.243034 19547 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.243410 19140 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.243938 19263 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.244393 19263 ts_tablet_manager.cc:1403] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.006s
I20260709 13:18:04.245522 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:04.246155 19144 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.247445 19263 raft_consensus.cc:359] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.248133 19263 raft_consensus.cc:385] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.248427 19263 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.249086 19263 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.253685 19263 ts_tablet_manager.cc:1434] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:18:04.254702 19263 tablet_bootstrap.cc:492] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:04.260475 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:04.264333 19184 leader_election.cc:343] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.267868 19263 tablet_bootstrap.cc:654] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.267910 19144 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:04.269526 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.273166 19547 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.277256 19547 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:04.278568 19547 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.259617 19549 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.288273 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:04.290164 19067 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.289595 19549 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:04.297955 19110 leader_election.cc:343] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.311080 19292 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.322701 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:04.324178 19038 leader_election.cc:343] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.324832 19562 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.338357 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:04.338927 19215 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.343281 18968 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.348285 18968 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.350813 19292 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.354722 19566 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.355196 19566 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.356861 19261 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:04.357363 19261 ts_tablet_manager.cc:1403] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.042s
I20260709 13:18:04.358206 19566 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.360096 19263 tablet_bootstrap.cc:492] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.361054 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.363035 19071 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:04.363293 19562 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.361876 19263 ts_tablet_manager.cc:1403] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.012s
I20260709 13:18:04.364017 19562 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.366971 19140 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:04.368757 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:04.368958 19547 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:04.376261 19266 tablet_bootstrap.cc:492] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:04.370334 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.369580 19292 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.378429 19562 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.380951 19215 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:04.382748 19266 ts_tablet_manager.cc:1403] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.236s	user 0.014s	sys 0.034s
I20260709 13:18:04.382650 19261 raft_consensus.cc:359] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.384500 19261 raft_consensus.cc:385] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.384770 19261 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.385479 19261 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.387219 19266 raft_consensus.cc:359] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.387876 19266 raft_consensus.cc:385] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.388146 19266 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.388320 19292 raft_consensus.cc:697] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:04.389616 19292 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.397092 19606 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.397675 19606 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.400033 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:04.391134 19263 raft_consensus.cc:359] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.406661 19263 raft_consensus.cc:385] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.406968 19263 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.407210 19261 ts_tablet_manager.cc:1434] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.009s
I20260709 13:18:04.407374 19606 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.407586 19263 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.408989 19562 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.408540 19266 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.409489 19562 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.411119 19266 ts_tablet_manager.cc:1434] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:18:04.411985 19562 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.413830 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:04.414928 19071 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.416821 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.420783 19263 ts_tablet_manager.cc:1434] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.000s
I20260709 13:18:04.421783 19263 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
W20260709 13:18:04.422765 19110 leader_election.cc:343] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.425536 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.426676 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.428193 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:04.423643 19555 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.429425 19261 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:04.412142 19266 tablet_bootstrap.cc:492] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:04.432242 19547 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.433848 19566 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.434325 19566 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:04.428830 19215 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:04.438136 19035 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:04.438799 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:04.438614 19566 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.444924 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.445667 19555 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.449261 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:04.452631 19113 leader_election.cc:343] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.453101 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.453922 19605 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.454648 19555 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.472949 19063 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.474737 19458 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.485064 19549 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.478487 19605 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:18:04.494004 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 53366.4us
I20260709 13:18:04.497478 19613 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:04.503363 19261 tablet_bootstrap.cc:654] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.510632 18970 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.514811 19613 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:04.515262 19613 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.521613 18968 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.527617 19273 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.528062 19273 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.545753 19560 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.546331 19560 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.574564 19560 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.576654 19263 tablet_bootstrap.cc:654] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.579684 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.579908 19273 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.594455 19613 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.591144 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.602105 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.604429 19560 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.604640 19613 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:04.649919 19110 leader_election.cc:343] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.653797 19214 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.654408 19266 tablet_bootstrap.cc:654] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.655243 19263 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.655601 19263 ts_tablet_manager.cc:1403] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.234s	user 0.011s	sys 0.006s
I20260709 13:18:04.655411 19184 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.666926 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:04.667929 19215 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:04.668345 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:04.668540 19545 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.670228 19113 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.675293 19555 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.689963 19566 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:04.694639 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:04.691912 19555 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.699486 19555 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.699958 19261 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:04.700512 19261 ts_tablet_manager.cc:1403] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.276s	user 0.014s	sys 0.013s
I20260709 13:18:04.698885 19560 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.704949 19560 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.708148 19560 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.709722 19263 raft_consensus.cc:359] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.710886 19263 raft_consensus.cc:385] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.712985 19263 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.717463 19263 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.726845 19261 raft_consensus.cc:359] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.727552 19261 raft_consensus.cc:385] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.716234 19555 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.727821 19261 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
W20260709 13:18:04.729089 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 45239.8us
I20260709 13:18:04.729389 19261 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.730661 19263 ts_tablet_manager.cc:1434] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.002s
I20260709 13:18:04.733238 19263 tablet_bootstrap.cc:492] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:04.738545 19261 ts_tablet_manager.cc:1434] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.003s
I20260709 13:18:04.740360 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.741357 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.743283 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:04.749662 19613 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:04.751227 19555 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:04.752180 19261 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:04.752316 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:04.752907 19213 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.761348 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:04.766484 19213 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
W20260709 13:18:04.767830 19184 leader_election.cc:343] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.767704 19113 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:04.769647 19110 leader_election.cc:343] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.775096 19545 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.779841 19266 tablet_bootstrap.cc:492] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:04.780246 19266 ts_tablet_manager.cc:1403] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.368s	user 0.020s	sys 0.029s
W20260709 13:18:04.777410 19184 leader_election.cc:343] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.780761 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.782591 19545 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.771385 19555 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.785003 19555 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:04.785806 19555 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.789664 19261 tablet_bootstrap.cc:654] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.802273 19263 tablet_bootstrap.cc:654] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.811286 19266 raft_consensus.cc:359] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.812223 19266 raft_consensus.cc:385] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.812500 19266 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.814075 19266 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.817091 19266 ts_tablet_manager.cc:1434] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:18:04.817426 19547 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.818883 19266 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:04.824910 18970 catalog_manager.cc:5697] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.835376 19261 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:04.835901 19261 ts_tablet_manager.cc:1403] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.016s
I20260709 13:18:04.837335 19266 tablet_bootstrap.cc:654] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.841423 19261 raft_consensus.cc:359] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.842128 19261 raft_consensus.cc:385] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.842444 19261 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.843101 19261 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.845896 19261 ts_tablet_manager.cc:1434] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:04.847162 19261 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:04.849402 19263 tablet_bootstrap.cc:492] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.849820 19263 ts_tablet_manager.cc:1403] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.011s
I20260709 13:18:04.852270 19263 raft_consensus.cc:359] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.852952 19263 raft_consensus.cc:385] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.853240 19263 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.859894 19292 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.863976 19263 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.870651 19263 ts_tablet_manager.cc:1434] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:18:04.871639 19263 tablet_bootstrap.cc:492] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:04.884146 19263 tablet_bootstrap.cc:654] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.893806 19069 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.898155 19263 tablet_bootstrap.cc:492] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.898643 19263 ts_tablet_manager.cc:1403] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.011s
I20260709 13:18:04.901346 19263 raft_consensus.cc:359] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.901958 19263 raft_consensus.cc:385] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.902381 19624 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.904726 19263 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.905635 19263 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.907552 19263 ts_tablet_manager.cc:1434] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 13:18:04.908466 19263 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:04.914186 19263 tablet_bootstrap.cc:654] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:04.923810 19110 consensus_peers.cc:597] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.943884 19215 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.945365 19547 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.945842 19547 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.947782 19547 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.950314 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:04.951508 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:04.967219 19140 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:04.956614 19562 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 13:18:04.968158 19184 leader_election.cc:343] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.948014 19261 tablet_bootstrap.cc:654] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.970570 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:04.971197 19547 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.971541 19547 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.964592 19266 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:04.971848 19547 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.972407 19266 ts_tablet_manager.cc:1403] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.154s	user 0.029s	sys 0.026s
I20260709 13:18:04.974977 19266 raft_consensus.cc:359] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.975582 19266 raft_consensus.cc:385] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.975869 19266 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.978863 19547 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.984536 19547 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:04.980909 19266 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.985105 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:04.987030 19266 ts_tablet_manager.cc:1434] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:18:04.985020 19263 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:04.987756 19263 ts_tablet_manager.cc:1403] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.015s
I20260709 13:18:04.987638 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:04.989239 19140 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.991827 19263 raft_consensus.cc:359] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:04.988669 19266 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:04.992741 19261 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:04.993338 19261 ts_tablet_manager.cc:1403] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.006s
W20260709 13:18:04.986994 19184 leader_election.cc:343] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.996414 19263 raft_consensus.cc:385] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.997654 19263 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.999792 19266 tablet_bootstrap.cc:654] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.000221 19263 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.004006 19140 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.005092 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.006114 19547 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.006774 19547 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:05.007563 19547 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.005079 19263 ts_tablet_manager.cc:1434] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:18:05.011791 19263 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:05.011720 19605 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.017835 19266 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:05.018483 19266 ts_tablet_manager.cc:1403] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.002s
I20260709 13:18:05.022330 19261 raft_consensus.cc:359] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.022982 19261 raft_consensus.cc:385] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.023216 19261 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.023898 19261 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.025986 19266 raft_consensus.cc:359] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.026655 19266 raft_consensus.cc:385] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.026902 19266 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.026994 19261 ts_tablet_manager.cc:1434] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 13:18:05.027531 19266 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.028071 19261 tablet_bootstrap.cc:492] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.029573 19266 ts_tablet_manager.cc:1434] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:05.046773 19266 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:05.033118 19263 tablet_bootstrap.cc:654] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:05.052666 19018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:05.055395 19263 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:05.055536 19266 tablet_bootstrap.cc:654] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.055930 19263 ts_tablet_manager.cc:1403] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.004s
I20260709 13:18:05.058266 19261 tablet_bootstrap.cc:654] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.058542 19263 raft_consensus.cc:359] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.058460 18970 catalog_manager.cc:5697] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.059270 19263 raft_consensus.cc:385] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.059645 19263 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.062520 19069 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:05.064038 19606 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:05.065050 19606 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:05.065359 19606 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:05.066124 19606 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.067277 19606 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.077988 19263 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.082634 19263 ts_tablet_manager.cc:1434] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:18:05.083626 19263 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:05.089259 19263 tablet_bootstrap.cc:654] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.102056 19266 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:05.102494 19266 ts_tablet_manager.cc:1403] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.006s
I20260709 13:18:05.104984 19266 raft_consensus.cc:359] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.105615 19266 raft_consensus.cc:385] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.105858 19266 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.106431 19266 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.108361 19266 ts_tablet_manager.cc:1434] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:18:05.109949 19266 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:05.110270 19261 tablet_bootstrap.cc:492] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.110689 19261 ts_tablet_manager.cc:1403] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.083s	user 0.030s	sys 0.014s
I20260709 13:18:05.110757 19263 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:05.111192 19263 ts_tablet_manager.cc:1403] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.007s
I20260709 13:18:05.113199 19261 raft_consensus.cc:359] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.113824 19261 raft_consensus.cc:385] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.113889 19263 raft_consensus.cc:359] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.114499 19261 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.114635 19263 raft_consensus.cc:385] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.114981 19263 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.115219 19261 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.115761 19263 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.117576 19261 ts_tablet_manager.cc:1434] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:05.118034 19263 ts_tablet_manager.cc:1434] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:18:05.118060 19266 tablet_bootstrap.cc:654] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.119211 19263 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:05.122296 19261 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.126744 19545 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.127244 19545 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.128435 19261 tablet_bootstrap.cc:654] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.131714 19545 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.133594 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.135210 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:05.136929 19184 leader_election.cc:343] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.137748 19547 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.138250 19547 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.140378 19547 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:05.142158 19184 leader_election.cc:343] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.142617 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.143628 19625 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.144152 19266 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:05.144733 19261 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.144999 19266 ts_tablet_manager.cc:1403] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.012s
I20260709 13:18:05.145579 19261 ts_tablet_manager.cc:1403] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:18:05.145678 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.146366 19140 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.147660 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.149757 19261 raft_consensus.cc:359] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.150390 19261 raft_consensus.cc:385] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.150665 19261 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.151324 19261 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.152660 19266 raft_consensus.cc:359] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.186653 19261 ts_tablet_manager.cc:1434] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.041s	user 0.014s	sys 0.008s
I20260709 13:18:05.187749 19261 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.186697 19266 raft_consensus.cc:385] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.190488 19266 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.191529 19266 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:05.192420 19184 leader_election.cc:343] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.193135 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.195829 19263 tablet_bootstrap.cc:654] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.200691 19625 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.201088 19625 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.201404 19625 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.206383 19624 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.195619 19555 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:18:05.206838 19624 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.208715 19624 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.215519 19263 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:05.215996 19263 ts_tablet_manager.cc:1403] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 13:18:05.216274 19261 tablet_bootstrap.cc:654] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.217386 19625 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.218703 19263 raft_consensus.cc:359] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.223527 19263 raft_consensus.cc:385] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.223855 19263 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.224608 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.225260 19147 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.228097 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:05.229028 19624 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.229774 19624 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.230214 19624 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.224581 19263 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.238947 19263 ts_tablet_manager.cc:1434] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:18:05.240269 19263 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:05.246726 19624 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.252982 19545 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.253595 19545 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.256407 19545 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.256583 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.257259 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:05.257593 19067 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.258041 19140 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.259848 19625 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.261512 19266 ts_tablet_manager.cc:1434] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.000s
I20260709 13:18:05.265810 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.270159 19147 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.266080 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:05.270892 19266 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:05.267344 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.282035 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:05.285156 19545 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.285598 19545 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.285944 19545 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.267859 19624 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.270968 19069 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.306079 19545 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.306517 19069 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.267020 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:05.307338 19144 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.274082 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:05.275005 19613 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.312909 19110 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.313398 19263 tablet_bootstrap.cc:654] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.313176 19613 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.314831 19144 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.326884 19613 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:05.327489 19184 leader_election.cc:343] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.328331 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.330399 19266 tablet_bootstrap.cc:654] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:05.330569 19184 leader_election.cc:343] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.328933 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.334187 19624 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.338382 19140 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.338534 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.331660 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:05.349702 19560 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.349903 19215 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:05.350189 19560 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:05.339525 19545 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.344691 19261 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.351578 19261 ts_tablet_manager.cc:1403] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.164s	user 0.044s	sys 0.047s
I20260709 13:18:05.350989 19560 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.351785 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:05.352422 19140 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.353551 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.354516 19613 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.354202 19261 raft_consensus.cc:359] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.354909 19613 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.355072 19261 raft_consensus.cc:385] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.355279 19613 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.355366 19261 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.356073 19261 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.358942 19624 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:05.361526 19562 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.361613 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:05.362049 19562 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.363001 19624 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.363989 19562 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.365087 19067 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.348027 19146 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
I20260709 13:18:05.367305 19613 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.370877 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:05.371659 19215 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:05.372695 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.375046 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:05.375662 19141 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.375950 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:05.381887 19613 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.382745 19140 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.386744 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:05.388103 19141 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:05.387774 19547 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.388789 19547 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:05.389218 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:05.389304 19035 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.390254 19613 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.391000 19613 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:05.389806 19547 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.389827 19215 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.391812 19613 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.408532 19266 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:05.411826 19266 ts_tablet_manager.cc:1403] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.001s
I20260709 13:18:05.413646 19261 ts_tablet_manager.cc:1434] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:18:05.416215 19261 tablet_bootstrap.cc:492] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.418618 19562 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.419075 19562 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.423882 19292 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.424319 19292 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.421643 19067 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.431068 19509 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.431715 19292 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.427834 18969 catalog_manager.cc:5697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.435045 18969 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.437868 19562 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.438627 19215 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:05.443130 19263 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:05.443516 19263 ts_tablet_manager.cc:1403] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.204s	user 0.021s	sys 0.032s
I20260709 13:18:05.444265 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:05.447036 19263 raft_consensus.cc:359] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.447667 19263 raft_consensus.cc:385] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.447912 19263 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.448510 19263 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.452553 19263 ts_tablet_manager.cc:1434] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:05.453498 19069 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.459981 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:05.464226 19263 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:05.468683 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.469089 18968 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.472597 19266 raft_consensus.cc:359] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.473330 19266 raft_consensus.cc:385] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.473641 19266 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.474306 19266 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:05.475987 19038 leader_election.cc:343] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.476477 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.477066 19141 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 0.
W20260709 13:18:05.483814 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.484668 19266 ts_tablet_manager.cc:1434] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.003s
I20260709 13:18:05.485679 19266 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:05.489252 18970 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.493230 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:05.498976 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:05.499713 19659 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.500085 19659 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.501506 19659 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.504382 19263 tablet_bootstrap.cc:654] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.524758 19509 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.526378 19261 tablet_bootstrap.cc:654] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.533995 19659 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.535511 19266 tablet_bootstrap.cc:654] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.536723 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:05.537345 19140 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.537839 19263 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:05.538285 19263 ts_tablet_manager.cc:1403] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.006s
I20260709 13:18:05.546547 19659 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.549399 19263 raft_consensus.cc:359] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.550320 19263 raft_consensus.cc:385] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.550655 19263 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.551426 19263 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.554944 19140 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:05.556221 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.559078 19266 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:05.559854 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:05.560362 19266 ts_tablet_manager.cc:1403] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.010s
I20260709 13:18:05.560402 19214 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.562489 19266 raft_consensus.cc:359] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.562984 19266 raft_consensus.cc:385] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.563251 19266 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.563851 19266 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.565763 19613 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.566215 19266 ts_tablet_manager.cc:1434] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:18:05.566236 19613 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:05.567317 19266 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:05.567185 19613 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.568831 19605 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.569314 19605 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.570464 19263 ts_tablet_manager.cc:1434] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.004s
I20260709 13:18:05.571296 19605 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.570467 19624 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.571868 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.572242 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:05.572847 19215 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
W20260709 13:18:05.573112 19110 leader_election.cc:343] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.573961 19113 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.575577 19263 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Bootstrap starting.
I20260709 13:18:05.577033 19624 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.577173 19266 tablet_bootstrap.cc:654] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.577523 19624 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.578670 19549 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.579059 19549 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.579423 19549 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.580742 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.581490 19624 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.581785 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:05.582307 19184 leader_election.cc:343] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:05.582911 19184 leader_election.cc:343] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.583236 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.584340 19560 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.586905 19261 tablet_bootstrap.cc:492] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.587368 19263 tablet_bootstrap.cc:654] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.589457 19266 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:05.589910 19266 ts_tablet_manager.cc:1403] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.005s
I20260709 13:18:05.587394 19261 ts_tablet_manager.cc:1403] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.005s
I20260709 13:18:05.593014 19266 raft_consensus.cc:359] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.593782 19266 raft_consensus.cc:385] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.594076 19266 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.594659 19261 raft_consensus.cc:359] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.594724 19266 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.595359 19261 raft_consensus.cc:385] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.595659 19261 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.596367 19261 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.597318 19266 ts_tablet_manager.cc:1434] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:05.598304 19266 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Bootstrap starting.
I20260709 13:18:05.598548 19261 ts_tablet_manager.cc:1434] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:05.602007 18970 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.603961 19266 tablet_bootstrap.cc:654] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.620126 19261 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.628333 19069 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.628715 19549 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.630764 19214 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:05.631942 19261 tablet_bootstrap.cc:654] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.638808 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:05.640221 19110 leader_election.cc:343] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.643415 19266 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: No bootstrap required, opened a new log
I20260709 13:18:05.644002 19266 ts_tablet_manager.cc:1403] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.020s
I20260709 13:18:05.647456 19266 raft_consensus.cc:359] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.648916 19266 raft_consensus.cc:385] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.649997 19266 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.651989 19266 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.681565 19266 ts_tablet_manager.cc:1434] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:18:05.648442 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:05.683830 19549 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.694435 19261 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.695529 19261 ts_tablet_manager.cc:1403] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.012s
I20260709 13:18:05.699463 19261 raft_consensus.cc:359] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.700264 19261 raft_consensus.cc:385] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.700604 19261 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.701392 19261 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.693259 19214 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.706431 19261 ts_tablet_manager.cc:1434] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:18:05.707383 19261 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.714936 19263 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: No bootstrap required, opened a new log
I20260709 13:18:05.715369 19263 ts_tablet_manager.cc:1403] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Time spent bootstrapping tablet: real 0.140s	user 0.024s	sys 0.025s
I20260709 13:18:05.716446 19624 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.716958 19624 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.718014 19263 raft_consensus.cc:359] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.718654 19263 raft_consensus.cc:385] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.719002 19261 tablet_bootstrap.cc:654] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.718945 19263 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.719849 19263 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.722246 19263 ts_tablet_manager.cc:1434] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:05.731320 19624 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.733652 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.734565 19140 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.732735 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.736967 19069 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.740620 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.741556 19547 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.741910 19547 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.742233 19547 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.744182 19555 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.744812 19555 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.748301 19555 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.748862 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:05.750168 19110 leader_election.cc:343] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.749994 19547 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.756126 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:05.756953 19141 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.757812 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:05.758417 19213 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 0.
I20260709 13:18:05.758589 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:05.759104 19069 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.759431 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.760411 19605 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.760748 19605 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.761080 19605 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.767603 19141 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.770200 19069 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.773878 19605 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.777904 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.779146 19560 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.780236 19560 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:05.781188 19560 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.783259 19261 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.783699 19261 ts_tablet_manager.cc:1403] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.077s	user 0.046s	sys 0.020s
I20260709 13:18:05.786355 19261 raft_consensus.cc:359] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.786970 19261 raft_consensus.cc:385] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.787245 19261 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.787859 19261 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.789924 19261 ts_tablet_manager.cc:1434] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:05.791411 19509 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.792042 19261 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.791960 19509 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.794035 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:05.794461 19509 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.794606 19215 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.798744 19261 tablet_bootstrap.cc:654] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.795943 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.800789 19605 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:05.801297 19141 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:05.796104 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:05.751866 19547 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.804628 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:05.805665 19613 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.813756 18970 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.815367 19547 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.820487 19215 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:05.823776 19261 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.825100 19613 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.825256 19261 ts_tablet_manager.cc:1403] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.012s
I20260709 13:18:05.827795 19261 raft_consensus.cc:359] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.828368 19261 raft_consensus.cc:385] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.828594 19261 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.829252 19261 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.831310 19261 ts_tablet_manager.cc:1434] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:05.834362 19261 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.834744 19561 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.796926 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:05.836894 19110 leader_election.cc:343] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.840519 19261 tablet_bootstrap.cc:654] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.841782 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.842479 19555 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.842917 19555 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:05.843674 19555 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.844218 19214 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:05.846618 19545 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.847275 19545 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.849589 19545 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.852950 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:05.853598 19069 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.854692 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.855268 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:05.855883 19141 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 0.
I20260709 13:18:05.855988 19113 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:05.860044 19261 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.860463 19261 ts_tablet_manager.cc:1403] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
I20260709 13:18:05.855382 19545 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.861303 19545 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.861732 19545 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.862941 19261 raft_consensus.cc:359] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.863585 19261 raft_consensus.cc:385] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.860854 19555 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.864657 19555 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:05.865545 19555 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.863864 19261 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.870275 19261 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.872937 19624 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.873624 19545 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.875280 19261 ts_tablet_manager.cc:1434] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:18:05.876924 19261 tablet_bootstrap.cc:492] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.876858 19545 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:05.879935 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:05.880558 19066 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.887238 19066 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.888337 19261 tablet_bootstrap.cc:654] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.891184 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:05.892367 19624 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.893287 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:05.894328 19141 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.894507 18970 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.895906 18970 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.898524 19624 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:05.899540 19624 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.901122 19261 tablet_bootstrap.cc:492] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.901943 19261 ts_tablet_manager.cc:1403] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:18:05.905061 19261 raft_consensus.cc:359] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.907758 19261 raft_consensus.cc:385] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.907173 19547 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.908083 19261 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.908994 19261 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.911543 19261 ts_tablet_manager.cc:1434] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:05.912662 19261 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Bootstrap starting.
I20260709 13:18:05.925285 19067 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.926378 19261 tablet_bootstrap.cc:654] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.938068 19141 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:05.940541 19545 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:05.942953 19261 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: No bootstrap required, opened a new log
I20260709 13:18:05.943471 19261 ts_tablet_manager.cc:1403] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.011s
I20260709 13:18:05.945923 19261 raft_consensus.cc:359] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.946684 19261 raft_consensus.cc:385] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.946991 19261 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.947623 19261 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:05.950078 19261 ts_tablet_manager.cc:1434] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:05.959015 19545 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.985363 18970 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.988243 19063 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.010318 19509 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.010495 19613 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.023137 19509 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.058043 19613 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.205003 19545 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.217195 19545 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.223917 19624 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:06.227329 19624 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:06.231241 19624 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:06.236302 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:06.236807 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:06.237011 19140 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:06.237586 19063 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:06.239291 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:06.239920 19624 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:06.240305 19624 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:06.240658 19624 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.246712 19624 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:06.248294 19624 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:06.248828 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:06.249521 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:06.249608 19067 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:06.253561 19146 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:06.254370 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:06.254983 19624 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.255365 19624 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:06.255978 19624 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:06.266103 18966 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.275255 19613 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.275701 19613 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:06.278102 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:06.278389 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:06.279038 19613 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:06.279117 19215 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 1: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:06.280072 19038 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:06.280633 19613 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.285288 19613 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.344614 19624 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.358513 19606 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.358530 19545 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:06.371429 19555 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.382220 19555 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.398277 19606 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.715423 19146 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.716495 19624 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:06.724843 19066 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.726109 19560 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.812098 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:07.858929 19705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.859205 19708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.861845 19706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:07.862493 17964 server_base.cc:1061] running on GCE node
I20260709 13:18:07.864933 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:07.865185 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:07.865404 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603087865385 us; error 0 us; skew 500 ppm
I20260709 13:18:07.866041 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:07.869457 17964 webserver.cc:533] Webserver started at http://127.17.139.4:33013/ using document root <none> and password file <none>
I20260709 13:18:07.870076 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:07.870321 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:07.870712 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:07.872294 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-3-root/instance:
uuid: "508ee2e0531b43d7a1c05f950644ae66"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-z675"
I20260709 13:18:07.878455 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:18:07.882742 19713 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.884678 17964 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.000s
I20260709 13:18:07.885849 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-3-root
uuid: "508ee2e0531b43d7a1c05f950644ae66"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-z675"
I20260709 13:18:07.886225 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:07.916751 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:07.918473 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:07.920078 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:07.922878 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:07.923122 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.923429 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:07.923666 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.995517 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.4:42525
I20260709 13:18:07.995630 19775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.4:42525 every 8 connection(s)
I20260709 13:18:07.999460 17964 auto_leader_rebalancer-test.cc:384] add a tserver: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:08.016098 19776 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35345
I20260709 13:18:08.016647 19776 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:08.017657 19776 heartbeater.cc:507] Master 127.17.139.62:35345 requested a full tablet report, sending...
I20260709 13:18:08.019714 18968 ts_manager.cc:194] Registered new tserver with Master: 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:08.021515 18968 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60996
I20260709 13:18:08.257136 19140 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:08.264122 19215 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.265537 19605 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.276067 19069 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.283172 19605 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.289933 19784 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.291739 19215 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:18:08.298890 19110 consensus_peers.cc:597] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e9eca38a1164c2293be5a949d3526b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.300444 19069 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.312460 18968 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.325527 19069 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:08.334522 19215 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.336043 19509 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.367998 19146 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.370698 19794 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:08.382037 19509 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.385196 19146 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:18:08.387328 19035 consensus_peers.cc:597] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28952387f86d4e5892a88c9c3e0173c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.389140 19215 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.399493 18968 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.400648 19066 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:08.410563 19215 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.412073 19691 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:08.414039 19035 consensus_peers.cc:597] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75fa1003f49c4855bf92d61c4fc4e4ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.414186 19140 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.419674 19794 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.423106 19794 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.429428 19215 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.438316 19146 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:08.444643 19140 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.447014 18966 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:08.451857 19110 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79274c20a7fb4e3dbf6355e5d4a28751. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.452154 19066 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.451382 19215 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:08.454452 19605 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.455286 19784 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.467144 19549 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.488310 19066 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.492329 19215 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.512127 18966 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:08.789175 19804 ts_tablet_manager.cc:933] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:08.791168 19804 tablet_copy_client.cc:323] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:08.813019 19157 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 6e9eca38a1164c2293be5a949d3526b3 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:08.813618 19157 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 6e9eca38a1164c2293be5a949d3526b3 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-6e9eca38a1164c2293be5a949d3526b3
I20260709 13:18:08.821305 19157 tablet_copy_source_session.cc:215] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:08.827025 19804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9eca38a1164c2293be5a949d3526b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.841679 19804 tablet_copy_client.cc:806] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:08.842337 19804 tablet_copy_client.cc:670] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:08.846594 19804 tablet_copy_client.cc:538] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:08.857607 19804 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:08.877135 19804 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:08.878067 19804 tablet_bootstrap.cc:492] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:08.878684 19804 ts_tablet_manager.cc:1403] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:18:08.882248 19804 raft_consensus.cc:359] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:08.883061 19804 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:08.883674 19804 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:08.967885 19804 ts_tablet_manager.cc:1434] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.088s	user 0.031s	sys 0.023s
I20260709 13:18:08.968672 19776 heartbeater.cc:499] Master 127.17.139.62:35345 was elected leader, sending a full tablet report...
I20260709 13:18:08.969872 19157 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-6e9eca38a1164c2293be5a949d3526b3 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:08.970379 19157 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-6e9eca38a1164c2293be5a949d3526b3 on tablet 6e9eca38a1164c2293be5a949d3526b3 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:08.983603 19804 ts_tablet_manager.cc:933] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:08.994381 19804 tablet_copy_client.cc:323] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:08.996430 19157 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 79274c20a7fb4e3dbf6355e5d4a28751 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:08.997850 19157 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 79274c20a7fb4e3dbf6355e5d4a28751 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-79274c20a7fb4e3dbf6355e5d4a28751
I20260709 13:18:09.009682 19157 tablet_copy_source_session.cc:215] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:09.012905 19804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79274c20a7fb4e3dbf6355e5d4a28751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.034611 19818 ts_tablet_manager.cc:933] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:18:09.055143 19804 tablet_copy_client.cc:806] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:09.055774 19804 tablet_copy_client.cc:670] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:09.069505 19818 tablet_copy_client.cc:323] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:18:09.070251 19804 tablet_copy_client.cc:538] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:09.075307 19820 ts_tablet_manager.cc:933] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:18:09.082839 19804 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:09.083058 19820 tablet_copy_client.cc:323] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:18:09.101239 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 28952387f86d4e5892a88c9c3e0173c8 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:18:09.101504 19081 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 75fa1003f49c4855bf92d61c4fc4e4ed from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:18:09.101902 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 28952387f86d4e5892a88c9c3e0173c8 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-28952387f86d4e5892a88c9c3e0173c8
I20260709 13:18:09.102643 19081 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 75fa1003f49c4855bf92d61c4fc4e4ed from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-75fa1003f49c4855bf92d61c4fc4e4ed
I20260709 13:18:09.109977 19081 tablet_copy_source_session.cc:215] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:09.113118 19820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75fa1003f49c4855bf92d61c4fc4e4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.119915 19082 tablet_copy_source_session.cc:215] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:09.122917 19818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28952387f86d4e5892a88c9c3e0173c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:09.123512 19804 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:09.124375 19804 tablet_bootstrap.cc:492] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:09.125020 19804 ts_tablet_manager.cc:1403] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.009s
I20260709 13:18:09.128401 19804 raft_consensus.cc:359] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:09.129212 19804 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:09.130203 19804 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:09.132359 19804 ts_tablet_manager.cc:1434] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:09.134590 19157 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-79274c20a7fb4e3dbf6355e5d4a28751 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:09.135002 19157 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-79274c20a7fb4e3dbf6355e5d4a28751 on tablet 79274c20a7fb4e3dbf6355e5d4a28751 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:09.139138 19818 tablet_copy_client.cc:806] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:09.139691 19818 tablet_copy_client.cc:670] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:09.143729 19818 tablet_copy_client.cc:538] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:09.145658 19820 tablet_copy_client.cc:806] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:09.146227 19820 tablet_copy_client.cc:670] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:09.149904 19820 tablet_copy_client.cc:538] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:09.151654 19818 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:09.159655 19820 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:09.169480 19750 raft_consensus.cc:1217] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:09.188732 19820 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:09.189671 19820 tablet_bootstrap.cc:492] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:09.190387 19820 ts_tablet_manager.cc:1403] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.009s
I20260709 13:18:09.193873 19820 raft_consensus.cc:359] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:09.195076 19820 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:09.195704 19820 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:09.197695 19818 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:09.197690 19820 ts_tablet_manager.cc:1434] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:18:09.198642 19818 tablet_bootstrap.cc:492] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:09.199285 19818 ts_tablet_manager.cc:1403] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.014s
I20260709 13:18:09.206439 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-75fa1003f49c4855bf92d61c4fc4e4ed received from {username='slave'} at 127.0.0.1:59842
I20260709 13:18:09.206121 19818 raft_consensus.cc:359] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:09.206938 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-75fa1003f49c4855bf92d61c4fc4e4ed on tablet 75fa1003f49c4855bf92d61c4fc4e4ed with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:09.207156 19818 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:09.207798 19818 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:09.211606 19818 ts_tablet_manager.cc:1434] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:18:09.216341 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-28952387f86d4e5892a88c9c3e0173c8 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:18:09.216737 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-28952387f86d4e5892a88c9c3e0173c8 on tablet 28952387f86d4e5892a88c9c3e0173c8 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:09.500514 19750 raft_consensus.cc:1217] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:09.574573 19784 raft_consensus.cc:1064] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:09.577237 19784 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:09.586472 19750 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:09.587281 19213 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:09.588006 19605 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:09.588738 19811 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:09.608158 19066 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:09.609617 19828 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:09.624974 19751 raft_consensus.cc:1217] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:09.640564 19828 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.642969 19750 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.648065 19066 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.651898 19213 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.657655 19751 raft_consensus.cc:1217] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:09.662294 18968 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.691911 19141 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:09.697463 19750 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:09.699066 19213 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:09.698973 19784 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:09.702086 19828 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:09.705988 19828 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.710793 19215 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.713516 19750 raft_consensus.cc:2955] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.724622 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e9eca38a1164c2293be5a949d3526b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:09.727469 18967 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:09.741294 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9eca38a1164c2293be5a949d3526b3 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:09.743335 19835 tablet_replica.cc:333] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:18:09.744705 19835 raft_consensus.cc:2243] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:09.745997 19835 raft_consensus.cc:2272] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:09.749986 19835 ts_tablet_manager.cc:1916] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:09.761881 19835 ts_tablet_manager.cc:1929] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:09.762244 19835 log.cc:1199] T 6e9eca38a1164c2293be5a949d3526b3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/6e9eca38a1164c2293be5a949d3526b3
I20260709 13:18:09.763672 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 6e9eca38a1164c2293be5a949d3526b3 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:10.067823 19784 raft_consensus.cc:1064] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:10.069964 19784 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:10.075732 19750 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.075887 19213 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.077476 19828 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.077831 19066 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.079181 19605 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.080170 19784 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.089550 19784 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.091099 19066 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.096035 19215 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.110590 18970 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.118858 19750 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.131575 19816 raft_consensus.cc:1064] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:10.134449 19816 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:10.149597 19817 raft_consensus.cc:1064] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:10.154395 19817 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:10.167650 19141 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:10.173159 19750 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:10.176162 19063 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:10.179481 19784 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.184469 19828 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.193133 19828 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.210707 19750 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.213060 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79274c20a7fb4e3dbf6355e5d4a28751 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:10.224843 18970 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.226225 19066 raft_consensus.cc:2955] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.240046 19213 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.240260 19215 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.242136 19845 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:10.242688 19844 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:10.243399 19750 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.246156 19140 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.247766 19750 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.252638 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 79274c20a7fb4e3dbf6355e5d4a28751 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:10.255853 19817 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.257630 19817 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.259194 19817 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.279446 19141 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:10.285059 19845 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:10.298188 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 94604.2us
I20260709 13:18:10.318738 19816 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.333727 19848 tablet_replica.cc:333] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:10.339484 19848 raft_consensus.cc:2243] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.340396 19848 raft_consensus.cc:2272] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.340361 19215 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.350174 19848 ts_tablet_manager.cc:1916] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:10.361495 18967 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.369928 19750 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.373492 19844 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.381671 19144 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.390833 19751 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.438906 19848 ts_tablet_manager.cc:1929] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:10.437992 19146 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.446152 19848 log.cc:1199] T 79274c20a7fb4e3dbf6355e5d4a28751 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/79274c20a7fb4e3dbf6355e5d4a28751
I20260709 13:18:10.447638 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 79274c20a7fb4e3dbf6355e5d4a28751 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:10.438279 19213 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.437855 18967 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.482883 19063 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:10.483501 19067 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:10.487963 19751 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:10.488754 19146 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:10.490410 19844 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.493430 19213 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:10.494737 19816 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.496153 19794 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.496325 19751 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:10.503633 19845 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.505218 19794 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.505946 19844 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.516389 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28952387f86d4e5892a88c9c3e0173c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:10.517220 19213 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.517692 19751 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.510979 19146 raft_consensus.cc:2955] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.523006 19750 raft_consensus.cc:2955] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.532531 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75fa1003f49c4855bf92d61c4fc4e4ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:10.548170 18969 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:10.549966 18967 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.559769 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 75fa1003f49c4855bf92d61c4fc4e4ed with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:10.560658 19848 tablet_replica.cc:333] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:10.561666 19848 raft_consensus.cc:2243] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.562482 19848 raft_consensus.cc:2272] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.564059 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 28952387f86d4e5892a88c9c3e0173c8 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:10.566277 19853 tablet_replica.cc:333] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:10.567270 19853 raft_consensus.cc:2243] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.568011 19853 raft_consensus.cc:2272] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.569391 19848 ts_tablet_manager.cc:1916] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:10.571420 19853 ts_tablet_manager.cc:1916] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:10.584573 19848 ts_tablet_manager.cc:1929] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:10.584789 19853 ts_tablet_manager.cc:1929] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:10.585098 19848 log.cc:1199] T 75fa1003f49c4855bf92d61c4fc4e4ed P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/75fa1003f49c4855bf92d61c4fc4e4ed
I20260709 13:18:10.585306 19853 log.cc:1199] T 28952387f86d4e5892a88c9c3e0173c8 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/28952387f86d4e5892a88c9c3e0173c8
I20260709 13:18:10.586515 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 75fa1003f49c4855bf92d61c4fc4e4ed (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:10.587050 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 28952387f86d4e5892a88c9c3e0173c8 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
W20260709 13:18:12.190435 19036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.009s
W20260709 13:18:12.259739 19111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.007s	sys 0.016s
W20260709 13:18:12.260109 19111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.007s	sys 0.016s
W20260709 13:18:12.222270 19036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.010s
I20260709 13:18:12.423600 19218 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:12.429920 19145 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.434369 19067 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.434289 19868 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:12.436066 19864 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:12.444283 19184 consensus_peers.cc:597] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 409c2d9a573f4e408b732ebafda96921. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:12.447252 19868 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.449062 19145 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:18:12.461010 19001 debug-util.cc:398] Leaking SignalData structure 0x7b0800038800 after lost signal to thread 17967
W20260709 13:18:12.461970 19001 debug-util.cc:398] Leaking SignalData structure 0x7b0800057100 after lost signal to thread 19004
I20260709 13:18:12.461216 19067 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:18:12.463425 19001 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0040 after lost signal to thread 19096
W20260709 13:18:12.464406 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080028d500 after lost signal to thread 19171
W20260709 13:18:12.471920 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080030b700 after lost signal to thread 19810
I20260709 13:18:12.476759 18967 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.479768 19218 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:12.513891 19145 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.515842 19865 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:12.516692 19184 consensus_peers.cc:597] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 263ce615af6646ada8e5f6d61d990dee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:12.518183 19067 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.520689 19865 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:12.552121 19067 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.546808 19864 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.612370 19142 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.656116 18970 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.658306 19218 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:12.741412 19145 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:12.745548 19184 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d57ee419ffa74c87b2c5eb26b930d9ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:12.745699 19865 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:12.749514 19067 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.757225 19865 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:12.783623 19868 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.784727 19142 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.822511 19063 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.828212 18969 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.838877 19220 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:18:12.880367 19184 consensus_peers.cc:597] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec63bca0af2942e1b88ac12d090c139c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:12.880709 19063 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.882105 19624 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:12.886710 19142 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:12.888170 19547 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:12.893994 19868 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.897284 19895 ts_tablet_manager.cc:933] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:12.898242 19063 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.901638 19145 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:12.916460 18970 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.943315 19895 tablet_copy_client.cc:323] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:12.964942 19231 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 263ce615af6646ada8e5f6d61d990dee from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:12.965548 19231 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 263ce615af6646ada8e5f6d61d990dee from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-263ce615af6646ada8e5f6d61d990dee
I20260709 13:18:12.977015 19231 tablet_copy_source_session.cc:215] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:12.980193 19895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 263ce615af6646ada8e5f6d61d990dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:12.997357 19899 ts_tablet_manager.cc:933] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:13.002537 19895 tablet_copy_client.cc:806] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:13.002856 19899 tablet_copy_client.cc:323] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:13.003116 19895 tablet_copy_client.cc:670] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:13.004765 19231 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 409c2d9a573f4e408b732ebafda96921 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:13.005357 19231 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 409c2d9a573f4e408b732ebafda96921 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-409c2d9a573f4e408b732ebafda96921
I20260709 13:18:13.007897 19895 tablet_copy_client.cc:538] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:13.014463 19231 tablet_copy_source_session.cc:215] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:13.016798 19895 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:13.018163 19899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409c2d9a573f4e408b732ebafda96921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:13.038748 19899 tablet_copy_client.cc:806] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:13.039307 19899 tablet_copy_client.cc:670] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:13.043174 19899 tablet_copy_client.cc:538] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:13.052685 19895 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:13.053653 19895 tablet_bootstrap.cc:492] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:13.054389 19895 ts_tablet_manager.cc:1403] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.011s
I20260709 13:18:13.057487 19895 raft_consensus.cc:359] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.058352 19895 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:13.059029 19895 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.059613 19899 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:13.097317 19895 ts_tablet_manager.cc:1434] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.043s	user 0.013s	sys 0.029s
I20260709 13:18:13.099720 19231 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-263ce615af6646ada8e5f6d61d990dee received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:13.100148 19231 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-263ce615af6646ada8e5f6d61d990dee on tablet 263ce615af6646ada8e5f6d61d990dee with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:13.109833 19899 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:13.110839 19899 tablet_bootstrap.cc:492] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:13.111583 19899 ts_tablet_manager.cc:1403] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.010s
I20260709 13:18:13.115234 19899 raft_consensus.cc:359] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.116092 19899 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:13.116730 19899 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.119036 19899 ts_tablet_manager.cc:1434] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:18:13.120638 19231 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-409c2d9a573f4e408b732ebafda96921 received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:13.121111 19231 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-409c2d9a573f4e408b732ebafda96921 on tablet 409c2d9a573f4e408b732ebafda96921 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:13.365402 19899 ts_tablet_manager.cc:933] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:13.371793 19899 tablet_copy_client.cc:323] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:13.373757 19231 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet d57ee419ffa74c87b2c5eb26b930d9ef from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:13.374316 19231 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet d57ee419ffa74c87b2c5eb26b930d9ef from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-d57ee419ffa74c87b2c5eb26b930d9ef
I20260709 13:18:13.383637 19231 tablet_copy_source_session.cc:215] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:13.387251 19899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57ee419ffa74c87b2c5eb26b930d9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:13.410490 19895 ts_tablet_manager.cc:933] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:13.418376 19895 tablet_copy_client.cc:323] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:13.419281 19899 tablet_copy_client.cc:806] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:13.420341 19231 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet ec63bca0af2942e1b88ac12d090c139c from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:13.420948 19231 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet ec63bca0af2942e1b88ac12d090c139c from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-ec63bca0af2942e1b88ac12d090c139c
I20260709 13:18:13.421082 19899 tablet_copy_client.cc:670] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:13.424937 19899 tablet_copy_client.cc:538] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:13.433391 19231 tablet_copy_source_session.cc:215] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:13.436803 19895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec63bca0af2942e1b88ac12d090c139c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:13.439128 19899 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:13.479651 19750 raft_consensus.cc:1217] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:13.494042 19750 raft_consensus.cc:1217] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:13.494891 19899 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:13.495954 19899 tablet_bootstrap.cc:492] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:13.499328 19899 ts_tablet_manager.cc:1403] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.007s
I20260709 13:18:13.505645 19899 raft_consensus.cc:359] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.506783 19899 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:13.507702 19899 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.513188 19899 ts_tablet_manager.cc:1434] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:18:13.514407 19895 tablet_copy_client.cc:806] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:13.514981 19895 tablet_copy_client.cc:670] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:13.522504 19231 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-d57ee419ffa74c87b2c5eb26b930d9ef received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:13.522919 19231 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-d57ee419ffa74c87b2c5eb26b930d9ef on tablet d57ee419ffa74c87b2c5eb26b930d9ef with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:13.529029 19895 tablet_copy_client.cc:538] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:13.557435 19895 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:13.586426 19895 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:13.587297 19895 tablet_bootstrap.cc:492] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:13.587962 19895 ts_tablet_manager.cc:1403] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.002s
I20260709 13:18:13.591392 19895 raft_consensus.cc:359] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.593523 19895 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:13.594110 19895 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:13.596707 19895 ts_tablet_manager.cc:1434] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:18:13.598846 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-ec63bca0af2942e1b88ac12d090c139c received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:13.599259 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-ec63bca0af2942e1b88ac12d090c139c on tablet ec63bca0af2942e1b88ac12d090c139c with peer 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:13.732402 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 48470.2us
I20260709 13:18:13.782660 19750 raft_consensus.cc:1217] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:18:13.921028 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49412.2us
I20260709 13:18:13.968961 19750 raft_consensus.cc:1217] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:13.972554 19915 raft_consensus.cc:1064] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:13.976745 19915 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:14.015314 19750 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.017163 19145 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.018055 19915 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:14.018659 19069 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.019683 19868 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:14.023325 19624 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.057495 19624 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.062799 19066 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.070647 19750 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.094228 19915 raft_consensus.cc:1064] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:14.083300 18967 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.099596 19915 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:14.081210 19145 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.148233 19750 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.149775 19547 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.150445 19063 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.152853 19142 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.154150 19547 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.161540 19868 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.207309 19547 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.209354 19750 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.212086 19063 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.227555 19147 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.285432 18969 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.348388 19865 raft_consensus.cc:1064] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:14.350188 19218 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:14.351305 19865 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:14.356060 19220 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:14.380788 19750 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.381717 19147 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.386399 19063 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.387765 19916 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:14.388979 19547 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:14.389670 19750 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:14.391124 19916 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:14.392087 19624 raft_consensus.cc:1064] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:14.393118 19547 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:14.394404 19624 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:14.404788 19147 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.406281 19750 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.412539 19066 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.416399 19868 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.417021 19865 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.419224 19868 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.422008 19912 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.423740 19912 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.424651 19145 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.428630 19063 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.426661 19147 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.437240 19749 raft_consensus.cc:2955] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.449169 18968 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.449762 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 263ce615af6646ada8e5f6d61d990dee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:14.466836 19865 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.470252 19069 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.484337 19748 raft_consensus.cc:2955] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.497745 19547 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.501541 19750 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:14.526719 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 263ce615af6646ada8e5f6d61d990dee with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36450
W20260709 13:18:14.554636 19930 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:18:14.545264 19915 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:14.584607 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 409c2d9a573f4e408b732ebafda96921 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:14.620939 18970 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.599742 19912 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.737768 19936 tablet_replica.cc:333] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
W20260709 13:18:14.756188 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 101296us
I20260709 13:18:14.833241 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 409c2d9a573f4e408b732ebafda96921 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:14.839910 19748 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.843549 19139 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.842603 19063 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.864404 19936 raft_consensus.cc:2243] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.865139 19936 raft_consensus.cc:2272] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.868582 19936 ts_tablet_manager.cc:1916] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:14.874693 18967 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.892942 19952 tablet_replica.cc:333] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:14.924705 19952 raft_consensus.cc:2243] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.933238 19912 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:14.936062 19220 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:14.939695 19936 ts_tablet_manager.cc:1929] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:14.940238 19936 log.cc:1199] T 263ce615af6646ada8e5f6d61d990dee P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/263ce615af6646ada8e5f6d61d990dee
I20260709 13:18:14.948704 19952 raft_consensus.cc:2272] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.951156 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 263ce615af6646ada8e5f6d61d990dee (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:14.959394 19952 ts_tablet_manager.cc:1916] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:14.969534 18970 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.988333 19952 ts_tablet_manager.cc:1929] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:14.988981 19952 log.cc:1199] T 409c2d9a573f4e408b732ebafda96921 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/409c2d9a573f4e408b732ebafda96921
I20260709 13:18:14.996456 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 409c2d9a573f4e408b732ebafda96921 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:15.012301 19748 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:15.014587 19063 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:15.015260 19069 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.018572 19147 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.025306 19944 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:15.042276 19748 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.054672 19220 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:15.069267 19944 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:15.076303 19749 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:15.077836 19147 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:15.083055 19953 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:15.084851 19953 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.086004 19944 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:15.089825 19749 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.104346 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d57ee419ffa74c87b2c5eb26b930d9ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:15.105540 19069 raft_consensus.cc:2955] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.109520 18968 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:15.110854 19944 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.121210 19147 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.123343 19748 raft_consensus.cc:2955] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.125630 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec63bca0af2942e1b88ac12d090c139c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:15.140488 18967 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:15.162797 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet ec63bca0af2942e1b88ac12d090c139c with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:15.163533 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet d57ee419ffa74c87b2c5eb26b930d9ef with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:15.164059 19936 tablet_replica.cc:333] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:18:15.164448 19952 tablet_replica.cc:333] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:15.165228 19936 raft_consensus.cc:2243] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:15.165446 19952 raft_consensus.cc:2243] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:15.166041 19936 raft_consensus.cc:2272] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:15.166139 19952 raft_consensus.cc:2272] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:15.169341 19936 ts_tablet_manager.cc:1916] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:15.172071 19952 ts_tablet_manager.cc:1916] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:15.187580 19936 ts_tablet_manager.cc:1929] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:15.189419 19936 log.cc:1199] T ec63bca0af2942e1b88ac12d090c139c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/ec63bca0af2942e1b88ac12d090c139c
I20260709 13:18:15.190399 19952 ts_tablet_manager.cc:1929] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:15.190889 19952 log.cc:1199] T d57ee419ffa74c87b2c5eb26b930d9ef P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/d57ee419ffa74c87b2c5eb26b930d9ef
I20260709 13:18:15.191234 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet ec63bca0af2942e1b88ac12d090c139c (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:15.192512 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet d57ee419ffa74c87b2c5eb26b930d9ef (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:16.248736 19147 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:16.255587 19220 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:16.256506 19110 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d1b18b0ec57435da3325e677d1b8741. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:16.257213 19954 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.258071 19069 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.259505 19954 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.266549 19945 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.278652 19220 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.303516 18967 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.306701 19147 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:16.271744 19069 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:18:16.332906 19110 consensus_peers.cc:597] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af41c4af8a294a729613e88856c064ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:16.333891 19219 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.334955 19063 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.336477 19960 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.337517 19946 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.379523 19946 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.385640 19067 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.392230 19219 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.411852 19214 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:16.422783 19067 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.424216 19953 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:16.427582 19184 consensus_peers.cc:597] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66ce6ec243d4436da3c96c55bba7244a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:16.429388 19147 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.431917 18969 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.440708 19944 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.454484 19912 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.464653 19067 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.465757 19147 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.479342 18967 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.489066 19145 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:18:16.504958 19110 consensus_peers.cc:597] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e4e5f111c104ea4adb5e45cd00f1db6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:16.505491 19214 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.506994 19946 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.509981 19069 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:16.511559 19960 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:16.518008 19960 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.520742 19219 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.523864 19067 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.543866 18967 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:16.708173 19974 ts_tablet_manager.cc:933] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:16.711083 19974 tablet_copy_client.cc:323] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:16.713263 19157 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 2d1b18b0ec57435da3325e677d1b8741 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:16.713858 19157 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 2d1b18b0ec57435da3325e677d1b8741 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-2d1b18b0ec57435da3325e677d1b8741
I20260709 13:18:16.725104 19157 tablet_copy_source_session.cc:215] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:16.731020 19976 ts_tablet_manager.cc:933] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:16.731923 19974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1b18b0ec57435da3325e677d1b8741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.760648 19976 tablet_copy_client.cc:323] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:16.762354 19157 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet af41c4af8a294a729613e88856c064ac from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:16.762882 19157 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet af41c4af8a294a729613e88856c064ac from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-af41c4af8a294a729613e88856c064ac
I20260709 13:18:16.883996 19974 tablet_copy_client.cc:806] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:16.885432 19157 tablet_copy_source_session.cc:215] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:16.892246 19976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af41c4af8a294a729613e88856c064ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.884766 19974 tablet_copy_client.cc:670] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:16.964900 19974 tablet_copy_client.cc:538] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:16.996147 19980 ts_tablet_manager.cc:933] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:17.005790 19976 tablet_copy_client.cc:806] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:17.006430 19976 tablet_copy_client.cc:670] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:17.009528 19980 tablet_copy_client.cc:323] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:17.011619 19976 tablet_copy_client.cc:538] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:17.018292 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 66ce6ec243d4436da3c96c55bba7244a from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:17.018882 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 66ce6ec243d4436da3c96c55bba7244a from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-66ce6ec243d4436da3c96c55bba7244a
I20260709 13:18:17.027406 19230 tablet_copy_source_session.cc:215] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:17.064229 19983 ts_tablet_manager.cc:933] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:17.053706 19974 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:17.072536 19980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ce6ec243d4436da3c96c55bba7244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.073202 19983 tablet_copy_client.cc:323] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:17.075657 19976 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:17.076588 19157 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 0e4e5f111c104ea4adb5e45cd00f1db6 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:17.077159 19157 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 0e4e5f111c104ea4adb5e45cd00f1db6 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-0e4e5f111c104ea4adb5e45cd00f1db6
I20260709 13:18:17.097645 19157 tablet_copy_source_session.cc:215] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:17.101138 19983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4e5f111c104ea4adb5e45cd00f1db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.130824 19974 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:17.131829 19974 tablet_bootstrap.cc:492] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:17.132570 19974 ts_tablet_manager.cc:1403] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.079s	user 0.031s	sys 0.004s
I20260709 13:18:17.132364 19980 tablet_copy_client.cc:806] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:17.133131 19983 tablet_copy_client.cc:806] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:17.135180 19983 tablet_copy_client.cc:670] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:17.146955 19980 tablet_copy_client.cc:670] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:17.160238 19983 tablet_copy_client.cc:538] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:17.157683 19980 tablet_copy_client.cc:538] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:17.192219 19974 raft_consensus.cc:359] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:17.207880 19974 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:17.219583 19976 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:17.220577 19976 tablet_bootstrap.cc:492] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:17.221361 19976 ts_tablet_manager.cc:1403] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.146s	user 0.029s	sys 0.005s
I20260709 13:18:17.211694 19974 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:18:17.549423 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 341611us
I20260709 13:18:17.578838 19976 raft_consensus.cc:359] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:17.581121 19976 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:17.582083 19976 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:17.594934 19983 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:17.629915 19980 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:17.722779 19976 ts_tablet_manager.cc:1434] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.501s	user 0.013s	sys 0.034s
W20260709 13:18:17.723330 19976 ts_tablet_manager.cc:1467] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Tablet startup took 501ms
I20260709 13:18:17.740840 19974 ts_tablet_manager.cc:1434] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.608s	user 0.059s	sys 0.067s
W20260709 13:18:17.741340 19974 ts_tablet_manager.cc:1467] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Tablet startup took 608ms
W20260709 13:18:17.741684 19974 ts_tablet_manager.cc:1469] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Trace:
0709 13:18:16.691721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.691874 (+   153us) service_pool.cc:224] Handling call
0709 13:18:16.708552 (+ 16678us) ts_tablet_manager.cc:934] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
0709 13:18:16.730637 (+ 22085us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:16.745957 (+ 15320us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:16.746058 (+   101us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:16.763815 (+ 17757us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:16.764093 (+   278us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:16.883153 (+119060us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:16.883240 (+    87us) inbound_call.cc:177] Queueing success response
0709 13:18:17.053326 (+170086us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:17.132910 (+ 79584us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:17.189865 (+ 56955us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:17.190479 (+   614us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":267,"raft.queue_time_us":482974,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":6934,"tablet-copy.queue_time_us":12616,"tablet-download-pool.queue_time_us":136,"tablet-download-pool.run_cpu_time_us":1339,"tablet-download-pool.run_wall_time_us":32845,"thread_start_us":467552,"threads_started":3}
I20260709 13:18:17.760805 19748 raft_consensus.cc:1217] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:17.777748 19748 raft_consensus.cc:1217] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:17.781628 19157 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-2d1b18b0ec57435da3325e677d1b8741 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:17.782145 19157 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-2d1b18b0ec57435da3325e677d1b8741 on tablet 2d1b18b0ec57435da3325e677d1b8741 with peer 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:17.733174 19976 ts_tablet_manager.cc:1469] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Trace:
0709 13:18:16.726109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.728011 (+  1902us) service_pool.cc:224] Handling call
0709 13:18:16.731346 (+  3335us) ts_tablet_manager.cc:934] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
0709 13:18:16.891069 (+159723us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:16.925726 (+ 34657us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:16.925839 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:16.973718 (+ 47879us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:16.973987 (+   269us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:16.974303 (+   316us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:16.974361 (+    58us) inbound_call.cc:177] Queueing success response
0709 13:18:17.075310 (+100949us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:17.221673 (+146363us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:17.535452 (+313779us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:17.576806 (+ 41354us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":258,"raft.queue_time_us":145182,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":2077,"tablet-copy.queue_time_us":2511,"tablet-download-pool.queue_time_us":111,"tablet-download-pool.run_cpu_time_us":1076,"tablet-download-pool.run_wall_time_us":4377,"thread_start_us":167330,"threads_started":3}
I20260709 13:18:18.160449 19983 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:18.168758 19982 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:18.170063 19982 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:18.177445 19983 tablet_bootstrap.cc:492] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:18.178895 19982 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:18.179533 19983 ts_tablet_manager.cc:1403] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.586s	user 0.039s	sys 0.028s
I20260709 13:18:18.185380 19983 raft_consensus.cc:359] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:18.186316 19983 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:18.187053 19983 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:18.181905 19980 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:18.188822 19980 tablet_bootstrap.cc:492] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:18.189636 19980 ts_tablet_manager.cc:1403] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.560s	user 0.039s	sys 0.007s
I20260709 13:18:18.195900 19983 ts_tablet_manager.cc:1434] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:18:18.193344 19980 raft_consensus.cc:359] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:18.197341 19980 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:18.198211 19980 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:18.201104 19980 ts_tablet_manager.cc:1434] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:18:18.207329 19982 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:18.207842 19982 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:18.209156 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:18.209932 19982 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:18.224964 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:18.231642 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-66ce6ec243d4436da3c96c55bba7244a received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:18.232188 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-66ce6ec243d4436da3c96c55bba7244a on tablet 66ce6ec243d4436da3c96c55bba7244a with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:18.239967 19157 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-0e4e5f111c104ea4adb5e45cd00f1db6 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:18.240453 19157 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-0e4e5f111c104ea4adb5e45cd00f1db6 on tablet 0e4e5f111c104ea4adb5e45cd00f1db6 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:18.241088 20003 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:18.241712 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-af41c4af8a294a729613e88856c064ac received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:18.241590 20003 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:18.242197 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-af41c4af8a294a729613e88856c064ac on tablet af41c4af8a294a729613e88856c064ac with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:18.243633 20003 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:18.249965 19946 raft_consensus.cc:1064] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:18.255340 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:18.252175 19946 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:18.280622 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:18.282150 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:18.281746 19989 raft_consensus.cc:1064] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:18.337404 20001 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:18.355675 20001 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:18.358629 20001 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:18.359788 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:18.361035 19748 raft_consensus.cc:1217] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:18.363445 19989 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:18.370764 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 84706.6us
I20260709 13:18:18.377173 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:18.383538 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:18.389343 19215 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.391070 19035 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:18.392007 19748 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:18:18.393985 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 76705.3us
I20260709 13:18:18.394505 20013 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.395529 19946 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.397327 19954 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.395678 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:18.405854 20014 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.407509 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:18.415150 19067 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.417879 19946 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:18.422029 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:18.422797 20013 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:18.437244 19747 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.438741 19946 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.453016 19219 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.454730 19960 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.465449 20009 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.472385 19945 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.472378 19215 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.488583 19747 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.510946 19988 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.517590 19214 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.530624 19063 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.531216 19748 raft_consensus.cc:1217] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:18.546746 19993 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:18.544390 18969 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.557096 19071 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.584522 19063 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.625510 19747 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.654625 19142 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:18.664338 19747 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:18.664413 18967 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.666028 19988 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:18.666332 19215 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:18.669559 19987 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:18.677054 19987 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.686229 19215 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.688486 19747 raft_consensus.cc:2955] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.718014 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af41c4af8a294a729613e88856c064ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:18.716995 18968 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.742834 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet af41c4af8a294a729613e88856c064ac with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:18.753412 20027 tablet_replica.cc:333] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:18:18.754478 20027 raft_consensus.cc:2243] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:18.759919 20027 raft_consensus.cc:2272] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:18.765914 20027 ts_tablet_manager.cc:1916] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:18.780926 20027 ts_tablet_manager.cc:1929] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:18.781356 20027 log.cc:1199] T af41c4af8a294a729613e88856c064ac P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/af41c4af8a294a729613e88856c064ac
I20260709 13:18:18.782999 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet af41c4af8a294a729613e88856c064ac (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
W20260709 13:18:18.852948 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800120200 after lost signal to thread 17967
W20260709 13:18:18.854032 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff180 after lost signal to thread 19004
W20260709 13:18:18.855199 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800328b80 after lost signal to thread 19096
W20260709 13:18:18.856273 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf460 after lost signal to thread 19171
W20260709 13:18:18.857419 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08002a90e0 after lost signal to thread 19245
W20260709 13:18:18.858582 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0b80 after lost signal to thread 19775
I20260709 13:18:18.881462 19993 raft_consensus.cc:1064] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:18.883798 19993 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:18.909174 19219 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.911404 19945 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.913122 19747 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.915674 19945 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.941751 19071 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:18.943638 19945 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:18.983244 19988 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.990769 19215 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:18.994517 19747 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.014513 19071 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.017647 18968 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.063952 19142 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:19.089097 19747 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.091466 19072 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.093470 19993 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:19.095333 19993 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:19.118940 19960 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.124437 19063 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.147023 18970 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.150909 19747 raft_consensus.cc:2955] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.154891 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e4e5f111c104ea4adb5e45cd00f1db6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:19.165341 19142 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:19.174564 19751 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.176852 19988 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:19.187641 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4e5f111c104ea4adb5e45cd00f1db6 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:19.195107 19989 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.197883 20032 tablet_replica.cc:333] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:19.198987 20032 raft_consensus.cc:2243] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.199754 20032 raft_consensus.cc:2272] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.238662 19063 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.243523 19751 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.250411 20032 ts_tablet_manager.cc:1916] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:19.252655 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d1b18b0ec57435da3325e677d1b8741 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:19.257062 19945 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:19.264731 18970 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.271559 19063 raft_consensus.cc:2955] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.287896 20032 ts_tablet_manager.cc:1929] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:19.288416 20032 log.cc:1199] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/0e4e5f111c104ea4adb5e45cd00f1db6
W20260709 13:18:19.302569 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 65502.9us
I20260709 13:18:19.311355 19998 raft_consensus.cc:1064] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:19.331219 19998 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:19.345173 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 0e4e5f111c104ea4adb5e45cd00f1db6 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:19.357547 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1b18b0ec57435da3325e677d1b8741 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:19.358588 20032 tablet_replica.cc:333] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:19.359743 20032 raft_consensus.cc:2243] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.360572 20032 raft_consensus.cc:2272] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.365671 20032 ts_tablet_manager.cc:1916] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:19.394459 19146 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:19.397207 19063 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:19.397328 19751 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:19.401578 20034 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:19.407394 19978 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:19.409873 20032 ts_tablet_manager.cc:1929] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:19.410409 20032 log.cc:1199] T 2d1b18b0ec57435da3325e677d1b8741 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/2d1b18b0ec57435da3325e677d1b8741
I20260709 13:18:19.410449 19998 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:19.412449 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 2d1b18b0ec57435da3325e677d1b8741 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:19.461663 19998 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.464075 19146 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.489470 18968 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.491870 19751 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.500489 19071 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.529153 19214 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:19.534067 19751 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.534632 19071 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:19.538892 19998 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:19.544579 19978 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:19.556672 20015 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.566268 19071 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.569746 19751 raft_consensus.cc:2955] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:19.571605 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66ce6ec243d4436da3c96c55bba7244a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:19.581209 18970 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.605661 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 66ce6ec243d4436da3c96c55bba7244a with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:19.624469 20039 tablet_replica.cc:333] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:19.628064 20039 raft_consensus.cc:2243] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.629199 20039 raft_consensus.cc:2272] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.632450 20039 ts_tablet_manager.cc:1916] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:19.643389 20039 ts_tablet_manager.cc:1929] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:19.643677 20039 log.cc:1199] T 66ce6ec243d4436da3c96c55bba7244a P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/66ce6ec243d4436da3c96c55bba7244a
I20260709 13:18:19.644968 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 66ce6ec243d4436da3c96c55bba7244a (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:20.681485 19214 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:20.688195 19146 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:20.690166 19071 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:20.690614 19184 consensus_peers.cc:597] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90cdd87d3b9846a1a1863432e72d2d75. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.691677 20041 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:20.692497 19978 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:20.702409 19071 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.702653 19146 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.701288 20041 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.719921 18970 catalog_manager.cc:5697] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.722781 19214 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:20.767048 19146 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:20.770968 19063 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:20.776993 19978 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:20.779271 19184 consensus_peers.cc:597] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13256a1f86494f9f812c2c4162cec4f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.785375 19978 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:20.806891 20047 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.812143 19071 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.813326 19146 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.819950 19142 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:20.830926 18968 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:20.847563 19110 consensus_peers.cc:597] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bf1d0079a1c47338b7cf7be4cdcf505. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:20.850143 19071 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:20.851167 19989 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:20.851872 19214 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:20.853264 19960 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:20.913512 19989 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.913790 19071 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.935815 19214 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.954063 18968 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:20.956028 19146 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:18:20.977545 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52262.1us
W20260709 13:18:21.034416 19110 consensus_peers.cc:597] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cafb40f37ca439fa093060d6ba342f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:21.038055 19219 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:21.039991 19063 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:21.040551 20062 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:21.045142 20060 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.054836 20062 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:21.058686 19063 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:21.060140 19219 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:21.084163 18969 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:21.154763 20066 ts_tablet_manager.cc:933] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:21.167039 20066 tablet_copy_client.cc:323] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:21.168792 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 13256a1f86494f9f812c2c4162cec4f7 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:21.169350 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 13256a1f86494f9f812c2c4162cec4f7 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-13256a1f86494f9f812c2c4162cec4f7
I20260709 13:18:21.181759 19230 tablet_copy_source_session.cc:215] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.184906 20068 ts_tablet_manager.cc:933] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:21.187669 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13256a1f86494f9f812c2c4162cec4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.196738 20068 tablet_copy_client.cc:323] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:21.206310 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 90cdd87d3b9846a1a1863432e72d2d75 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:21.206895 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 90cdd87d3b9846a1a1863432e72d2d75 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-90cdd87d3b9846a1a1863432e72d2d75
I20260709 13:18:21.215286 20066 tablet_copy_client.cc:806] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.215893 20066 tablet_copy_client.cc:670] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:21.227535 19230 tablet_copy_source_session.cc:215] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.234409 20066 tablet_copy_client.cc:538] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.237066 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cdd87d3b9846a1a1863432e72d2d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.242931 20066 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:21.273064 20068 tablet_copy_client.cc:806] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.273588 20068 tablet_copy_client.cc:670] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:21.282353 20070 ts_tablet_manager.cc:933] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:21.282444 20068 tablet_copy_client.cc:538] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.292632 20066 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.293635 20066 tablet_bootstrap.cc:492] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:21.294394 20066 ts_tablet_manager.cc:1403] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.007s
I20260709 13:18:21.297518 20068 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:21.300005 20066 raft_consensus.cc:359] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.301028 20066 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:21.301684 20066 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.303050 20070 tablet_copy_client.cc:323] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:21.304672 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 4bf1d0079a1c47338b7cf7be4cdcf505 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:21.305213 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 4bf1d0079a1c47338b7cf7be4cdcf505 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-4bf1d0079a1c47338b7cf7be4cdcf505
I20260709 13:18:21.316987 19156 tablet_copy_source_session.cc:215] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.320665 20066 ts_tablet_manager.cc:1434] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.008s
I20260709 13:18:21.321103 20070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf1d0079a1c47338b7cf7be4cdcf505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.334003 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-13256a1f86494f9f812c2c4162cec4f7 received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:21.334450 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-13256a1f86494f9f812c2c4162cec4f7 on tablet 13256a1f86494f9f812c2c4162cec4f7 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:21.345216 20070 tablet_copy_client.cc:806] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.345791 20070 tablet_copy_client.cc:670] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:21.350067 20070 tablet_copy_client.cc:538] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.359900 20070 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:21.396106 20070 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.398698 20070 tablet_bootstrap.cc:492] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:21.399391 20070 ts_tablet_manager.cc:1403] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.003s
I20260709 13:18:21.402292 20070 raft_consensus.cc:359] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.403132 20070 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:21.403822 20070 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.406599 20070 ts_tablet_manager.cc:1434] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:18:21.408478 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-4bf1d0079a1c47338b7cf7be4cdcf505 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:21.408998 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-4bf1d0079a1c47338b7cf7be4cdcf505 on tablet 4bf1d0079a1c47338b7cf7be4cdcf505 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:21.424239 20068 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.426589 20068 tablet_bootstrap.cc:492] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:21.428365 20068 ts_tablet_manager.cc:1403] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.023s
I20260709 13:18:21.434078 20068 raft_consensus.cc:359] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.434937 20068 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:21.435565 20068 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.445221 20068 ts_tablet_manager.cc:1434] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:18:21.452937 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-90cdd87d3b9846a1a1863432e72d2d75 received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:21.453459 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-90cdd87d3b9846a1a1863432e72d2d75 on tablet 90cdd87d3b9846a1a1863432e72d2d75 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:21.559617 20068 ts_tablet_manager.cc:933] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:21.561457 20068 tablet_copy_client.cc:323] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:21.563256 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 3cafb40f37ca439fa093060d6ba342f0 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:21.563774 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 3cafb40f37ca439fa093060d6ba342f0 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-3cafb40f37ca439fa093060d6ba342f0
I20260709 13:18:21.574757 19156 tablet_copy_source_session.cc:215] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:21.580761 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cafb40f37ca439fa093060d6ba342f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:21.616111 20068 tablet_copy_client.cc:806] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:21.616787 20068 tablet_copy_client.cc:670] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:21.621352 20068 tablet_copy_client.cc:538] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:21.631325 20068 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:21.638466 19751 raft_consensus.cc:1217] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:21.662921 19751 raft_consensus.cc:1217] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:21.713208 20068 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:21.720227 20068 tablet_bootstrap.cc:492] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:21.721087 20068 ts_tablet_manager.cc:1403] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.022s
I20260709 13:18:21.724642 20068 raft_consensus.cc:359] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.725613 20068 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:21.726377 20068 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:21.738063 20068 ts_tablet_manager.cc:1434] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:18:21.739820 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-3cafb40f37ca439fa093060d6ba342f0 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:21.740288 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-3cafb40f37ca439fa093060d6ba342f0 on tablet 3cafb40f37ca439fa093060d6ba342f0 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:21.755645 19751 raft_consensus.cc:1217] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:21.935987 19751 raft_consensus.cc:1217] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:22.082088 20062 raft_consensus.cc:1064] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:22.084709 20062 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:22.120440 19214 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.122136 19751 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.123624 20062 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.126718 20058 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.139678 19071 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.151181 20081 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.164150 20058 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.167043 19214 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.188272 18968 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.189258 19751 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.231001 19071 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.245443 20047 raft_consensus.cc:1064] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:22.248641 20047 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:22.269090 19141 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.271742 19071 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.273625 20047 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.275681 20079 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.278230 19751 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.289845 20079 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.309527 20080 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.311332 19142 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:22.320721 19063 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.323215 20062 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.329394 19747 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.334128 20058 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.337175 19071 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.338475 20062 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.351430 19063 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.351935 19141 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.356263 18967 catalog_manager.cc:5697] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.376981 19989 raft_consensus.cc:1064] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:22.382790 18967 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.378561 19751 raft_consensus.cc:2955] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.374455 19747 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.401865 20041 raft_consensus.cc:1064] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:22.404539 20041 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:22.409077 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4bf1d0079a1c47338b7cf7be4cdcf505 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:22.412922 19989 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:22.414458 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 74015.9us
I20260709 13:18:22.416850 19214 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:22.426115 19146 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.428429 20015 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.434278 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bf1d0079a1c47338b7cf7be4cdcf505 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:22.452155 19749 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.451222 19214 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.453461 19071 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.453694 20062 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.454982 20058 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.462180 20097 tablet_replica.cc:333] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:22.462005 20079 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.463189 20097 raft_consensus.cc:2243] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.463842 20097 raft_consensus.cc:2272] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.464524 19989 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.471781 19748 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.477492 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90cdd87d3b9846a1a1863432e72d2d75 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:22.483826 20015 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.485563 19141 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.500298 19146 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.503952 19063 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.506623 19747 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:22.508539 20080 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:22.509477 18967 catalog_manager.cc:5697] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.509729 19748 raft_consensus.cc:2955] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.511742 20015 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.520220 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 90cdd87d3b9846a1a1863432e72d2d75 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:22.524187 20097 ts_tablet_manager.cc:1916] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:22.525266 20015 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.528632 20081 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.543520 19214 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.552490 20103 tablet_replica.cc:333] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:18:22.553586 20103 raft_consensus.cc:2243] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.554260 20103 raft_consensus.cc:2272] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.567312 20103 ts_tablet_manager.cc:1916] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:22.568126 19747 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.571887 19063 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.600786 18969 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.606149 20097 ts_tablet_manager.cc:1929] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:22.606587 20097 log.cc:1199] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/4bf1d0079a1c47338b7cf7be4cdcf505
I20260709 13:18:22.607954 20047 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.609218 19071 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.613086 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 4bf1d0079a1c47338b7cf7be4cdcf505 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:22.616916 19751 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.629474 19146 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.635250 19141 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:22.644658 19747 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.644789 19214 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.647194 20081 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.647974 20108 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.652592 18967 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.656486 20081 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.657895 19214 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.669183 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3cafb40f37ca439fa093060d6ba342f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:22.671363 19747 raft_consensus.cc:2955] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.679281 20103 ts_tablet_manager.cc:1929] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:22.679709 20103 log.cc:1199] T 90cdd87d3b9846a1a1863432e72d2d75 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/90cdd87d3b9846a1a1863432e72d2d75
I20260709 13:18:22.681313 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 90cdd87d3b9846a1a1863432e72d2d75 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:22.687682 19214 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:22.685599 18970 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.699622 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cafb40f37ca439fa093060d6ba342f0 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:22.700378 19747 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.701745 20080 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.703666 19063 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:22.708483 20079 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:22.713176 20041 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.725389 20103 tablet_replica.cc:333] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:18:22.726511 20103 raft_consensus.cc:2243] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.727156 20103 raft_consensus.cc:2272] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.726305 19063 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.733599 19751 raft_consensus.cc:2955] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.753821 18970 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:22.768325 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 13256a1f86494f9f812c2c4162cec4f7 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:22.736572 20103 ts_tablet_manager.cc:1916] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:22.781301 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13256a1f86494f9f812c2c4162cec4f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:22.791452 20103 ts_tablet_manager.cc:1929] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:22.791903 20103 log.cc:1199] T 3cafb40f37ca439fa093060d6ba342f0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/3cafb40f37ca439fa093060d6ba342f0
I20260709 13:18:22.793571 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 3cafb40f37ca439fa093060d6ba342f0 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:22.807618 20109 tablet_replica.cc:333] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:22.818135 20109 raft_consensus.cc:2243] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.818832 20109 raft_consensus.cc:2272] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.821997 20109 ts_tablet_manager.cc:1916] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:22.842659 20109 ts_tablet_manager.cc:1929] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:22.843076 20109 log.cc:1199] T 13256a1f86494f9f812c2c4162cec4f7 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/13256a1f86494f9f812c2c4162cec4f7
I20260709 13:18:22.844664 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 13256a1f86494f9f812c2c4162cec4f7 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:23.993665 19146 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:18:24.005075 19110 consensus_peers.cc:597] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: debddc2dd9264017aeda9f1cad516f83. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:24.005748 19219 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:24.008116 19071 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:24.009558 20111 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:24.014624 20111 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:24.033295 20108 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.038385 19072 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.047428 19214 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.065575 18970 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.081677 19215 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.105731 19141 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:24.106319 19072 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:24.114566 20041 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:24.115574 19184 consensus_peers.cc:597] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c405ec9a50f54a4fa80ed27adf421c09. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:24.117621 20015 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:24.145710 20015 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.148360 19063 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.165570 19063 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.184499 19142 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.206236 19215 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:24.207928 20098 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:24.216192 19141 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:24.201785 18968 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.219412 20098 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:24.239598 19035 consensus_peers.cc:597] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33ef0d891f7b462bafaf9441fbf19e37. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:24.250452 20098 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.252164 19215 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.274501 18970 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.274986 19142 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.291417 19146 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.310906 19215 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:24.311648 19110 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1b84fdcb260415b9e65e72540fe1841. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:24.312299 19063 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:24.312500 20081 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:24.313446 20111 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:24.322687 20111 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.324601 19215 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.339689 18968 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.343343 19063 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:24.514178 20131 ts_tablet_manager.cc:933] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:24.528542 20131 tablet_copy_client.cc:323] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:24.530714 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet c405ec9a50f54a4fa80ed27adf421c09 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:24.531342 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet c405ec9a50f54a4fa80ed27adf421c09 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-c405ec9a50f54a4fa80ed27adf421c09
I20260709 13:18:24.539484 19230 tablet_copy_source_session.cc:215] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:24.543381 20131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c405ec9a50f54a4fa80ed27adf421c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:24.579787 20131 tablet_copy_client.cc:806] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:24.581308 20131 tablet_copy_client.cc:670] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:24.585582 20133 ts_tablet_manager.cc:933] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:24.590144 20131 tablet_copy_client.cc:538] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:24.602948 20131 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:24.604699 20133 tablet_copy_client.cc:323] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:24.606873 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet debddc2dd9264017aeda9f1cad516f83 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:24.607438 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet debddc2dd9264017aeda9f1cad516f83 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-debddc2dd9264017aeda9f1cad516f83
I20260709 13:18:24.615789 19156 tablet_copy_source_session.cc:215] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:24.619858 20133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debddc2dd9264017aeda9f1cad516f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:24.638867 20133 tablet_copy_client.cc:806] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:24.639530 20133 tablet_copy_client.cc:670] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:24.643705 20133 tablet_copy_client.cc:538] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:24.653296 20133 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:24.655714 20131 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.658281 20131 tablet_bootstrap.cc:492] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:24.658988 20131 ts_tablet_manager.cc:1403] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.056s	user 0.031s	sys 0.007s
I20260709 13:18:24.667776 20131 raft_consensus.cc:359] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.672809 20131 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:24.673632 20131 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.682538 20133 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.684686 20133 tablet_bootstrap.cc:492] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:24.685459 20133 ts_tablet_manager.cc:1403] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 13:18:24.688612 20133 raft_consensus.cc:359] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.689563 20133 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:24.690277 20133 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.700112 20133 ts_tablet_manager.cc:1434] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:18:24.701871 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-debddc2dd9264017aeda9f1cad516f83 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:24.702617 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-debddc2dd9264017aeda9f1cad516f83 on tablet debddc2dd9264017aeda9f1cad516f83 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:24.701197 20131 ts_tablet_manager.cc:1434] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.009s
I20260709 13:18:24.705461 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c405ec9a50f54a4fa80ed27adf421c09 received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:24.705855 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c405ec9a50f54a4fa80ed27adf421c09 on tablet c405ec9a50f54a4fa80ed27adf421c09 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:24.738420 20131 ts_tablet_manager.cc:933] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:24.774814 20131 tablet_copy_client.cc:323] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:24.776376 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet c1b84fdcb260415b9e65e72540fe1841 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:24.776901 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet c1b84fdcb260415b9e65e72540fe1841 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-c1b84fdcb260415b9e65e72540fe1841
I20260709 13:18:24.782940 20133 ts_tablet_manager.cc:933] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:18:24.802887 19156 tablet_copy_source_session.cc:215] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:24.806627 20133 tablet_copy_client.cc:323] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:18:24.807595 20131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b84fdcb260415b9e65e72540fe1841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:24.808684 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 33ef0d891f7b462bafaf9441fbf19e37 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:18:24.809267 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 33ef0d891f7b462bafaf9441fbf19e37 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-33ef0d891f7b462bafaf9441fbf19e37
I20260709 13:18:24.818928 19082 tablet_copy_source_session.cc:215] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:24.822265 20133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33ef0d891f7b462bafaf9441fbf19e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:24.828377 20131 tablet_copy_client.cc:806] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:24.829017 20131 tablet_copy_client.cc:670] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:24.835595 20131 tablet_copy_client.cc:538] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:24.844906 20133 tablet_copy_client.cc:806] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:24.845541 20133 tablet_copy_client.cc:670] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:24.850656 20133 tablet_copy_client.cc:538] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:24.858441 20131 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:24.861119 20133 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:24.889424 20133 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.890331 20133 tablet_bootstrap.cc:492] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:24.891012 20133 ts_tablet_manager.cc:1403] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.003s
I20260709 13:18:24.894094 20133 raft_consensus.cc:359] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.894969 20133 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:24.895623 20133 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.901592 20133 ts_tablet_manager.cc:1434] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:18:24.903584 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-33ef0d891f7b462bafaf9441fbf19e37 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:18:24.904003 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-33ef0d891f7b462bafaf9441fbf19e37 on tablet 33ef0d891f7b462bafaf9441fbf19e37 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:24.918337 20131 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.919309 20131 tablet_bootstrap.cc:492] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:24.920006 20131 ts_tablet_manager.cc:1403] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.002s
I20260709 13:18:24.922981 20131 raft_consensus.cc:359] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.924929 20131 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:24.925588 20131 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:24.936515 20131 ts_tablet_manager.cc:1434] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:18:24.943725 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c1b84fdcb260415b9e65e72540fe1841 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:24.944166 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c1b84fdcb260415b9e65e72540fe1841 on tablet c1b84fdcb260415b9e65e72540fe1841 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:24.966236 19747 raft_consensus.cc:1217] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:25.085418 19747 raft_consensus.cc:1217] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:25.174543 19747 raft_consensus.cc:1217] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:25.217000 19747 raft_consensus.cc:1217] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:25.494259 20108 raft_consensus.cc:1064] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:25.496806 20108 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:25.506639 19214 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.507902 19071 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.509873 20111 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.514362 19747 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.516017 20081 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.517956 20081 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.544898 20143 raft_consensus.cc:1064] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:25.562723 20143 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:25.643167 20110 raft_consensus.cc:1064] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:25.646175 20110 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:25.666332 20146 raft_consensus.cc:1064] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:25.669114 20146 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:25.679991 19214 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.684402 20081 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.688000 19146 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.692267 19751 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.692665 19749 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.695853 19063 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.699115 20041 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.704169 20146 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.709081 20111 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:25.714062 20041 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.718874 20143 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.722306 19749 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.726837 20077 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:25.736296 19214 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.739737 19748 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.749522 19214 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.753458 19072 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.752240 18968 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.755735 19071 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.750505 20077 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:18:25.763563 19146 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:25.770236 20081 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:25.783237 20127 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:25.786204 19747 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.784837 20148 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:18:25.816658 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 46783.4us
I20260709 13:18:25.829521 20108 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.852067 19141 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.839645 19071 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:18:25.875829 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 46996.6us
I20260709 13:18:25.882609 20127 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.879383 19750 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.892297 19214 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.906163 19215 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.917732 19072 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.922307 19747 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.955652 19142 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:25.987352 19142 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:25.992005 19747 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:25.994194 20108 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:25.995065 19063 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:25.999394 20108 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.002453 20160 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.010663 19747 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.020196 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet debddc2dd9264017aeda9f1cad516f83 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:26.024756 18967 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.026995 18967 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.030982 18967 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.031838 19063 raft_consensus.cc:2955] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.062199 19142 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:26.066104 19063 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:26.073427 19214 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:26.074160 19215 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:26.075170 19747 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:26.077354 20127 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.071775 18966 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.080176 19747 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:26.082755 20077 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.083473 19063 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:26.085938 20041 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.099316 20110 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.102156 20080 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:26.106264 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet debddc2dd9264017aeda9f1cad516f83 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:26.119781 20148 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.120280 19214 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.126585 19747 raft_consensus.cc:2955] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.170233 19748 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:26.170747 19072 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:26.172235 20081 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.173764 20081 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.180321 20146 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.192936 20170 tablet_replica.cc:333] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:26.191635 19072 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.198174 19750 raft_consensus.cc:2955] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.215582 18968 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.224207 19063 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.230995 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33ef0d891f7b462bafaf9441fbf19e37 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:26.246119 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1b84fdcb260415b9e65e72540fe1841 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:26.246932 20170 raft_consensus.cc:2243] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.252246 20170 raft_consensus.cc:2272] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.258109 20170 ts_tablet_manager.cc:1916] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:26.265223 18969 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.278590 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 33ef0d891f7b462bafaf9441fbf19e37 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:26.281744 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c405ec9a50f54a4fa80ed27adf421c09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:26.284183 20170 ts_tablet_manager.cc:1929] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:26.284904 20170 log.cc:1199] T debddc2dd9264017aeda9f1cad516f83 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/debddc2dd9264017aeda9f1cad516f83
I20260709 13:18:26.286978 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet debddc2dd9264017aeda9f1cad516f83 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
W20260709 13:18:26.301227 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 68486.6us
I20260709 13:18:26.314555 18969 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.337841 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b84fdcb260415b9e65e72540fe1841 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:26.338862 20170 tablet_replica.cc:333] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:26.339954 20170 raft_consensus.cc:2243] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.340646 20170 raft_consensus.cc:2272] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.345206 20170 ts_tablet_manager.cc:1916] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:26.366765 20170 ts_tablet_manager.cc:1929] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:26.371896 20170 log.cc:1199] T c1b84fdcb260415b9e65e72540fe1841 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/c1b84fdcb260415b9e65e72540fe1841
I20260709 13:18:26.372263 20174 tablet_replica.cc:333] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:26.377065 19747 raft_consensus.cc:2955] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:26.381739 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet c405ec9a50f54a4fa80ed27adf421c09 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:26.391324 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet c1b84fdcb260415b9e65e72540fe1841 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:26.391917 20174 raft_consensus.cc:2243] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.392431 20174 raft_consensus.cc:2272] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.399950 20174 ts_tablet_manager.cc:1916] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:26.419091 20174 ts_tablet_manager.cc:1929] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:26.419682 20174 log.cc:1199] T 33ef0d891f7b462bafaf9441fbf19e37 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/33ef0d891f7b462bafaf9441fbf19e37
I20260709 13:18:26.421569 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 33ef0d891f7b462bafaf9441fbf19e37 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:26.421787 20174 tablet_replica.cc:333] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:26.423169 20174 raft_consensus.cc:2243] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:26.423982 20174 raft_consensus.cc:2272] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:26.430199 20174 ts_tablet_manager.cc:1916] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:26.446478 20174 ts_tablet_manager.cc:1929] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:26.446914 20174 log.cc:1199] T c405ec9a50f54a4fa80ed27adf421c09 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/c405ec9a50f54a4fa80ed27adf421c09
I20260709 13:18:26.448535 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet c405ec9a50f54a4fa80ed27adf421c09 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:27.447410 19142 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:27.453002 19072 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.453042 19219 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:27.453755 19110 consensus_peers.cc:597] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b07ef65c060943509b105c2f74e22ff5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.454427 20175 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.455093 20146 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.462226 20146 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.463750 19072 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.464155 19219 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.475287 19063 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:27.479676 18969 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:27.483369 19142 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.484287 19219 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.485584 20176 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:27.486482 19035 consensus_peers.cc:597] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 736ce293ef884a9d97ae4efb914752f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.487171 20110 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.511431 20110 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.513679 19146 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.533238 19219 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:27.534025 19214 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.536525 18966 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:18:27.540378 19184 consensus_peers.cc:597] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e7ecd70203b43ca9b21a47be75683e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.543005 19063 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.546684 19146 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.546911 20143 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.549445 20172 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.574409 19063 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.572530 20172 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.585451 19141 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.595700 19072 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:27.595997 18966 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.608774 19214 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.609930 20110 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.611858 19141 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:27.612056 19035 consensus_peers.cc:597] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 716382b8056843a8ac2701a2242b5834. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.613231 20176 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.619864 20176 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.623422 19214 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.632998 19141 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.641788 18969 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 2, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:27.864315 20194 ts_tablet_manager.cc:933] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:18:27.866284 20194 tablet_copy_client.cc:323] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:18:27.867820 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 736ce293ef884a9d97ae4efb914752f6 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:18:27.868348 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 736ce293ef884a9d97ae4efb914752f6 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-736ce293ef884a9d97ae4efb914752f6
I20260709 13:18:27.875679 19082 tablet_copy_source_session.cc:215] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.879458 20194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736ce293ef884a9d97ae4efb914752f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.892127 20194 tablet_copy_client.cc:806] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:27.892726 20194 tablet_copy_client.cc:670] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:27.896168 20194 tablet_copy_client.cc:538] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.904448 20194 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:27.924758 20194 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.925694 20194 tablet_bootstrap.cc:492] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:27.926730 20194 ts_tablet_manager.cc:1403] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.011s
I20260709 13:18:27.927211 20197 ts_tablet_manager.cc:933] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:27.929747 20194 raft_consensus.cc:359] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:27.930735 20194 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:27.931843 20194 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:27.940482 20194 ts_tablet_manager.cc:1434] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:18:27.944897 20197 tablet_copy_client.cc:323] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:18:27.945096 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-736ce293ef884a9d97ae4efb914752f6 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:18:27.945544 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-736ce293ef884a9d97ae4efb914752f6 on tablet 736ce293ef884a9d97ae4efb914752f6 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:27.949544 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 7e7ecd70203b43ca9b21a47be75683e4 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:18:27.950250 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 7e7ecd70203b43ca9b21a47be75683e4 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-7e7ecd70203b43ca9b21a47be75683e4
I20260709 13:18:27.961830 19230 tablet_copy_source_session.cc:215] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.966197 20194 ts_tablet_manager.cc:933] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:27.967216 20197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7ecd70203b43ca9b21a47be75683e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.975485 20194 tablet_copy_client.cc:323] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:18:27.977404 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet b07ef65c060943509b105c2f74e22ff5 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:18:27.977908 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet b07ef65c060943509b105c2f74e22ff5 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-b07ef65c060943509b105c2f74e22ff5
I20260709 13:18:27.983476 20197 tablet_copy_client.cc:806] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:27.984090 20197 tablet_copy_client.cc:670] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:27.985481 19156 tablet_copy_source_session.cc:215] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.987432 20197 tablet_copy_client.cc:538] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.988490 20194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07ef65c060943509b105c2f74e22ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.993309 20197 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:28.004010 20194 tablet_copy_client.cc:806] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:28.004549 20194 tablet_copy_client.cc:670] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:28.008299 20194 tablet_copy_client.cc:538] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:28.016490 20194 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:28.022959 20197 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.023923 20197 tablet_bootstrap.cc:492] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:28.024646 20197 ts_tablet_manager.cc:1403] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.008s
I20260709 13:18:28.027762 20197 raft_consensus.cc:359] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:28.028635 20197 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:28.030295 20197 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:28.035791 20197 ts_tablet_manager.cc:1434] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:18:28.037667 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-7e7ecd70203b43ca9b21a47be75683e4 received from {username='slave'} at 127.0.0.1:42382
I20260709 13:18:28.038107 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-7e7ecd70203b43ca9b21a47be75683e4 on tablet 7e7ecd70203b43ca9b21a47be75683e4 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:28.054929 20194 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.055866 20194 tablet_bootstrap.cc:492] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:28.056499 20194 ts_tablet_manager.cc:1403] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.009s
I20260709 13:18:28.058748 20194 raft_consensus.cc:359] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:28.059512 20194 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:28.060184 20194 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:28.063611 20194 ts_tablet_manager.cc:1434] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:18:28.065938 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-b07ef65c060943509b105c2f74e22ff5 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:18:28.066478 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-b07ef65c060943509b105c2f74e22ff5 on tablet b07ef65c060943509b105c2f74e22ff5 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:28.079756 20194 ts_tablet_manager.cc:933] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:18:28.081467 20194 tablet_copy_client.cc:323] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:18:28.083057 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 716382b8056843a8ac2701a2242b5834 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:18:28.083570 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 716382b8056843a8ac2701a2242b5834 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-716382b8056843a8ac2701a2242b5834
I20260709 13:18:28.088878 19082 tablet_copy_source_session.cc:215] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:28.096098 20194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716382b8056843a8ac2701a2242b5834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.110096 20194 tablet_copy_client.cc:806] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:28.110663 20194 tablet_copy_client.cc:670] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:28.124970 20194 tablet_copy_client.cc:538] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:28.138140 20194 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:18:28.153070 20194 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:28.153713 20194 tablet_bootstrap.cc:492] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:18:28.154301 20194 ts_tablet_manager.cc:1403] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.001s
I20260709 13:18:28.156528 20194 raft_consensus.cc:359] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:28.157253 20194 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:18:28.157701 20194 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:28.161288 20194 ts_tablet_manager.cc:1434] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:28.164825 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-716382b8056843a8ac2701a2242b5834 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:18:28.165231 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-716382b8056843a8ac2701a2242b5834 on tablet 716382b8056843a8ac2701a2242b5834 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:28.250698 19747 raft_consensus.cc:1217] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:28.311688 19750 raft_consensus.cc:1217] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:28.465379 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:28.966087 19750 raft_consensus.cc:1217] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:29.005112 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:18:29.006100 19141 raft_consensus.cc:606] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:29.032894 20220 raft_consensus.cc:1064] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:29.034027 19748 raft_consensus.cc:1217] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:29.035562 20220 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.041266 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:18:29.042117 19141 raft_consensus.cc:606] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:29.077039 19748 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.078924 19141 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.078998 20176 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.080503 20220 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.085067 19217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:29.085690 19217 raft_consensus.cc:606] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:29.086447 20210 raft_consensus.cc:993] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:18:29.086892 20208 raft_consensus.cc:1081] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Signalling peer 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:18:29.104645 19140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:18:29.105271 19140 raft_consensus.cc:606] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:29.107353 19748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0"
dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:42930
I20260709 13:18:29.107921 19748 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.108314 19748 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.109097 19140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:18:29.109673 19140 raft_consensus.cc:606] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:29.111006 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:29.113157 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:29.135079 20110 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:29.136475 19749 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:29.148819 20143 raft_consensus.cc:993] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: : Instructing follower 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:18:29.149276 20143 raft_consensus.cc:1081] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Signalling peer 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:18:29.149344 20212 raft_consensus.cc:1064] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:29.157562 19141 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:29.151638 20212 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.164134 19748 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.165822 20219 raft_consensus.cc:993] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:29.166275 20146 raft_consensus.cc:1081] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Signalling peer 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:29.187229 19063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:36478
I20260709 13:18:29.187773 19063 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.188129 19063 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.189970 18966 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.192422 20210 raft_consensus.cc:993] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:29.192888 20210 raft_consensus.cc:1081] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Signalling peer 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:29.206593 19748 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:29.209431 19063 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:29.211405 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:29.212092 19217 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.212584 19063 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:29.213562 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:29.216274 19145 raft_consensus.cc:3055] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.188426 20207 raft_consensus.cc:993] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:29.217139 20207 raft_consensus.cc:1081] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Signalling peer 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:29.216560 19145 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:29.219556 19145 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:29.222781 19145 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:29.225284 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 222093us
I20260709 13:18:29.237165 19219 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.243251 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:29.244042 19216 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.244364 20220 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:29.249666 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 55603.6us
I20260709 13:18:29.252553 19068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:36478
I20260709 13:18:29.253095 19068 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.253435 19068 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.261083 19063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:36478
I20260709 13:18:29.261649 19063 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.262004 19063 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.264186 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:29.264819 19141 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.265123 19141 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:29.266201 19141 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.267340 19141 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.268554 19145 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:29.267019 19068 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:29.271425 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 88349us
I20260709 13:18:29.273413 19141 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:29.279459 19063 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:29.284041 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:29.284795 19063 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:29.283432 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:29.285490 20217 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.286633 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:29.288189 19145 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.288460 19145 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:29.289523 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:29.290040 19215 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.303437 20206 raft_consensus.cc:1064] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:29.304363 19216 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:29.306275 19068 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:29.305984 20206 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.310808 19217 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:29.291997 19219 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:29.314090 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:29.314790 19214 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.315719 20217 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:29.321036 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:29.321538 19141 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.321810 19141 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:29.323289 19141 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:29.324203 19141 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.326586 19145 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:29.326000 20218 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.337157 20218 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:29.329094 19748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75"
dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:18:29.337747 19141 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:29.337937 19748 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.338395 19748 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.330567 19750 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.335357 19063 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.336061 19146 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.338973 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:29.341529 19214 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:29.341635 19215 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:29.338133 20218 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:29.342603 19038 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:29.325508 20217 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.345713 20220 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.345894 20176 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.346282 20220 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:29.346448 20176 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:29.347280 20220 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:29.349067 19145 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.347345 20176 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:29.355202 19145 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:29.356827 19748 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.361722 20211 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.362710 20172 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:29.366040 20212 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.391831 19748 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:29.394151 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:29.406121 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:29.416276 19214 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.420118 20110 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.416821 19146 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.498670 19219 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.499192 19219 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:29.500216 19219 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:29.508080 19219 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.586560 19146 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:29.590616 19219 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
W20260709 13:18:29.591626 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 101637us
W20260709 13:18:29.592408 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57996.7us
I20260709 13:18:29.633157 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:29.678088 20235 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:29.678728 20242 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:18:29.690021 19750 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:18:29.717253 20241 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:29.734278 20235 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:29.735456 20235 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:29.751139 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 157825us
I20260709 13:18:29.762223 19146 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:29.811533 20220 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.849331 19147 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:29.862468 20255 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.868567 20255 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:29.878134 20172 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:29.886569 18966 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.889256 18966 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.889864 19145 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:29.891637 20235 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:29.892696 18969 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:29.899430 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0d00 after lost signal to thread 17967
I20260709 13:18:29.899290 18969 catalog_manager.cc:5697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:29.900381 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9500 after lost signal to thread 19004
W20260709 13:18:29.901546 19772 debug-util.cc:398] Leaking SignalData structure 0x7b0800276fa0 after lost signal to thread 19096
W20260709 13:18:29.902781 19772 debug-util.cc:398] Leaking SignalData structure 0x7b080033b3c0 after lost signal to thread 19171
I20260709 13:18:29.890843 18966 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:29.903754 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee820 after lost signal to thread 19245
W20260709 13:18:29.904825 19772 debug-util.cc:398] Leaking SignalData structure 0x7b080011eea0 after lost signal to thread 19775
I20260709 13:18:29.922214 19215 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.930979 19146 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.938524 19215 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.943070 19214 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:29.944186 20235 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:29.945680 19215 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:29.959674 20206 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.970436 19749 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:29.977320 19066 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:29.979564 19140 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:30.001922 19747 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 LEARNER]: Advancing to term 2
I20260709 13:18:30.009106 19747 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:30.017045 20245 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:30.017824 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 66626.9us
I20260709 13:18:30.027907 20110 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.030032 20110 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.039640 20176 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:30.052736 19142 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:30.056550 20110 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:30.077244 20220 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:30.112205 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:30.113042 19066 raft_consensus.cc:606] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:18:30.129372 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:30.131184 20206 raft_consensus.cc:993] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:18:30.131661 20206 raft_consensus.cc:1081] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:18:30.133385 19146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:18:30.136363 19146 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:30.137459 19146 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.140587 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:30.153079 19066 raft_consensus.cc:606] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:18:30.156808 19750 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:30.179687 18967 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:30.187266 18954 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b07ef65c060943509b105c2f74e22ff5 already in progress [suppressed 4 similar messages]
I20260709 13:18:30.248601 19214 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:30.254151 20235 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:30.257072 19146 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:30.261175 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:30.261721 19214 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.270920 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:30.271500 19071 raft_consensus.cc:3055] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:30.271808 19071 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:30.263343 19146 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:30.272533 19071 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:30.277691 19071 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:30.296763 19146 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:30.300953 20235 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:30.325630 19214 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:30.345726 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:30.347306 20209 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:30.347887 20209 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:30.348697 20209 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:30.355456 19071 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:30.333758 19215 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:30.402918 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 192092us
I20260709 13:18:30.416244 19142 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:30.416157 19215 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:18:30.548678 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 124704us
W20260709 13:18:30.550956 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 124298us
I20260709 13:18:30.551004 20143 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:30.562062 19140 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:18:30.693341 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 94660.3us
W20260709 13:18:30.767729 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 73746.6us
I20260709 13:18:30.812460 19749 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:18:30.835969 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 242481us
W20260709 13:18:30.877604 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 108245us
W20260709 13:18:30.876669 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.906915 18954 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.033s	sys 0.023s
W20260709 13:18:30.907225 18954 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.033s	sys 0.023s
W20260709 13:18:30.907444 18954 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 721196us
I20260709 13:18:31.901026 20308 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.901787 20308 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.906056 20308 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.910199 20309 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:31.910614 20307 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.908246 20308 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:31.912277 20307 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.912392 20308 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.914389 20307 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.914986 20307 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:31.915458 20307 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.917178 20309 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.919302 20307 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.914393 20308 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:31.920644 20308 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.921517 20308 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.923079 20309 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.923449 20308 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.924765 20308 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.919816 20307 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:31.925753 20308 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.926149 20307 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.925256 20311 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:31.927269 20311 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.929344 20314 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.929906 20314 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.930441 20307 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:31.931030 20307 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.931500 20307 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.932060 20314 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.932657 20314 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:31.933280 20314 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.933965 20308 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:31.934214 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080030b5e0 after lost signal to thread 17967
I20260709 13:18:31.934481 20308 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.934923 20308 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.935406 20314 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.935796 20309 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:31.936961 20313 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:31.936599 20311 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:31.939064 19140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.000s	sys 0.012s
I20260709 13:18:31.936601 20307 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.941236 20315 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.955372 20313 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:31.956862 19140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.001s	sys 0.014s
I20260709 13:18:31.944783 20308 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.955785 20315 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:31.959216 20219 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:31.956485 20309 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.959827 20313 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.959416 20312 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.961513 20219 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:31.964607 20315 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.966435 20219 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:31.966701 20309 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:31.960774 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 810) took 1537 ms. Trace:
I20260709 13:18:31.970805 19140 rpcz_store.cc:276] 0709 13:18:30.420992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.422120 (+  1128us) service_pool.cc:224] Handling call
0709 13:18:30.552836 (+130716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.561311 (+  8475us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:30.776031 (+214720us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.957335 (+1181304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.957402 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:31.957457 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.957555 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.957689 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18169,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":1180946,"threads_started":1}
I20260709 13:18:31.972410 20313 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.972999 20313 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.980554 20221 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:31.975641 20315 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:31.985685 20315 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.987660 20315 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:31.988265 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 1.08807e+06us
I20260709 13:18:31.981292 20221 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.997452 20309 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:31.992635 20315 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.997489 20316 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:31.998122 20315 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:31.998525 20295 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:31.997993 20309 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:31.993791 20313 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:31.998741 20316 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.001904 20295 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.010411 20324 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.010918 20324 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.011929 20295 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.013101 20324 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.014073 20295 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.014716 20295 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.016110 20295 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.016494 20295 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:31.977437 20312 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.002563 20219 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.004436 20309 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.003207 20319 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.004168 20315 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.018733 20219 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.019696 20326 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.019966 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:32.020382 19066 raft_consensus.cc:606] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:18:32.020658 19066 raft_consensus.cc:614] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:32.020298 20326 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.021255 20219 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.022850 20323 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.022389 20321 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.030295 20325 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.022488 20313 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.016918 20295 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.022327 20319 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.034433 20318 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.030192 20323 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.034319 20325 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.031052 20315 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.031811 20219 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.036005 20320 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.038048 20322 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.025913 20321 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.042534 20322 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.035694 20313 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.044705 20316 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.080123 20327 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.080261 20316 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.038419 20219 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.038439 20315 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.083436 20281 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.081063 20312 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.041211 20318 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.044173 20320 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.157724 20315 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.284060 20323 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.338313 20315 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.338605 20323 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.338896 20315 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.339207 20323 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.341295 20323 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.090642 20327 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.350261 20327 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.291144 20282 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.356606 20282 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.359519 20282 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.285931 20219 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.293203 20321 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.340714 20281 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.400251 20281 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.400815 20281 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.401461 20281 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.152109 20325 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.416643 20325 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.417202 20325 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.417701 20281 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.418219 20281 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.418666 20281 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.419399 20325 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.145411 20319 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.314124 20322 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.151468 20257 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.420867 20257 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.083802 20316 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.423218 20257 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.423954 20316 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.409319 20309 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.424719 20309 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.427161 20309 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.151331 20313 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.157383 20295 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.431593 20309 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.432168 20309 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.435712 20309 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.444397 20315 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.450863 20326 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.348380 20323 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.462831 20323 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.464803 20323 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.344707 20320 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.342489 20318 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:32.520824 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080030bf40 after lost signal to thread 19004
W20260709 13:18:32.522415 19111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.823s	user 0.026s	sys 0.037s
W20260709 13:18:32.525441 19111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.827s	user 0.026s	sys 0.037s
I20260709 13:18:32.526497 20282 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.527065 20331 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.528795 20318 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.528962 20313 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.530211 20313 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.531199 20322 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.531733 20322 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.532236 20313 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.529302 20315 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.533730 20322 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.527655 20282 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.533259 20205 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.528935 20331 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.535809 20205 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.537752 20321 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:32.538295 20205 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.538385 20316 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.538520 20321 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.539032 20316 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.540390 20321 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.540951 20321 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.541127 20316 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.541340 20321 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.533766 20315 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.552102 20315 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.552490 20321 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.530133 20318 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.542191 20257 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.553300 20257 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.542506 20331 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.542917 20329 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.543720 20245 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.543782 20332 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.556247 20332 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.556177 20245 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.558148 20332 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.558727 20245 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.544327 20320 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.545223 20323 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.545644 20282 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.559629 20323 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.543437 20281 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.546380 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.560755 19066 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.561385 20323 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.561673 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.562667 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.563161 19066 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.564021 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.547996 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.548496 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.565263 19070 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.548820 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.565681 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.566138 19068 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.566268 19072 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.549597 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.550239 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.547394 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.566920 19069 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.566996 19064 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.567114 19071 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.555022 20257 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.559551 20320 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.541725 20316 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.545820 20205 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.568979 20320 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.568806 20329 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.569370 20205 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.569136 20316 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.554919 20318 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.570881 20329 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.571180 20205 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.571866 20316 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.564710 19066 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
W20260709 13:18:32.574805 17969 debug-util.cc:398] Leaking SignalData structure 0x7b080000fc00 after lost signal to thread 19187
W20260709 13:18:32.575209 17969 kernel_stack_watchdog.cc:198] Thread 19187 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 667ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:18:32.578825 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.579077 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.579607 19067 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.579979 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.580940 20309 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.581296 20309 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.581609 20335 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.581673 20309 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.582070 20335 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.582343 20335 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.590498 20254 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.591033 20254 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.593689 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.592185 20245 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.594585 20245 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.591631 20282 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.596480 20245 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:32.597919 19215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.005s	sys 0.026s
W20260709 13:18:32.598320 19215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.793s	user 0.005s	sys 0.026s
I20260709 13:18:32.600493 20254 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.595808 20282 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.592550 20281 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.603323 20282 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.603664 20281 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.604595 20309 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.588693 20335 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.605669 20281 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.606480 20335 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.606874 20309 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.607036 20335 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.607427 20335 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.607663 20335 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.592399 20332 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.609084 20332 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.610972 20332 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.612054 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.612262 20221 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:32.616281 20335 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:32.618147 19187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.712s	user 0.010s	sys 0.014s
I20260709 13:18:32.618301 20335 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:32.618458 19187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.713s	user 0.010s	sys 0.014s
I20260709 13:18:32.618804 20335 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.619264 20335 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.625483 20309 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.628891 20335 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.629467 20335 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.629686 20309 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.632972 20309 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.630044 20335 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.636999 20335 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.640177 20337 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.640703 20337 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.643496 20337 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.644757 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.645433 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.644990 18969 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 2 to 3, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.649418 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:32.652701 20304 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:32.653002 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 59389.5us
I20260709 13:18:32.653399 20304 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.654218 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.655200 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.656268 20304 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.655764 20337 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.656400 20309 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.753319 20337 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.753407 20309 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.753822 20337 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.753944 20309 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.656533 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:32.755692 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 99250.3us
I20260709 13:18:32.756316 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.664812 20248 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.665128 20143 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.665699 20251 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.666507 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 815) took 2270 ms. Trace:
I20260709 13:18:32.669404 20172 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.669525 20212 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.669721 20211 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.673151 20292 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.669258 20234 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.673403 20340 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.685783 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.677369 20249 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.686255 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.757362 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.696686 20216 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.701256 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.719345 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.718948 19071 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.797884 19214 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.793800 20212 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.719674 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.799455 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.719995 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.701753 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:32.703928 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080017fba0 after lost signal to thread 19096
W20260709 13:18:32.803359 19001 debug-util.cc:398] Leaking SignalData structure 0x7b0800038aa0 after lost signal to thread 19171
W20260709 13:18:32.803658 19001 debug-util.cc:398] Leaking SignalData structure 0x7b0800038a80 after lost signal to thread 19172
I20260709 13:18:32.804221 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:32.804515 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080034a780 after lost signal to thread 19245
I20260709 13:18:32.781108 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:32.705725 19018 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:18:32.710778 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.711107 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.721724 19064 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.686504 20258 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.722860 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.723933 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.726171 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.727496 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.703796 19748 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:32.709647 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.710388 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.808833 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.809140 19147 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.809490 19748 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.667233 20299 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.728307 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.714490 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.712404 18968 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 107) took 2477 ms. Trace:
I20260709 13:18:32.732797 18967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 227) took 1824 ms. Trace:
I20260709 13:18:32.732919 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.811790 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.812139 19751 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.812508 19140 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.735903 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.737627 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.813350 19069 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.738207 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.739295 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.741936 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.814612 19070 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.799520 20216 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.745872 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.747867 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.750242 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.750538 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.750870 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.751696 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.757279 20335 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.757230 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.761606 20143 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.763571 19215 rpcz_store.cc:276] 0709 13:18:30.396365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.396502 (+   137us) service_pool.cc:224] Handling call
0709 13:18:30.415813 (+ 19311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.416033 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:30.804597 (+388564us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.666052 (+1861455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.666128 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:32.666185 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.666278 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.666414 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67304,"raft.queue_time_us":67969,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":1793755,"threads_started":1,"wal-append.queue_time_us":136524,"wal-append.run_cpu_time_us":1213,"wal-append.run_wall_time_us":1001247}
I20260709 13:18:32.787335 19750 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:32.689014 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.770241 20172 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.805186 19717 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:32.805682 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080024a580 after lost signal to thread 19775
W20260709 13:18:32.842572 19001 debug-util.cc:398] Leaking SignalData structure 0x7b0800262ac0 after lost signal to thread 19776
I20260709 13:18:32.844828 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.704262 20110 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.807060 19142 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.677076 20256 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:32.809964 19018 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:18:32.808717 19145 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.796809 20211 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.743918 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:32.818953 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 123795us
I20260709 13:18:32.849016 20143 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.849113 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.801004 20292 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.801105 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.823524 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:32.848289 19018 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:18:32.811252 19221 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.811584 18968 rpcz_store.cc:276] 0709 13:18:30.234884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.240193 (+  5309us) service_pool.cc:224] Handling call
0709 13:18:32.712299 (+2472106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100009,"reported_tablets":3}
I20260709 13:18:32.811648 18967 rpcz_store.cc:276] 0709 13:18:30.908630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.909515 (+   885us) service_pool.cc:224] Handling call
0709 13:18:32.732716 (+1823201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1750226,"reported_tablets":5}
I20260709 13:18:32.801059 20304 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.863299 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.830369 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.831532 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.865185 19066 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.835669 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.793864 20309 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.836675 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.836783 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.847030 20212 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.875043 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.875609 19145 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.847183 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.877641 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.849888 19146 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.851679 20172 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.852646 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.824591 20206 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:32.853648 20110 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.853972 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.854969 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.856386 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.824059 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.863025 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.823290 19065 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.836760 20335 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:32.832425 20281 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.874178 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.882339 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.974572 19072 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.974691 19146 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.829865 20299 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.913178 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.832171 19139 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.805349 20249 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:32.976586 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.876199 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.919031 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.920862 19748 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.921844 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.977995 19070 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.978910 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.922353 20110 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:32.979743 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.977451 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:32.980288 19142 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.924117 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.981055 19147 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.981128 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.922642 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.981739 19072 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.805189 20340 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.874008 20304 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.985469 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.801280 20251 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.970378 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.934190 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.932170 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:32.781219 20248 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.972534 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.041899 19215 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:33.042136 19063 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.975741 19140 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.920148 20172 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:32.982488 20342 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:32.982712 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.983664 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.916738 19216 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:32.969820 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:32.924222 20216 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:32.935236 20335 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:32.801539 20234 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:32.830590 20258 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.867483 19743 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
W20260709 13:18:32.921094 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 163792us
I20260709 13:18:33.039894 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.040512 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.991245 19750 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:33.042745 19751 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:33.049083 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.049916 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.052469 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:33.058074 19748 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:32.876051 20256 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:32.917276 20206 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:33.139370 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.140054 19221 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:33.141171 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.043207 18967 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 3, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:32.993893 19749 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:32.932955 20336 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:32.982772 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:32.973340 20281 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:32.989269 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.982882 20346 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.225697 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:32.990123 20245 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.228835 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.130101 19213 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:32.989764 20348 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.041980 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.244784 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.245359 19218 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
W20260709 13:18:33.272521 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 220093us
I20260709 13:18:33.158955 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.227263 20336 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.226325 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.134070 20342 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:33.147814 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 270461us
I20260709 13:18:33.146847 19220 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:33.075549 19068 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:33.145298 19748 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.157941 20234 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.133219 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.137836 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.241456 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.241513 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.244063 19751 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEARNER]: Advancing to term 3
I20260709 13:18:33.283351 19070 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:33.467984 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.297619 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.387890 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.387562 20350 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.482455 20350 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:33.460448 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.389478 20304 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.386075 20292 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:33.484738 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.479453 20257 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:18:33.394065 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.486950 20318 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:33.487346 20318 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:33.241576 20348 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:33.387105 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.489243 20348 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.490422 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.491776 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.401938 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.245759 19212 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:33.246151 19742 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:33.395254 20340 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.494668 20354 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.442471 20309 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.495474 20354 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:33.242614 20245 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:33.496057 20354 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.496208 20245 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:33.483794 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 336142us
I20260709 13:18:33.497852 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:33.395507 20299 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.389654 20211 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:33.503239 20336 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.385226 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.504441 20309 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.504850 20309 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.505270 20309 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.270946 19144 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:33.247570 20346 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:33.508842 20346 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.482879 20350 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.370792 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.513100 20254 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.488205 20318 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.513461 20254 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.503026 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.513922 20254 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.514964 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:33.513907 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 143191us
I20260709 13:18:33.493098 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.515892 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:33.516647 20330 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.470743 20206 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:33.360993 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.476863 19214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:33.520224 19214 raft_consensus.cc:606] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:33.516642 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.465829 20281 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.470243 20248 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.462982 20249 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.467095 20256 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:33.535379 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 56630.1us
I20260709 13:18:33.536303 19110 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:33.537256 20329 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.537618 20329 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.537966 20329 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.538789 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:33.541646 20317 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.542021 20317 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.542469 20317 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.583899 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:33.606585 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:33.613137 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 97317.3us
I20260709 13:18:33.613961 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.614941 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.616514 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.621084 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.628078 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.629326 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:33.629781 20337 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.011s
I20260709 13:18:33.630375 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.632658 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.630061 20205 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.635016 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.628082 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.620208 20206 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.620333 20281 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.639586 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.656934 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.660521 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.652346 20206 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.636837 20205 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.665134 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.651798 20281 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.669867 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.661091 20257 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.630208 20337 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.666464 20206 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.672174 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.675449 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.664366 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:33.673084 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 57034.3us
I20260709 13:18:33.681288 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:33.668711 20205 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.691946 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.694260 19035 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.705247 19747 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.707727 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.674198 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.709323 20357 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:33.710654 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.711653 20332 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.711995 20332 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.712363 20332 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.713898 20350 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.728011 20324 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.728570 20324 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.673499 20281 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.674528 20257 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:33.725268 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 183346us
W20260709 13:18:33.731068 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 192380us
I20260709 13:18:33.722517 20337 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.678064 20249 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:33.741205 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.741827 19218 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:33.732409 20324 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.729462 20342 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.750623 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.730581 20234 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:33.737488 20257 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:33.745738 20335 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.007s
I20260709 13:18:33.733641 20292 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:33.757054 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.724565 20364 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.757131 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.760833 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.755070 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.755474 20350 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.769510 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.770740 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.771883 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.788414 19751 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:33.773598 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.777261 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.778986 20281 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:33.765654 20367 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.747529 20362 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:18:33.757074 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 178477us
I20260709 13:18:33.749662 20309 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.748972 20249 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:33.790792 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.796660 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.796154 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.799791 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:33.798132 20359 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.800774 20359 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.801048 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.801196 20359 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.801332 20365 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.762746 20335 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.804333 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.763010 20234 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:33.791687 19743 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.801743 20365 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.806034 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.762982 20292 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:33.767402 20364 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.807888 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.810740 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:33.806922 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.780606 20348 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.812239 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.806205 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.793465 20367 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.817160 20367 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.792208 20245 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.816598 19221 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:33.819298 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:33.801904 20281 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.809849 20346 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.826272 19750 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.794528 20336 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.811838 20365 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.826886 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.830983 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.804893 20254 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:33.835428 20254 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.836197 20309 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.816497 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:33.838918 19063 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.838614 19746 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:33.839783 19745 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.840500 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:33.824277 20362 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.846347 20362 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.846807 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:33.847107 20362 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.848832 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 132) took 1049 ms. Trace:
I20260709 13:18:33.838825 19144 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:33.849233 20324 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:33.849236 19749 rpcz_store.cc:276] 0709 13:18:32.799082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.799204 (+   122us) service_pool.cc:224] Handling call
0709 13:18:33.848607 (+1049403us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400522454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:33.848745 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296412928}
I20260709 13:18:33.846233 20368 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.850767 20318 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.850824 20368 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:33.810374 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:33.840961 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.842626 19751 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.845760 20258 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:33.863365 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.856225 20346 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.856949 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.857197 20354 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:33.840195 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:33.870976 20336 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.871100 19742 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.846913 20249 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:33.973704 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:33.881392 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 133) took 1068 ms. Trace:
I20260709 13:18:33.851352 20324 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:33.955705 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:33.851440 20368 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.958019 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:33.957084 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:34.030771 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 269967us
I20260709 13:18:34.221587 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:34.110131 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.976402 19750 rpcz_store.cc:276] 0709 13:18:32.832290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.140770 (+308480us) service_pool.cc:224] Handling call
0709 13:18:33.141018 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.826678 (+685660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.881126 (+ 54448us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54005b5754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:33.881322 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575535488}
I20260709 13:18:34.229089 19070 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.228996 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:33.872054 20337 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.114028 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.241158 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.241036 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:34.243588 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:34.123785 20341 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:18:34.204099 20329 consensus_meta.cc:287] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.006s
I20260709 13:18:33.965430 20348 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.124455 20364 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:34.242488 20326 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.976037 19744 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:34.254622 20326 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.254833 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:34.255059 20326 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.247670 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.247967 19751 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.174994 20234 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:34.249555 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:34.197260 20245 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:34.097462 20335 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.151573 20252 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:34.173939 20354 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:34.174217 20292 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:34.248023 20247 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.242107 20342 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.262135 20369 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:33.959036 20205 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:34.230242 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 425025us
I20260709 13:18:34.071132 20251 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:34.262375 20317 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.719s	user 0.002s	sys 0.014s
I20260709 13:18:34.198921 20332 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.255852 20329 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.263262 20252 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.265316 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 284) took 1562 ms. Trace:
I20260709 13:18:34.265583 20247 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.258469 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:34.255327 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 46) took 1527 ms (client timeout 1736 ms). Trace:
I20260709 13:18:34.311507 20247 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.311574 19216 rpcz_store.cc:269] 0709 13:18:32.753744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.800056 (+ 46312us) service_pool.cc:224] Handling call
0709 13:18:34.255122 (+1455066us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b54001d5954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.255252 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65096448}
I20260709 13:18:34.312951 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.314136 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.167763 20367 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.153196 20206 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.310514 19747 rpcz_store.cc:276] 0709 13:18:32.703002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.703103 (+   101us) service_pool.cc:224] Handling call
0709 13:18:32.703343 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.705744 (+1002401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.265080 (+559336us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400685454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:34.265239 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303578368}
I20260709 13:18:34.259634 20373 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.323354 19221 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:34.318127 20373 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.331104 20205 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.334956 20252 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:34.324136 20359 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.006s
I20260709 13:18:34.310575 20317 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.349880 20359 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:34.351859 20330 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.834s	user 0.013s	sys 0.008s
W20260709 13:18:34.351080 20362 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:18:34.347486 20373 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.347616 20372 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.359630 20330 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.383276 20206 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.384460 20332 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.393332 20359 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.386128 20329 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:34.387252 20367 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:34.389251 20365 consensus_meta.cc:287] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.003s
I20260709 13:18:34.397177 20365 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.399905 20365 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.362587 20372 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.402451 20372 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.365302 20317 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:34.359790 20362 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.405373 20362 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.408811 20326 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:34.409930 20257 consensus_meta.cc:287] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.647s	user 0.015s	sys 0.000s
I20260709 13:18:34.410923 20326 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.412566 20373 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.414686 20368 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.417290 20368 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.417790 20373 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.237955 19064 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.451107 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.459856 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.460695 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.469153 19068 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:34.470358 19147 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.470556 19139 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.470738 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.471796 19145 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.263994 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:34.474838 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 210761us
I20260709 13:18:34.477406 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.478820 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.479651 19140 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.483114 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.490469 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.500218 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.514972 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.503685 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:34.512897 19070 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:34.503036 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.555421 19140 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:34.556736 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.560945 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.563279 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.566118 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.567509 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.568811 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:34.569159 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 65796.4us
I20260709 13:18:34.570180 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.571374 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.572516 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.574842 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.576092 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.572942 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.573585 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:34.577756 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.578601 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:34.579295 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.556775 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.580191 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:34.577770 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:34.590967 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 237102us
I20260709 13:18:34.592515 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:34.609370 20252 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.603751 19749 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:34.610359 19747 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.372681 20247 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.614596 19743 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.614722 20252 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.614674 20234 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:34.615399 20251 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.625440 20335 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.415359 20257 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.626019 20335 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.626645 20335 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.628306 20257 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:34.616451 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:34.635545 20326 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:34.636384 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.637037 20324 consensus_queue.cc:1059] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:34.638414 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.638646 20326 raft_consensus.cc:3055] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.639618 20258 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.612602 20205 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:34.639961 20326 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:34.640136 20258 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:34.646247 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:34.648124 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57394.4us
I20260709 13:18:34.618086 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 291) took 1813 ms. Trace:
I20260709 13:18:34.633419 20281 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.655747 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.655949 20258 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.658857 20247 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:34.696441 20352 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.276s	user 0.017s	sys 0.034s
I20260709 13:18:34.659512 19138 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.628720 20206 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:18:34.697690 19146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 844) took 1565 ms (client timeout 1745 ms). Trace:
W20260709 13:18:34.698233 19146 rpcz_store.cc:269] 0709 13:18:33.131878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.131987 (+   109us) service_pool.cc:224] Handling call
0709 13:18:34.655307 (+1523320us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:34.697606 (+ 42299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4781440}
I20260709 13:18:34.698350 20206 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.699390 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:34.701308 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 467266us
W20260709 13:18:34.660511 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 80497.1us
I20260709 13:18:34.702276 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.703687 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.705101 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.661324 20369 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.706105 20369 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:34.653393 19745 rpcz_store.cc:276] 0709 13:18:32.804782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.993949 (+189167us) service_pool.cc:224] Handling call
0709 13:18:33.133245 (+139296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.852201 (+718956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.617421 (+765220us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540062a054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:34.617832 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622335872}
I20260709 13:18:34.706300 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.654428 20281 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.707235 20281 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.707283 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:34.707903 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.667320 20361 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.708534 20361 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:34.708678 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.709909 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.709906 20361 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.711339 20361 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.713217 20304 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:34.714059 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.714968 19144 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:34.669682 20326 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.716933 20326 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.717237 20248 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.717862 20248 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:34.677029 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.723157 19216 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:34.721134 20248 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:34.727211 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.019s	sys 0.016s
W20260709 13:18:34.727658 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.019s	sys 0.016s
W20260709 13:18:34.728179 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 887218us
I20260709 13:18:34.729239 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.729091 20206 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.679338 19064 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
W20260709 13:18:34.679816 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 78027.5us
I20260709 13:18:34.641497 20205 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:34.681012 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 80494.3us
W20260709 13:18:34.682039 19212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 49) took 1927 ms (client timeout 1940 ms). Trace:
I20260709 13:18:34.694578 19141 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:34.695778 20258 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.657454 20300 raft_consensus.cc:2955] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:34.706346 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.744282 19748 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.670065 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.706540 20369 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.733150 19212 rpcz_store.cc:269] 0709 13:18:32.754607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.933469 (+178862us) service_pool.cc:224] Handling call
0709 13:18:34.681559 (+1748090us) spinlock_profiling.cc:243] Waited 69.6 ms on lock 0x7b540026a2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.681809 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160027520}
W20260709 13:18:34.735443 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 39) took 2017 ms (client timeout 1518 ms). Trace:
I20260709 13:18:34.736521 20205 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.737459 19035 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:34.741293 19071 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.747956 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.731518 20248 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.749804 19220 rpcz_store.cc:269] 0709 13:18:32.718397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.722581 (+  4184us) service_pool.cc:224] Handling call
0709 13:18:34.735103 (+2012522us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540024c054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.735271 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779701120}
I20260709 13:18:34.752633 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.750929 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 261) took 1015 ms. Trace:
I20260709 13:18:34.752972 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 843) took 1616 ms. Trace:
I20260709 13:18:34.755060 19146 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:34.754070 19748 rpcz_store.cc:276] 0709 13:18:33.735609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.735724 (+   115us) service_pool.cc:224] Handling call
0709 13:18:34.743859 (+1008135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.746606 (+  2747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.749707 (+  3101us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54006801d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.750842 (+  1135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2317669120}
W20260709 13:18:34.747043 19746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 129) took 2011 ms (client timeout 2229 ms). Trace:
I20260709 13:18:34.754326 19213 rpcz_store.cc:276] 0709 13:18:33.133567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.627781 (+494214us) service_pool.cc:224] Handling call
0709 13:18:34.690168 (+1062387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.690712 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.690773 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.690876 (+   103us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:34.690920 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.691022 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.747550 (+ 56528us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540026a2d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.749886 (+  2336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440385792}
W20260709 13:18:34.757292 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 385588us
I20260709 13:18:34.760478 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1425) took 1137 ms. Trace:
I20260709 13:18:34.764277 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.764418 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:34.765013 19064 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:34.765205 19069 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:34.758700 18967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 228) took 1849 ms. Trace:
I20260709 13:18:34.761861 19071 rpcz_store.cc:276] 0709 13:18:33.616856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.616979 (+   123us) service_pool.cc:224] Handling call
0709 13:18:34.740424 (+1123445us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:34.740828 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.751901 (+ 11073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.753852 (+  1951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4448128}
I20260709 13:18:34.769371 20205 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:34.770192 20205 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:34.771304 20205 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:34.769371 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.775180 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.760977 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:34.781121 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:34.782379 20335 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.786985 20369 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.790864 20257 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.791391 20257 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.791832 20257 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.798139 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1114) took 1056 ms. Trace:
I20260709 13:18:34.798557 19063 rpcz_store.cc:276] 0709 13:18:33.741887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.742007 (+   120us) service_pool.cc:224] Handling call
0709 13:18:33.742239 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.840599 (+ 98360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.797694 (+957095us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b54001a9854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:34.797958 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220041472}
W20260709 13:18:34.799894 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 49315.2us
I20260709 13:18:34.802142 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:34.803745 20369 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:34.803663 20257 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:34.806072 20257 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.806975 20354 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.807370 20354 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:34.807736 20354 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.758083 19746 rpcz_store.cc:269] 0709 13:18:32.735195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.735422 (+   227us) service_pool.cc:224] Handling call
0709 13:18:34.743627 (+2008205us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54006801d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.746820 (+  3193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315029376}
I20260709 13:18:34.809654 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 827) took 2006 ms. Trace:
I20260709 13:18:34.809974 19214 rpcz_store.cc:276] 0709 13:18:32.802792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.521261 (+718469us) service_pool.cc:224] Handling call
0709 13:18:34.255447 (+734186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.255613 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.255649 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.255696 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:34.255741 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.255808 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.809299 (+553491us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54001d5950. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.809482 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477366528}
I20260709 13:18:34.812147 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 862) took 1062 ms. Trace:
I20260709 13:18:34.812502 19218 rpcz_store.cc:276] 0709 13:18:33.749475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.749839 (+   364us) service_pool.cc:224] Handling call
0709 13:18:33.750076 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.810549 (+ 60473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.810577 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.810613 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:33.810640 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.811808 (+1001168us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b540043a654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:34.811865 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.811997 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138689792}
I20260709 13:18:34.813524 19071 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.815063 19064 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.815496 20249 raft_consensus.cc:993] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:18:34.817164 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:34.818585 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:34.820981 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 44006.5us
I20260709 13:18:34.824522 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.824522 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:34.826210 19746 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:34.820267 20354 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.826694 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.827095 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.827638 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.827888 19214 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:34.829030 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.829442 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.829952 20354 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:34.830917 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46189.8us
I20260709 13:18:34.831055 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.831933 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:34.833066 20373 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.826695 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.833495 20373 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:34.835253 19217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:34.835680 20295 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.836220 19217 raft_consensus.cc:606] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:34.833907 20373 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.835474 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.842132 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.842872 19214 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.845228 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.765928 18967 rpcz_store.cc:276] 0709 13:18:32.881770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.881908 (+   138us) service_pool.cc:224] Handling call
0709 13:18:34.724866 (+1842958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:33.458314 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:33.459022 (+   708us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:33.459068 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:18:33.459094 (+    26us) tablet.cc:662] Decoding operations
0709 13:18:33.459493 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:33.459580 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:33.459623 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:33.459834 (+   211us) tablet.cc:701] Row locks acquired
0709 13:18:33.459858 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:18:33.460014 (+   156us) write_op.cc:270] Start()
0709 13:18:33.460154 (+   140us) write_op.cc:276] Timestamp: P: 1783603113459964 usec, L: 0
0709 13:18:33.460182 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:18:33.468003 (+  7821us) log.cc:844] Serialized 595 byte log entry
0709 13:18:33.711002 (+242999us) op_driver.cc:464] REPLICATION: finished
0709 13:18:33.802436 (+ 91434us) write_op.cc:301] APPLY: starting
0709 13:18:33.806613 (+  4177us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:33.811630 (+  5017us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:33.818898 (+  7268us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:33.831152 (+ 12254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:33.840232 (+  9080us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:33.844563 (+  4331us) write_op.cc:312] APPLY: finished
0709 13:18:33.957383 (+112820us) log.cc:844] Serialized 23 byte log entry
0709 13:18:34.013040 (+ 55657us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:34.067170 (+ 54130us) write_op.cc:454] Released schema lock
0709 13:18:34.089732 (+ 22562us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:34.128315 (+ 38583us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:34.128364 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":8576,"child_traces":[["op",{"apply.queue_time_us":83938,"apply.run_cpu_time_us":2631,"apply.run_wall_time_us":332055,"mutex_wait_us":67653,"num_ops":1,"prepare.queue_time_us":261014,"prepare.run_cpu_time_us":3057,"prepare.run_wall_time_us":12130,"replication_time_us":250678,"thread_start_us":214993,"threads_started":2}]]}
I20260709 13:18:34.851610 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1115) took 1106 ms. Trace:
I20260709 13:18:34.850674 19063 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.856323 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 50) took 1061 ms. Trace:
I20260709 13:18:34.856693 19141 rpcz_store.cc:276] 0709 13:18:33.794695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.799537 (+  4842us) service_pool.cc:224] Handling call
0709 13:18:34.856113 (+1056576us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54002b7ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.856259 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521737472}
I20260709 13:18:34.858412 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 258) took 1362 ms. Trace:
I20260709 13:18:34.858780 19742 rpcz_store.cc:276] 0709 13:18:33.495470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.495645 (+   175us) service_pool.cc:224] Handling call
0709 13:18:33.870906 (+375261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.975387 (+104481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.858054 (+882667us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400522450. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:34.858255 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819392768}
I20260709 13:18:34.864233 20249 raft_consensus.cc:1081] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:18:34.865303 19748 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.851985 19065 rpcz_store.cc:276] 0709 13:18:33.744780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.746648 (+  1868us) service_pool.cc:224] Handling call
0709 13:18:34.850726 (+1104078us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:34.850960 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.851151 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.851183 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.851235 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:34.851268 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.851332 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.851456 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3616128}
I20260709 13:18:34.868393 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:34.869176 19147 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:34.871811 19141 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.873425 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.878798 19213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:34.879347 19213 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:34.880532 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.881806 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:34.883538 19214 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:34.883837 20295 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:18:34.889204 20110 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:18:34.892764 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:34.893608 20110 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.898942 20281 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.900035 19069 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.901343 20110 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:34.909739 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 77956.2us
I20260709 13:18:34.909606 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:34.897945 20335 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:34.915869 18967 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 3 to 4, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 1 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:34.921458 20304 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.929471 20304 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:34.935449 20304 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.941897 19717 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:34.920459 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:34.974074 20281 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:34.974553 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.975391 19212 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:34.976332 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.984701 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:34.977015 20295 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:34.985985 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 90867.3us
I20260709 13:18:34.986140 20295 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:34.977262 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.987389 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:34.988003 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.988749 20354 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.989045 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.989167 20354 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:34.989552 20354 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.977790 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.990981 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.992018 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:34.993000 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.993178 20363 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:34.993975 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.981016 20234 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:34.995055 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.995328 20234 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.995791 20234 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:34.978026 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.996806 20234 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.997488 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.977558 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.998306 20234 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.999249 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.983868 20335 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.999910 20335 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.000308 20335 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.000358 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.977324 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.994004 19220 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.002141 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:34.977633 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.003299 19038 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:34.983475 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 51718.2us
I20260709 13:18:35.004783 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:34.977334 19214 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.985750 19215 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:35.006924 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:34.983641 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.996002 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:35.011487 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.014635 20361 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:35.015362 19138 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.021483 20335 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.021592 20206 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.022513 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.023334 20361 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.023682 20335 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:35.024420 20335 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:35.027115 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 56527.2us
I20260709 13:18:35.026592 20359 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:35.033488 20295 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:34.976824 20304 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.039212 20205 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.039705 20300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40740 (request call id 74) took 4712 ms. Trace:
I20260709 13:18:35.042428 20304 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:35.047145 20295 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.043387 20300 rpcz_store.cc:276] 0709 13:18:30.327089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.329038 (+  1949us) service_pool.cc:224] Handling call
0709 13:18:30.384135 (+ 55097us) log.cc:844] Serialized 494 byte log entry
0709 13:18:35.039594 (+4655459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":940,"raft.run_wall_time_us":1224}
W20260709 13:18:35.052471 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 109945us
I20260709 13:18:35.064926 19038 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.055037 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:35.056133 20249 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.057832 20363 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:35.057835 20354 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.059340 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:35.061705 20367 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:18:35.066623 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 61950.8us
I20260709 13:18:35.071111 20206 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:35.070528 19748 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:35.079445 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e7ecd70203b43ca9b21a47be75683e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.063911 20373 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.079988 20258 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:35.080437 20258 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:35.081700 20373 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:35.078130 19746 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.085053 19145 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.090428 20369 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.090826 20369 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.091768 20369 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.093327 20369 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.093528 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.095098 20373 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.095511 20373 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:35.095876 20373 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.101504 20361 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:35.080797 20258 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.087854 20205 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.109094 20257 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.110589 20376 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.110944 20376 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:35.111824 20376 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.113595 20376 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.115113 20295 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.116799 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.120388 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:18:35.121694 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 58296us
I20260709 13:18:35.120512 19140 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:35.122494 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.131795 19717 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.134565 20304 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.137159 20248 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.137532 20248 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.138252 20335 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.138417 20248 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.139612 20248 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.087738 20206 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.132802 20324 consensus_queue.cc:1059] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:18:35.143196 20326 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.130579 20257 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.147195 19218 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.125429 20373 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.159809 19141 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.148532 20304 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:18:35.159061 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.161551 19069 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.148661 20326 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:35.164695 19140 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.166148 19066 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.167073 19064 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.167448 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.169955 19071 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.170583 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.171056 19071 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.173167 19140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47596
I20260709 13:18:35.174441 19139 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.173799 19140 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.175519 19140 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.175631 19145 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.176117 19143 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:35.181356 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.181434 20326 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.182446 19140 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:35.189085 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57352.4us
I20260709 13:18:35.189649 19140 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:35.193022 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.193739 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.194594 20363 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.194965 19717 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:35.161715 20335 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.198593 19138 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.204483 20206 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:35.205197 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.198534 20361 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.205086 20388 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.205132 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.214751 20351 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.215425 20351 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.205631 20389 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.220216 20351 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:35.220788 20335 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.206235 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:35.221494 20388 raft_consensus.cc:697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:35.206398 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.222445 20388 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.223616 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.224450 20256 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.207551 20234 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.224833 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.225064 20234 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.225118 20256 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.225733 20300 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.226089 20234 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.227135 20234 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.228062 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.228840 20300 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.229311 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.229558 20258 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.230062 20300 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.231130 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.231437 20258 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:35.231937 20300 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.232342 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.233250 20354 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:35.233904 20359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36450 (request call id 72) took 2516 ms. Trace:
I20260709 13:18:35.228714 20326 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.206987 20304 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.206427 20248 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:35.217116 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 62866us
I20260709 13:18:35.218411 19038 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.219312 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.221140 20205 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.161017 20367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36450 (request call id 71) took 2438 ms. Trace:
I20260709 13:18:35.235558 20351 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.234333 20359 rpcz_store.cc:276] 0709 13:18:32.717311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.719858 (+  2547us) service_pool.cc:224] Handling call
0709 13:18:33.397597 (+677739us) log.cc:844] Serialized 494 byte log entry
0709 13:18:35.233813 (+1836216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41603,"raft.run_cpu_time_us":936,"raft.run_wall_time_us":935,"thread_start_us":243688,"threads_started":2,"wal-append.queue_time_us":225647,"wal-append.run_cpu_time_us":1684,"wal-append.run_wall_time_us":1016074}
I20260709 13:18:35.235742 20304 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.236620 20373 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:35.237753 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.236661 20248 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.238483 20354 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:35.238643 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.240370 20367 rpcz_store.cc:276] 0709 13:18:32.716950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.717440 (+   490us) service_pool.cc:224] Handling call
0709 13:18:32.878339 (+160899us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4c004e7f40. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101856a20 00007f6101867a29 00007f610182d644 00007f6101854f2d 00007f6101854b93 00007f61034e31af 00007f61034e2f3e 00007f6103568888 00007f610358575c 00007f610358676a 00007f610358591b
0709 13:18:32.878907 (+   568us) log.cc:844] Serialized 494 byte log entry
0709 13:18:33.629447 (+750540us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b54000cb0a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610350ab26 00007f610350449a 00007f6103503714 00007f61034e3eaa 00007f61034ead53 00007f61034eacd9 00007f61034eac69 00007f61034eac31 00007f61034e9dfd 000000000038f354
0709 13:18:33.817563 (+188116us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b54000cb0a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103503142 00007f61034e3eaa 00007f61034ead53 00007f61034eacd9 00007f61034eac69 00007f61034eac31 00007f61034e9dfd 000000000038f354 000000000038f199 00007f610049d475
0709 13:18:34.695540 (+877977us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:35.154784 (+459244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6093,"raft.queue_time_us":9677,"raft.run_cpu_time_us":51880,"raft.run_wall_time_us":1211295,"spinlock_wait_cycles":52656512,"thread_start_us":198766,"threads_started":1,"wal-append.queue_time_us":422034}
I20260709 13:18:35.250602 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 716382b8056843a8ac2701a2242b5834 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.250520 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.252614 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 736ce293ef884a9d97ae4efb914752f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.253957 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:35.238643 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:35.243251 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48491us
I20260709 13:18:35.254962 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:35.257833 20324 raft_consensus.cc:3055] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.258404 19746 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.259511 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.260020 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.260176 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:35.260429 19067 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:35.261363 20206 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.261890 20206 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:35.262388 20206 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.262676 19742 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.264019 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:35.257862 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:35.264920 20359 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:35.258333 20324 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:35.265262 20359 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.266109 20359 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:35.266258 19745 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.266459 20324 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.260717 19218 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:35.267748 20324 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.269249 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:35.270475 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.270519 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:35.270305 18968 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.271232 19069 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:35.272308 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.247548 20248 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:35.268715 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:35.273156 19067 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:35.273722 19746 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:35.247820 20304 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:35.249235 20295 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.271792 18968 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.278100 18968 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 1 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.278733 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.279662 20326 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:35.280292 20304 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.281545 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.282919 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.283663 20205 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.284090 19038 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.284425 20205 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:35.284855 20304 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.285037 20205 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.286144 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.288056 20359 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:35.288793 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:35.289179 20354 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.289829 20354 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:35.290235 20304 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.290942 20354 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.292150 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.294448 20367 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:35.294819 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56202.3us
I20260709 13:18:35.295600 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.295769 20373 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.296108 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:35.297253 19745 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:35.297742 20367 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.297204 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:35.298894 20304 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.298682 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:35.299285 20304 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:35.299726 20304 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.299950 20367 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.295634 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.303076 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:35.305269 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.306666 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.313512 19069 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:35.315987 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.321508 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:35.322100 19745 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.324117 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.320266 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.322965 20369 consensus_queue.cc:1059] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:35.334380 20369 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.334740 20369 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.335497 20369 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.336539 20369 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.320298 20248 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.337141 20248 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:35.337502 20248 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.337536 19113 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.338364 20376 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.338528 20361 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.340291 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.341127 19070 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:18:35.341235 20364 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.346629 19745 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.347980 20304 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.314862 20373 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.348723 20300 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.352442 20258 raft_consensus.cc:993] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: : Instructing follower 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:35.352643 20249 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.352860 20258 raft_consensus.cc:1081] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Signalling peer 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:35.353186 20249 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.349820 20351 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:35.354678 20351 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.354409 20249 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.355055 20351 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.356755 20326 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.356962 20351 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.358403 20351 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.360786 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e7ecd70203b43ca9b21a47be75683e4 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36450
I20260709 13:18:35.364476 20249 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.367048 20248 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.313915 20359 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:35.372427 20367 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.374722 19113 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.375337 20300 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.376607 20256 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.377911 20258 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.378542 20304 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:35.379717 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 53428.8us
I20260709 13:18:35.314320 20205 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:35.380599 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 64671.3us
I20260709 13:18:35.383994 20373 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.405313 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.388693 20364 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:18:35.379089 20380 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:18:35.411736 19113 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.407042 20361 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:18:35.420225 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.402083 20248 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:35.424150 19141 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:35.415273 20373 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.407194 20257 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:18:35.408109 20351 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:18:35.410298 20376 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:18:35.433069 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.435813 20295 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.432054 20359 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.438493 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.428974 20380 consensus_queue.cc:1243] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:35.451300 20326 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.457531 20380 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.457960 20380 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.458813 20380 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.460095 20245 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.461774 20399 tablet_replica.cc:333] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:18:35.468434 20399 raft_consensus.cc:2243] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.469499 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 716382b8056843a8ac2701a2242b5834 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:35.476331 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.491040 20245 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.454677 20364 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:35.493444 19218 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:35.493714 20392 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:18:35.498315 20206 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.501456 20399 raft_consensus.cc:2272] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:35.503120 19067 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
W20260709 13:18:35.503892 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47075.1us
I20260709 13:18:35.501902 20388 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:35.500833 20206 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:35.509707 20401 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.527743 20388 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:35.528640 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 736ce293ef884a9d97ae4efb914752f6 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47584
I20260709 13:18:35.530476 20388 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:35.525579 20403 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.531531 20403 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:35.531368 20388 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.532754 20388 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.532626 20403 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.534516 20403 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.542060 20404 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.542430 20404 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:35.541481 18967 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.543233 20404 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:35.544584 20396 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:35.548928 20399 ts_tablet_manager.cc:1916] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.549361 20256 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.551450 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.544654 20404 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.543838 18967 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.516034 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:35.553536 20400 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.561884 20400 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:35.562741 20400 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.564030 20400 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:35.567945 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 51997.7us
I20260709 13:18:35.569131 20401 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:35.570513 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52743.4us
I20260709 13:18:35.570907 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.557725 20256 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.568439 18967 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.575171 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.566740 20249 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.575743 19218 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
W20260709 13:18:35.576925 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 156735us
I20260709 13:18:35.576941 20249 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.579030 20249 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.580142 20249 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.581069 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.576787 20401 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:35.583498 20401 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:35.585000 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.585528 20248 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.585945 20248 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.586232 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.586706 20248 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.575641 20408 tablet_replica.cc:333] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:18:35.591795 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.594848 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.595715 19212 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.601135 20247 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.602043 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.602618 19213 raft_consensus.cc:2376] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2. Re-sending same reply.
W20260709 13:18:35.603785 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.604341 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.606599 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.607178 19221 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:35.607205 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.610347 20373 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.608690 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.618219 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.618916 19216 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.592756 20248 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.619184 20256 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.620620 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.620918 20256 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.621307 19217 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.622191 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.618256 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.623271 19219 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:35.623947 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.624280 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.625144 19220 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:35.626045 20205 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:35.627579 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.628147 19213 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:35.628412 19215 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:35.619827 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.629607 19216 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.622279 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.629994 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.631608 20257 raft_consensus.cc:3055] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.632030 20257 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:35.632972 20257 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.634296 20257 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:35.637710 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 258396us
I20260709 13:18:35.640933 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:35.641194 20295 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.642269 20300 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.643136 20380 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.646486 20351 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.646858 20351 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.647224 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.650859 19220 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.651103 20304 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.651432 20304 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.652012 19213 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.652123 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.652174 20304 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.647653 20351 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:35.655040 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.655797 20410 tablet_replica.cc:333] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:18:35.657086 20410 raft_consensus.cc:2243] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.657862 20410 raft_consensus.cc:2272] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:35.658658 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.660645 19221 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.665988 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.666661 19220 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:35.666735 19184 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.668365 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.671314 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.665807 20400 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.675401 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.678515 19145 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.674418 18969 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.681939 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.682838 19213 raft_consensus.cc:2393] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:35.684417 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.701395 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.701702 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.702019 19213 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:35.702122 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.702590 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.703063 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.703596 19215 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:35.701395 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:35.704073 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.704932 19217 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.705085 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.705391 19217 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.708475 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.708345 19217 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.709043 19215 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:35.709465 19217 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.709867 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.710879 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.711673 20351 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.705682 19213 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:35.664500 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.713176 20304 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.717731 19214 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:35.718441 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.718201 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 51539.5us
W20260709 13:18:35.719269 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 50977.2us
I20260709 13:18:35.722090 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.726841 19145 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.730188 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.723573 20409 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.731328 20406 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.732380 20406 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.732735 20406 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.733450 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.678112 20234 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:18:35.741452 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.762193 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.764290 19145 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.740513 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.740031 20409 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.745216 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.749375 20413 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:35.749581 20414 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:18:35.752326 19220 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:35.721292 20400 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:35.744248 20406 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.757953 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.767648 19214 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:35.768471 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.771047 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.773465 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.777150 19215 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.773887 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.769033 20408 raft_consensus.cc:2243] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.782473 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:35.768146 20409 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.785190 20409 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.785550 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.785815 19140 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.785615 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:35.788194 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:35.788429 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.789474 19066 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.783526 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:35.790768 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:35.790900 19216 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:35.791216 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:35.791664 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.792215 19146 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.792373 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.793210 19069 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:35.793414 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.793978 19068 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.797472 19064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:18:35.797659 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.798035 19064 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.798431 19064 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.798635 20373 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:35.799041 20373 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.799377 20373 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.797784 19063 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.789196 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.778995 20394 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.801991 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.803875 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:35.809847 19063 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.802192 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:35.780033 20256 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.813087 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:35.813633 19220 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.815562 19067 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.816968 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.818856 19217 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:35.819100 19221 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:35.821045 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 63164.7us
I20260709 13:18:35.821300 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.821077 19215 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:35.821959 19139 raft_consensus.cc:2376] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2. Re-sending same reply.
I20260709 13:18:35.822041 20394 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.822270 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.824913 20408 raft_consensus.cc:2272] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:35.825928 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:35.831899 19213 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:35.833321 20413 raft_consensus.cc:2810] Couldn't start leader election after successful pre-election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:18:35.840269 19063 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.841688 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.848955 19068 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:35.842790 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.850104 20364 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.850620 20364 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:35.850867 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.851109 20364 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.852061 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.852761 20407 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.853035 20405 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.845033 20404 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.845770 20408 ts_tablet_manager.cc:1916] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.846333 20400 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.829452 20406 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.847790 19218 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:35.854123 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.854933 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.826361 19745 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:35.857430 20404 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.863071 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:35.864651 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.865162 20257 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.865733 20411 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.871126 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.872331 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.871340 20411 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:35.869150 20404 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.875102 20257 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:35.877784 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.878840 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.879338 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.879650 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.878521 20257 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.898662 20257 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.881443 20401 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.880980 19217 raft_consensus.cc:2955] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:35.893255 19146 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:35.897377 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.902463 19067 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.910161 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.912828 19742 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.912532 20373 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:35.913116 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:35.915454 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.918243 20354 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.919332 19069 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.920166 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.914783 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.921042 19063 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:35.922320 19070 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.912643 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.923123 19066 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:35.935528 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.936133 19063 raft_consensus.cc:2376] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2. Re-sending same reply.
I20260709 13:18:35.907312 20401 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:35.943706 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.945187 19067 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.937659 19068 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.937546 19139 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:35.930279 20407 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.948153 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:35.950795 19067 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:35.952836 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.908293 20256 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:35.954008 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.954725 19213 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:35.962606 20354 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:35.962647 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:35.963799 20354 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:35.940689 19144 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:35.946681 20401 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.969578 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.914080 19714 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.960706 20425 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.979216 20410 ts_tablet_manager.cc:1916] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.966060 20376 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.982723 20403 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.983088 20373 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:35.988220 19145 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.988493 19072 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:35.956003 20407 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:35.992275 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.961318 20247 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.969302 19065 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.001849 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:35.981386 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 67373.4us
I20260709 13:18:36.001818 20367 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.967283 20205 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.016840 19063 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:36.009701 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:36.018891 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 56529.3us
I20260709 13:18:35.991737 20394 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.021035 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:36.021200 19144 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:36.022337 20364 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.022670 20409 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.024930 20405 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.025310 20248 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.026782 19219 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:36.030604 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.009249 19068 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
W20260709 13:18:36.031243 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 61649.3us
I20260709 13:18:36.016024 20407 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.037890 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:35.991696 20404 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.032352 20380 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.048040 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:36.036374 20324 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.037075 20394 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:36.068527 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.053929 19145 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.055784 20110 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:36.052897 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.048079 20248 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:36.062287 20409 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.062597 20411 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.070310 20411 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.057226 20354 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.068733 19113 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:36.077046 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:36.077106 19142 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.035171 19064 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:36.081622 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 64836us
I20260709 13:18:36.080931 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.085060 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.058995 20425 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.088222 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.089609 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.092986 20434 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.093214 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:36.095366 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:36.095407 19742 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.067301 20304 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:36.098467 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:36.101033 19063 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.101313 19113 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:36.107029 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 54230.8us
I20260709 13:18:36.108057 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.120046 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:36.091984 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 71038.3us
I20260709 13:18:36.105638 20247 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.132007 20247 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.128584 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.113161 20428 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.133636 19064 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.105754 20300 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.098977 20249 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.139374 20205 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.112825 20406 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.141270 20406 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.142927 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:36.143186 19142 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.143468 19145 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.144469 20399 ts_tablet_manager.cc:1929] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:36.132428 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:18:36.145740 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47336.3us
I20260709 13:18:36.097126 20256 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.097247 20234 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.149143 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.078662 20405 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:36.150123 19145 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:36.121832 18966 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.092161 20354 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:36.096143 20434 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.105726 20258 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.153455 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:36.106143 20373 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.105959 19143 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:36.165671 20405 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.166337 20405 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.166661 20405 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.167465 20405 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.132493 20247 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.169699 20247 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.173779 20295 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.174772 20295 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:36.175113 20295 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:36.168608 20405 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.175467 20295 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.143245 20406 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:36.152570 20400 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:36.219537 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 58759.4us
I20260709 13:18:36.222276 20400 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.173806 20394 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.229207 20407 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.226754 20400 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.230321 19140 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.230321 19145 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.231384 20407 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.148895 20254 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:18:36.149159 20205 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:18:36.160248 20399 log.cc:1199] T 7e7ecd70203b43ca9b21a47be75683e4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/7e7ecd70203b43ca9b21a47be75683e4
I20260709 13:18:36.146869 20206 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:18:36.177572 20376 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:36.098906 20426 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:18:36.176976 20234 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:18:36.189779 20258 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:36.242233 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:36.248291 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 91707.8us
I20260709 13:18:36.234391 20304 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:36.253285 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.253827 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.172823 20257 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.238849 20364 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.255506 19215 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.260577 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.261337 19220 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.158972 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:36.257364 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.241344 20300 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:36.247409 20376 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:36.249501 20435 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.259207 18967 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.296067 19215 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
W20260709 13:18:36.313294 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 159900us
I20260709 13:18:36.320783 19220 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:36.246701 20409 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:36.328262 19146 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.262217 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:36.265465 20436 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.249922 20407 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:18:36.320981 20376 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.408800 19219 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
W20260709 13:18:36.411695 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 260939us
W20260709 13:18:36.459028 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 216849us
I20260709 13:18:36.413093 20205 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:36.464305 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:36.464740 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 206229us
I20260709 13:18:36.413244 20258 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.408119 20436 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.420979 20206 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.422214 20257 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.265844 20413 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.140s
I20260709 13:18:36.485049 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:36.429023 19064 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:36.429924 20304 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.431908 19212 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.435986 20401 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.314198 20354 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.447748 20399 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36450 (request call id 73) took 1087 ms. Trace:
I20260709 13:18:36.334898 20404 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.449899 20110 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.513751 20110 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.451289 20254 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.451948 20256 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.297189 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:36.405462 20431 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:18:36.502326 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:36.457934 19142 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.512058 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:36.465627 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.484397 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:36.402904 20435 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.429150 20434 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:36.335587 20300 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.502925 19070 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:36.498665 20443 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.562152 20443 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.562400 20401 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.537426 20324 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.563212 20443 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.566329 20408 ts_tablet_manager.cc:1929] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:36.566782 20408 log.cc:1199] T 716382b8056843a8ac2701a2242b5834 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/716382b8056843a8ac2701a2242b5834
I20260709 13:18:36.484158 20205 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.522135 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:36.575001 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52972.5us
I20260709 13:18:36.456925 20367 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.474119 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:36.539270 20432 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.582368 20432 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.539140 19742 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:36.535362 20110 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.515761 20254 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.500430 20206 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.546744 20425 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.546887 20435 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.548419 20441 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.517632 20256 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:36.553081 20248 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.554265 20300 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:36.554904 20295 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.543643 20436 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.596859 20432 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:36.598379 20295 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.598196 20256 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.581766 20249 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:36.599514 20256 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.599399 20249 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.581858 20205 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:36.589198 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 456888us
I20260709 13:18:36.564704 20443 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.549393 20434 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.595007 20110 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.512271 20399 rpcz_store.cc:276] 0709 13:18:35.360277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.360506 (+   229us) service_pool.cc:224] Handling call
0709 13:18:35.461326 (+100820us) ts_tablet_manager.cc:1151] Deleting tablet 7e7ecd70203b43ca9b21a47be75683e4
0709 13:18:35.461407 (+    81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:35.914286 (+452879us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:36.144335 (+230049us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:36.447654 (+303319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8543,"tablet-delete.queue_time_us":94858,"thread_start_us":55360,"threads_started":1}
I20260709 13:18:36.608242 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:36.584283 20406 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:36.610483 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 145125us
I20260709 13:18:36.612653 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:36.617123 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:36.621686 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:36.594367 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:36.615612 18969 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.628217 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:36.612362 20406 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.615461 20424 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.613850 20205 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.634407 20446 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:36.646894 20409 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.630767 20442 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.636251 20206 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:36.637393 20408 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40740 (request call id 75) took 1182 ms. Trace:
I20260709 13:18:36.620584 20361 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.646054 20445 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.646420 20295 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:36.657364 20445 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.658595 20445 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.634940 20444 raft_consensus.cc:3055] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.653592 20405 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.634053 20406 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.656172 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:36.647363 20409 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.666755 20442 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.633287 20373 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:36.673739 20367 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.630971 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.655027 20249 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:36.632284 20428 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.675421 20444 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:18:36.699786 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.678356 20367 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.677336 20405 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.678335 20206 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:36.681274 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:36.707849 19745 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:18:36.708029 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 85585.8us
I20260709 13:18:36.694132 20441 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.705457 19070 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.649227 20254 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.710752 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.716042 20254 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.716292 19746 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:36.715844 20442 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.716827 19065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:18:36.717767 19068 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.718652 20376 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:36.719751 20446 consensus_queue.cc:1175] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "55991c1f7f474a9888725d00438d8a83" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:18:36.720430 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:36.720512 20249 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.698519 20432 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.701129 20401 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.705523 20453 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:18:36.729863 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 234717us
I20260709 13:18:36.675524 20434 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.730408 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:36.741509 20441 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:36.737314 19065 raft_consensus.cc:606] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:36.736910 20407 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.764184 19065 raft_consensus.cc:614] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:36.765543 20407 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.721576 20405 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.741842 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:36.752785 19146 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:36.696756 20400 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:18:36.735440 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:36.743947 20249 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.754251 20434 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.755412 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:36.757201 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:36.654991 20408 rpcz_store.cc:276] 0709 13:18:35.468913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.469178 (+   265us) service_pool.cc:224] Handling call
0709 13:18:35.575209 (+106031us) ts_tablet_manager.cc:1151] Deleting tablet 716382b8056843a8ac2701a2242b5834
0709 13:18:35.575269 (+    60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:35.824314 (+249045us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b540024c054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103592362 00007f6106f7d34c 00007f61085a060a 00007f61085d12d0 00007f61085b783d 00007f61085b77e9 00007f61085b7779 00007f61085b7741 00007f61085b696d 000000000038f354
0709 13:18:36.138046 (+313732us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:36.566206 (+428160us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:36.637306 (+ 71100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57026,"spinlock_wait_cycles":51237120,"tablet-delete.queue_time_us":105194,"thread_start_us":94527,"threads_started":1}
I20260709 13:18:36.768580 20110 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.745849 20401 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.794571 19069 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:36.767290 20257 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:36.746583 20428 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.803059 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:36.803366 20451 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:36.803874 19742 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:36.805397 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 7e7ecd70203b43ca9b21a47be75683e4 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:36.811442 20295 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:36.817433 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:36.815033 20249 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:36.814060 20369 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.817734 20388 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.821468 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:36.822467 20388 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:36.823434 20388 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.819058 19069 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:36.811085 19143 raft_consensus.cc:2393] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:36.816994 19212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:36.832147 20110 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:36.817243 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 88174.4us
W20260709 13:18:36.848209 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.852195 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.858891 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.865911 19218 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.822184 19146 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:36.865414 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:36.911087 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 79537.6us
I20260709 13:18:36.914475 19069 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:36.918172 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:36.918900 19069 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:36.895478 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:36.829825 20410 ts_tablet_manager.cc:1929] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:36.926569 20110 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:36.926741 19220 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:36.927096 20110 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.927397 20110 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:36.927593 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:36.928236 20110 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.943167 19069 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:18:36.944478 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 49117.7us
I20260709 13:18:36.894260 20413 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.948218 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:36.893919 20435 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.925777 20424 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.957046 19219 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:36.957957 19220 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:36.958977 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.949307 20410 log.cc:1199] T 736ce293ef884a9d97ae4efb914752f6 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/736ce293ef884a9d97ae4efb914752f6
I20260709 13:18:36.946244 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.954941 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.893510 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 716382b8056843a8ac2701a2242b5834 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:36.925588 19212 raft_consensus.cc:606] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:36.968164 19212 raft_consensus.cc:614] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:36.968219 18957 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 101849us
I20260709 13:18:36.829553 20257 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:18:36.949009 20380 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:36.943192 20404 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:18:36.955942 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:36.850113 20451 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.979285 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:36.984615 19219 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:36.962961 20376 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:36.955564 20445 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:36.964674 20453 raft_consensus.cc:3055] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:36.964828 20364 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:36.952625 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:36.972865 20428 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.959712 20435 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:36.976402 20369 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.000190 19220 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:37.000614 20463 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:18:37.002306 20400 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.973045 20380 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.006457 19219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:36.956488 20413 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:36.994800 19068 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:37.045686 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.995393 20453 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:37.004442 20364 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.049178 20234 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.049790 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 105899us
I20260709 13:18:37.050810 20324 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:37.047040 20254 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.053403 20380 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.054276 20410 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47584 (request call id 75) took 1569 ms. Trace:
I20260709 13:18:37.047117 19219 raft_consensus.cc:606] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:37.099546 19219 raft_consensus.cc:614] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:37.098658 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.100749 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 304192us
I20260709 13:18:36.854489 20441 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.094156 20364 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.976995 20424 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:37.130205 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.149740 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:37.095276 20400 consensus_queue.cc:1243] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:18:37.111146 20443 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.005s
I20260709 13:18:37.128758 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:37.182044 20458 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.244402 20447 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.245121 20447 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.245606 20447 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.244473 20458 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.253135 20458 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.183089 20409 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.253738 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:37.254410 19742 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:37.185698 20354 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.186559 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:37.185412 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.191743 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:37.192759 19748 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:37.193638 20304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.036s	sys 0.029s
W20260709 13:18:37.256265 20304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.037s	sys 0.029s
I20260709 13:18:37.256826 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:37.199682 20367 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.258637 20367 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.261780 20447 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.217334 20248 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.237612 19213 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.254447 20409 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.186291 20446 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.208511 20457 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.373291 20472 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.373572 20447 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.373765 20457 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:18:37.264868 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 78372.9us
I20260709 13:18:37.376020 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:37.111368 20401 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.378156 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:37.378793 19147 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.378875 19141 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:37.269318 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 287296us
I20260709 13:18:37.098973 20234 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:37.274724 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 155490us
I20260709 13:18:37.273650 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:37.275573 19142 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.101577 20254 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.281178 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:37.287655 19146 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.159662 20324 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:18:37.394032 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.406114 19142 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:37.268285 20373 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.291031 20442 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:37.292939 20458 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.287817 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:37.412081 19218 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.373461 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:37.374358 20447 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.381102 20470 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:18:37.382583 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:37.149708 20258 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:37.117616 20453 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:37.389503 19065 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:18:37.390038 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:37.395150 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 121596us
I20260709 13:18:37.451594 20465 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.401233 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.452364 20465 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.415129 19748 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.390846 20413 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:37.415094 20434 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 13:18:37.408727 20469 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:37.432065 19141 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:37.413697 20458 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:37.407094 20406 consensus_meta.cc:287] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.002s
I20260709 13:18:37.478997 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.479576 19144 raft_consensus.cc:2376] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3. Re-sending same reply.
I20260709 13:18:37.479857 19748 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:37.428755 20300 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:37.429634 20304 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:37.488638 20465 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.439229 20324 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:37.489818 20324 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.490168 20324 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:37.491051 20324 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.492197 20324 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.431623 20447 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.495514 20447 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.430622 20400 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:18:37.477190 20458 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.427456 20424 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.445269 20457 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.506384 20404 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:37.506950 20404 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.504630 19071 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.449191 19218 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:37.453141 19064 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:37.370442 20463 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:37.454150 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 78204.7us
I20260709 13:18:37.373908 20472 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.518326 20110 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.458629 19068 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:37.446702 20258 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.458658 20425 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.461174 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.461705 20436 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:37.461786 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 44032us
I20260709 13:18:37.464033 20442 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.099436 20410 rpcz_store.cc:276] 0709 13:18:35.501106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.513051 (+ 11945us) service_pool.cc:224] Handling call
0709 13:18:35.654365 (+141314us) ts_tablet_manager.cc:1151] Deleting tablet 736ce293ef884a9d97ae4efb914752f6
0709 13:18:35.654891 (+   526us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:36.463530 (+808639us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:36.818726 (+355196us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:37.054142 (+235416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":118633,"thread_start_us":43167,"threads_started":1}
I20260709 13:18:37.467276 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.417376 20295 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.534408 20425 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:37.541504 20451 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.437923 20453 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.438992 20369 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.472853 19035 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:37.428030 20234 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.433184 20254 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.504048 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.503602 19065 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.508473 20300 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.513648 20404 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:37.552516 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 79766us
I20260709 13:18:37.553464 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:37.556353 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 736ce293ef884a9d97ae4efb914752f6 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:37.521420 20400 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:18:37.386045 20446 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.514541 20463 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.518168 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.530591 19146 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:37.531141 19063 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.485260 20435 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.556423 20254 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.561389 20295 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.531884 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.573014 20295 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.573391 20295 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.546568 20444 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.574748 20472 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.532765 19213 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:37.541684 20425 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.530103 20465 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.548388 19067 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:37.499601 20304 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.534891 20442 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:37.587699 20442 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.549800 20369 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.590147 20369 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:37.590991 20442 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.500118 20406 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.554546 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:37.383649 20407 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.572615 20457 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.585103 20465 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.586001 20300 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:37.596534 20254 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:37.600637 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.551867 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:37.602130 20254 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:37.602412 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57353.1us
I20260709 13:18:37.603154 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:37.603051 20254 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.603956 20424 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.604435 20424 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:37.605410 20424 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.606303 20465 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.607285 20354 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.607796 20354 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:37.607985 20258 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:37.608469 19063 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:37.608649 20354 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.609109 20443 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:37.609766 20443 consensus_queue.cc:1243] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:37.611202 20444 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.598163 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:37.613636 20472 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.614717 20465 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.623538 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.624235 19142 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:37.629215 20110 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.630158 20110 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.613981 20258 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.625702 20465 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.626295 20435 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.633306 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.536692 20458 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:37.649670 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.662195 19072 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:37.636240 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:37.671727 20465 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.646386 20405 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.627002 20472 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.640866 20445 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.642642 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:37.647491 19138 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:37.674995 20406 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.640919 20435 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.683058 19066 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:37.687556 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:37.726588 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.636799 20110 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.727293 20110 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:37.693979 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57827.1us
W20260709 13:18:37.695878 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.643620 20407 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:18:37.704701 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.704939 19070 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.705353 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1138) took 1236 ms. Trace:
I20260709 13:18:37.705039 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.696322 20463 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.641234 20258 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.695917 20206 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.735591 19142 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:37.716733 19185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.029s	sys 0.025s
W20260709 13:18:37.758106 19185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.030s	sys 0.025s
I20260709 13:18:37.698911 20367 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.734707 19072 rpcz_store.cc:276] 0709 13:18:36.464478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.464612 (+   134us) service_pool.cc:224] Handling call
0709 13:18:37.700448 (+1235836us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003a07d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:37.700585 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554405120}
I20260709 13:18:37.733508 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.727643 20110 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.760289 20110 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.698803 20476 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.763075 19215 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:37.727530 20257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.095s	sys 0.229s
I20260709 13:18:37.767863 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:37.773972 19219 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:37.763531 20480 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.766212 19218 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.734151 20388 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.727820 20435 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.771733 19220 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:37.764380 20476 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.766508 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:37.764890 20367 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.783363 19220 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:37.763825 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.781482 20477 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:18:37.756515 20443 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:18:37.772905 20257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.095s	sys 0.229s
I20260709 13:18:37.721287 20405 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.723915 20445 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.771037 20406 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.781095 19215 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:37.787534 19220 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.779763 20463 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.771698 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 136794us
I20260709 13:18:37.801344 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:37.801985 19215 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:37.775707 20400 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:18:37.782639 20476 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.802842 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:37.803560 19215 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:37.804397 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:37.805889 19215 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:37.756335 20407 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.764832 20206 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.756142 20465 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:18:37.782512 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:37.789083 19214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.002s
I20260709 13:18:37.805653 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:37.797710 20364 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:18:37.788235 20304 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:37.805485 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:37.807287 19215 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:37.809882 19214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.009s	sys 0.002s
I20260709 13:18:37.789113 19219 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.810626 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:37.821882 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:37.813014 19187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.052s
I20260709 13:18:37.826056 19748 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:18:37.825464 19184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.020s	sys 0.050s
W20260709 13:18:37.828236 19187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.011s	sys 0.052s
W20260709 13:18:37.830003 19184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.020s	sys 0.050s
W20260709 13:18:37.830884 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 608190us
I20260709 13:18:37.826778 20110 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.779678 20480 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.840667 19748 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:37.843178 20110 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:37.808235 19749 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.012s	sys 0.011s
I20260709 13:18:37.846388 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:37.851596 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:37.810101 20453 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:37.810196 20456 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.016s
I20260709 13:18:37.853137 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.853608 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:37.796262 20443 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.868907 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:37.870049 19113 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:37.857610 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:37.863874 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.870921 19147 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:37.853228 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.871224 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:37.861945 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.872385 19144 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.873659 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:37.798346 20406 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.873746 19063 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
W20260709 13:18:37.866369 20456 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.000s	sys 0.016s
I20260709 13:18:37.839892 20484 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.873692 20373 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.877679 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:37.850453 19749 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.013s	sys 0.011s
I20260709 13:18:37.826995 19217 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:37.880609 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52507us
I20260709 13:18:37.836330 20446 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.888682 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:37.842983 20354 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:18:37.843411 20409 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.839589 20300 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:37.893781 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:37.893877 19070 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.877926 20234 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.854887 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:37.897207 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.882588 20428 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.816754 20463 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.850692 20458 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.853165 20453 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:37.828749 20364 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.879228 20480 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.917227 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:37.905069 19214 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:37.878542 20451 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.897941 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:37.918069 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 62982.2us
I20260709 13:18:37.881640 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.888990 20248 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.877449 20304 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:37.894045 20432 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.903718 20485 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.877954 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:37.957526 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:37.908486 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:37.904825 20434 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.866161 20401 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:37.892627 20413 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:37.878686 20478 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.960383 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:38.155505 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 195189us
I20260709 13:18:37.865742 20388 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:37.881726 20404 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:18:37.890048 20254 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.899767 20256 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.898699 20376 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:18:37.995464 20258 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:37.904296 20472 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.975894 19070 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:37.903574 20373 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:37.897037 20361 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:18:38.251850 20424 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:18:37.981545 20406 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:37.964099 19064 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.908072 20300 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.891189 20426 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.931003 20409 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:37.899139 20484 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.239693 19212 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.993996 19145 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:38.244146 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:18:37.997844 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 90216.7us
I20260709 13:18:37.971292 20447 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.970872 20436 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:37.918386 20234 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.976693 20247 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.297079 20247 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.299134 20247 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:37.992313 19751 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:38.154525 20434 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:37.882978 20477 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:38.227972 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:38.304484 20247 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.284569 20361 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.304611 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 76756.6us
I20260709 13:18:38.304975 20247 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.305397 20247 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.305161 20361 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:37.973989 20295 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.307075 20361 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.307348 20295 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.307904 20295 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.308332 20295 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.308737 20234 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:38.296685 20436 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.310379 20295 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.238783 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:38.311434 20436 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.311618 19744 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:38.255960 20373 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.212756 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:38.263094 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:38.263666 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:38.155061 20478 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.313602 20478 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.247481 20458 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.314733 20458 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.314834 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:38.315110 20458 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.315447 20300 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:38.315740 20436 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.316201 20436 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.985265 20454 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:38.265725 20426 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.268699 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:38.280408 20483 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.238811 20475 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.238101 20443 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.102221 20248 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.262010 19143 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:38.239109 20407 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.102013 20432 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:38.250844 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 94060.5us
I20260709 13:18:38.151585 20304 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.296029 20447 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.258915 20369 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:38.162120 20413 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.303586 20434 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.160233 20405 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.313838 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:38.314040 20493 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:38.313602 20373 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.383282 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:38.322913 20484 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.282389 20445 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.254540 20256 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.293761 19746 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.254221 20254 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.320837 20436 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:38.343329 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 54325.2us
I20260709 13:18:38.325291 20426 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.204538 20485 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:38.409264 20498 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:18:38.290146 20380 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.193s	user 0.011s	sys 0.000s
W20260709 13:18:38.381656 20492 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:38.381949 20369 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.329226 19217 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:38.392844 20432 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.402841 20452 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:38.396598 19218 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:38.398043 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:38.402555 20413 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:38.400631 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.382917 19215 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:38.381960 20479 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.422739 20454 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:38.395325 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 913) took 1542 ms. Trace:
I20260709 13:18:38.339426 20446 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:18:38.404191 20256 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.399855 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 311) took 1181 ms. Trace:
I20260709 13:18:38.389863 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:38.425097 20452 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:38.434926 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:38.418007 20364 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.419359 20463 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.382099 20409 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.418659 20388 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:38.373049 20483 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.419636 20380 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.365604 20475 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.486207 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:38.539283 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 923) took 1248 ms. Trace:
I20260709 13:18:38.506475 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:38.575664 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:38.689172 19070 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:38.688663 19144 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.689586 19145 rpcz_store.cc:276] 0709 13:18:37.290968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.293858 (+  2890us) service_pool.cc:224] Handling call
0709 13:18:37.518037 (+224179us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:38.539091 (+1021054us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54002b7ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:38.539229 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151293056}
I20260709 13:18:38.688184 19221 rpcz_store.cc:276] 0709 13:18:36.852623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.855294 (+  2671us) service_pool.cc:224] Handling call
0709 13:18:37.225695 (+370401us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:37.225917 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.654299 (+428382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.654330 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.656670 (+  2340us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.826427 (+169757us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:37.872094 (+ 45667us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.877425 (+  5331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.877497 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.395027 (+517530us) raft_consensus.cc:1685] finished
0709 13:18:38.395122 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.395253 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4979,"prepare.queue_time_us":51173,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":212843,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":5613,"spinlock_wait_cycles":45607168,"thread_start_us":581261,"threads_started":2,"wal-append.queue_time_us":182297}
W20260709 13:18:38.574420 20496 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:18:38.697031 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:38.497689 20444 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.878s	user 0.009s	sys 0.003s
W20260709 13:18:38.497496 20476 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.673s	user 0.005s	sys 0.004s
I20260709 13:18:38.697021 20432 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:38.717103 20432 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:38.717538 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.535s (SENT) [suppressed 37 similar messages]
I20260709 13:18:38.656518 20369 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.554730 20300 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:38.661573 20447 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.703039 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:38.436507 20304 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:38.538669 19064 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:38.490542 20413 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:38.532056 20469 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:18:38.705691 20457 consensus_meta.cc:287] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.106s	user 0.007s	sys 0.003s
I20260709 13:18:38.706439 20206 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.715231 19140 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:38.739244 19144 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:38.697176 19212 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:38.554109 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:38.719182 19221 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.507390 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:38.437037 20258 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.743235 20364 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:38.730216 20254 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.454790 20500 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.335s
I20260709 13:18:38.773048 20258 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:38.721143 20442 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.127s	user 0.011s	sys 0.001s
I20260709 13:18:38.721390 20478 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.722062 20205 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.722234 20503 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.803324 20205 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.648801 20485 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.723948 20436 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.490155 20472 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.781585 20364 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.553887 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:38.567041 20295 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:38.531090 20248 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:38.431479 20247 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.700866 20454 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.726920 20435 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.942s	user 0.010s	sys 0.001s
I20260709 13:18:38.768392 20483 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:38.643399 20458 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.725922 20476 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.792897 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:38.797376 20432 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.729739 20452 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.800536 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:38.802772 20497 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.814s	user 0.004s	sys 0.011s
I20260709 13:18:38.781931 19138 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:38.803435 20503 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.850073 20475 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.850999 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:38.748837 20469 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.823232 20295 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.803824 20380 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:38.747680 20413 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.798219 20258 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.790356 19746 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:38.816943 19221 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:38.827504 20435 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.862731 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:38.863356 19221 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:38.719827 20300 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.859146 19217 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:38.824388 19142 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:38.812477 19068 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:38.814409 20442 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.866464 20442 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.829056 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:38.830897 20483 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.823657 20248 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.843683 20205 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.815059 20472 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:38.865415 20295 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:38.818182 20254 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.879604 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:38.835734 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 173212us
I20260709 13:18:38.842905 20304 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:38.824832 20454 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.856139 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.035418 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 917) took 1274 ms. Trace:
W20260709 13:18:38.991103 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.026522 20247 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.044445 19213 rpcz_store.cc:276] 0709 13:18:37.761153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.762107 (+   954us) service_pool.cc:224] Handling call
0709 13:18:37.762381 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.766308 (+  3927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.766334 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.778058 (+ 11724us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.852521 (+ 74463us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:37.852559 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.852623 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.802090 (+949467us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:39.027717 (+225627us) raft_consensus.cc:1685] finished
0709 13:18:39.027741 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.035352 (+  7611us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3541,"raft.queue_time_us":8537,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":5663,"spinlock_wait_cycles":595919744,"thread_start_us":58418,"threads_started":1,"wal-append.queue_time_us":195090}
I20260709 13:18:39.048024 19213 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.049146 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.000536 20476 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:38.687976 19749 rpcz_store.cc:276] 0709 13:18:37.218586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.218791 (+   205us) service_pool.cc:224] Handling call
0709 13:18:37.219090 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.219284 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:37.917752 (+698468us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.338862 (+421110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.358528 (+ 19666us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.369542 (+ 11014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.382749 (+ 13207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.399795 (+ 17046us) inbound_call.cc:177] Queueing success response
0709 13:18:38.708805 (+309010us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b18003f6280. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
Metrics: {"prepare.queue_time_us":742584,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":9856,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":25823,"spinlock_wait_cycles":21517184,"thread_start_us":1024395,"threads_started":2,"wal-append.queue_time_us":442987}
I20260709 13:18:39.049851 19746 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:39.051469 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.027714 20458 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:39.001704 20494 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.094s	user 0.011s	sys 0.004s
I20260709 13:18:39.053634 19749 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:39.025766 20206 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:39.054201 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 930) took 1431 ms. Trace:
I20260709 13:18:39.026547 20436 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:39.006011 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.002562 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 79) took 1156 ms. Trace:
I20260709 13:18:39.054760 19146 rpcz_store.cc:276] 0709 13:18:37.622338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.622480 (+   142us) service_pool.cc:224] Handling call
0709 13:18:37.630222 (+  7742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.630515 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.630542 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.641036 (+ 10494us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.810485 (+169449us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:37.810520 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.810616 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.001408 (+1190792us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b24002915a8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003239c4 00007f6100321acb 00007f61004dcdc9 00007f61004dca55 00007f61004dc09d 00007f610310e10e 00007f610312588c 00007f6103124bb6 00007f61031247d8 00007f610312e221
0709 13:18:39.053799 (+ 52391us) raft_consensus.cc:1685] finished
0709 13:18:39.053827 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.054109 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":662,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":11704,"spinlock_wait_cycles":4612480,"thread_start_us":136985,"threads_started":1,"wal-append.queue_time_us":166052}
I20260709 13:18:39.056713 19214 rpcz_store.cc:276] 0709 13:18:37.845857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.853397 (+  7540us) service_pool.cc:224] Handling call
0709 13:18:38.995246 (+1141849us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b540035c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:39.002502 (+  7256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116541824}
I20260709 13:18:38.859979 20452 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:38.933257 20505 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:18:39.041296 20426 consensus_meta.cc:287] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.001s
I20260709 13:18:38.933470 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:39.027557 20488 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.057s	user 0.001s	sys 0.001s
W20260709 13:18:39.059118 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 230109us
I20260709 13:18:39.064426 19070 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.064976 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.065903 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.059597 20442 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.067421 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:38.889725 20485 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.068027 20458 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:39.056624 20248 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.070861 20367 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.059537 20254 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.074548 20413 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.074568 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1168) took 1341 ms. Trace:
I20260709 13:18:39.103317 20466 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.103521 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.103850 20466 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:39.103489 19065 rpcz_store.cc:276] 0709 13:18:37.733033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.734051 (+  1018us) service_pool.cc:224] Handling call
0709 13:18:39.073845 (+1339794us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:39.074050 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.074235 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.074269 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.074314 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:39.074349 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.074412 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.074512 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9022336}
I20260709 13:18:39.075045 20435 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.076169 20457 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:39.105353 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.105226 20457 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.075677 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:39.106073 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1140) took 1334 ms. Trace:
I20260709 13:18:39.105957 19065 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.107221 20457 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.077764 20478 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.042128 20469 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.108148 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.080055 20258 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:38.915519 20425 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.052258 19212 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:39.026273 20451 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:39.027486 20364 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.091666 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:39.092437 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.082010 20426 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.113543 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.094482 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.096122 19746 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:39.086650 20409 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.096748 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:39.063006 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 345472us
I20260709 13:18:39.097260 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.097492 20503 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.097446 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.098083 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:38.914630 20380 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.058476 20304 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.099216 20300 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.100049 20458 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.081782 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.101066 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.104331 19743 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:38.538841 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:39.154606 19071 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.155824 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1495) took 1292 ms. Trace:
I20260709 13:18:39.156195 19071 rpcz_store.cc:276] 0709 13:18:37.863247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.863374 (+   127us) service_pool.cc:224] Handling call
0709 13:18:39.100927 (+1237553us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:39.155768 (+ 54841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16094080}
I20260709 13:18:39.108920 19065 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:39.111816 18967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 111) took 3023 ms. Trace:
I20260709 13:18:39.160149 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1166) took 1427 ms. Trace:
I20260709 13:18:39.101788 20465 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.165093 20465 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.087370 20476 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.161968 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.167701 19217 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:39.167951 20465 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.168751 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.169612 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.169891 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.170392 19142 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:39.171000 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.114082 20484 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.152518 20380 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.054495 20206 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.172122 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.115283 19072 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
W20260709 13:18:39.169616 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.174419 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:39.115350 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:39.175395 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 60116.1us
I20260709 13:18:39.176100 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.115576 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.102747 20406 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.172732 19066 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.118093 20469 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.119077 19750 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
W20260709 13:18:39.168318 20490 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 1.204s	user 0.003s	sys 0.000s
I20260709 13:18:39.126204 20258 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.112536 20451 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.125075 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.128767 20248 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.117515 20369 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.125936 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1153) took 1734 ms. Trace:
I20260709 13:18:39.106541 19216 rpcz_store.cc:276] 0709 13:18:37.772008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.772974 (+   966us) service_pool.cc:224] Handling call
0709 13:18:39.105376 (+1332402us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:39.105567 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.105741 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.105771 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.105817 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:39.105846 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.105908 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.106020 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9900416}
I20260709 13:18:39.129346 20409 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.130342 20453 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.131201 20454 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.193193 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.193369 20453 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.131485 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:39.132243 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.118737 20435 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.134929 19744 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:39.135941 19751 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:39.140730 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.166658 19064 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.195570 19220 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:39.196412 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.197733 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.198943 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:39.199576 19220 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.141503 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.085759 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.201239 19214 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:39.201542 19219 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 2: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:39.158645 20364 raft_consensus.cc:476] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 13:18:39.159735 20457 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:39.203974 20457 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.161286 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.209674 19070 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:39.161695 19138 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:39.128159 20426 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.162853 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:39.160521 19067 rpcz_store.cc:276] 0709 13:18:37.732380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.733646 (+  1266us) service_pool.cc:224] Handling call
0709 13:18:39.063595 (+1329949us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:39.063771 (+   176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.069865 (+  6094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.069897 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.070365 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.158005 (+ 87640us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:39.158040 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.158114 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.159864 (+  1750us) raft_consensus.cc:1685] finished
0709 13:18:39.159883 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.160080 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5757,"raft.queue_time_us":7507,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":179,"spinlock_wait_cycles":4752640,"thread_start_us":87282,"threads_started":1,"wal-append.queue_time_us":87648}
I20260709 13:18:39.163913 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.155382 20503 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:39.164413 20304 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.160363 18967 rpcz_store.cc:276] 0709 13:18:36.086916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.087055 (+   139us) service_pool.cc:224] Handling call
0709 13:18:39.109940 (+3022885us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.494202 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.494826 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.494853 (+    27us) write_op.cc:435] Acquired schema lock
0709 13:18:36.494875 (+    22us) tablet.cc:662] Decoding operations
0709 13:18:36.495256 (+   381us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.495316 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.495355 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:36.495610 (+   255us) tablet.cc:701] Row locks acquired
0709 13:18:36.495630 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:36.495784 (+   154us) write_op.cc:270] Start()
0709 13:18:36.495900 (+   116us) write_op.cc:276] Timestamp: P: 1783603116495733 usec, L: 0
0709 13:18:36.495923 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:36.540715 (+ 44792us) log.cc:844] Serialized 533 byte log entry
0709 13:18:37.977523 (+1436808us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.389219 (+411696us) write_op.cc:301] APPLY: starting
0709 13:18:38.389303 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.389400 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.389509 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.391550 (+  2041us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.391714 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:38.391769 (+    55us) write_op.cc:312] APPLY: finished
0709 13:18:38.391989 (+   220us) log.cc:844] Serialized 23 byte log entry
0709 13:18:38.392139 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.392223 (+    84us) write_op.cc:454] Released schema lock
0709 13:18:38.392277 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.392625 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.392654 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":408835,"apply.run_cpu_time_us":1903,"apply.run_wall_time_us":3402,"num_ops":1,"prepare.queue_time_us":164849,"prepare.run_cpu_time_us":2854,"prepare.run_wall_time_us":57851,"replication_time_us":1441546,"thread_start_us":185479,"threads_started":1}]]}
I20260709 13:18:39.145483 20413 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:39.133906 20472 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.113867 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.193804 20369 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:39.177583 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.177964 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.102756 20442 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.181367 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.181694 19142 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:39.245194 20432 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:39.245697 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.246348 19142 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:39.242707 20413 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:39.247226 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.247807 19142 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.182430 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.248675 20413 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.105989 20466 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.179219 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:39.249136 19066 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:39.181072 20458 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.185295 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:39.249589 19068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1494) took 1387 ms (client timeout 1758 ms). Trace:
I20260709 13:18:39.249902 20409 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.229569 19065 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
W20260709 13:18:39.249590 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 70442.7us
I20260709 13:18:39.183437 20444 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.185847 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.186146 20469 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:39.116425 20425 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.183444 20206 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.173755 20380 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.264670 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1165) took 1532 ms. Trace:
I20260709 13:18:39.265060 19063 rpcz_store.cc:276] 0709 13:18:37.732004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.733195 (+  1191us) service_pool.cc:224] Handling call
0709 13:18:39.264528 (+1531333us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001a8e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:39.264619 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262175616}
I20260709 13:18:39.192975 19217 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:39.188630 19069 rpcz_store.cc:276] 0709 13:18:37.391203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.391886 (+   683us) service_pool.cc:224] Handling call
0709 13:18:37.392169 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.403963 (+ 11794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.404006 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.408639 (+  4633us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.802375 (+393736us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:37.802425 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.802502 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.026849 (+1224347us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:39.125576 (+ 98727us) raft_consensus.cc:1685] finished
0709 13:18:39.125618 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.125866 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2956,"raft.queue_time_us":38795,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":642233216,"thread_start_us":393368,"threads_started":1,"wal-append.queue_time_us":465456}
I20260709 13:18:39.243963 20472 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.186966 20512 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.191541 20516 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.195114 19216 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:39.229861 19213 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:39.305313 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 180357us
I20260709 13:18:39.232033 19220 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:39.306783 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.308158 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:39.177079 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 61559.8us
W20260709 13:18:39.233443 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 119627us
I20260709 13:18:39.234229 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.236277 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:39.237838 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 46078.1us
I20260709 13:18:39.310909 19067 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.311429 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.313212 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:39.237895 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.238867 20457 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.240170 20526 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.251291 19214 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.343367 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.344426 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:39.227967 19212 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.248862 19142 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:39.250483 20409 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.237637 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.253976 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1483) took 1416 ms. Trace:
W20260709 13:18:39.250026 19068 rpcz_store.cc:269] 0709 13:18:37.861891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.868136 (+  6245us) service_pool.cc:224] Handling call
0709 13:18:39.249429 (+1381293us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400209754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:39.249530 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895599488}
I20260709 13:18:39.183914 20476 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.244735 20258 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.390352 20258 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.390801 20258 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.187213 20452 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.253907 20442 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:39.300040 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 929) took 1825 ms. Trace:
I20260709 13:18:39.403887 19140 rpcz_store.cc:276] 0709 13:18:37.474283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.474629 (+   346us) service_pool.cc:224] Handling call
0709 13:18:37.474971 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.736098 (+1261127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.299817 (+563719us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002b75d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:39.299982 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851460352}
I20260709 13:18:39.405419 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:39.406068 19140 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.314291 19070 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.320380 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.235235 20503 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.310021 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:39.407720 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 97793.1us
I20260709 13:18:39.345007 19063 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.344696 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.408689 19214 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:39.301143 20516 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:39.363914 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.376972 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.376745 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:39.410476 19067 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.273439 20413 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:39.382174 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.369859 20406 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.297209 20380 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:39.381924 20403 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.389935 20478 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.393126 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:39.393066 20452 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.342170 20434 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.408970 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:39.384305 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.363896 20526 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.410029 19213 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:39.385087 19064 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.381203 20409 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.381938 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:39.377589 20254 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.439056 20110 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:39.418069 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.390363 20457 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:39.257370 20444 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.460458 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.465587 19063 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:39.487987 19140 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:39.468750 20452 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.302287 20472 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.467515 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.305222 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:39.382460 20369 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.413515 20465 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.472040 20526 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.496953 19145 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:39.497503 20304 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.497982 20304 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.474395 20110 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.500370 20110 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.473946 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.501250 19213 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:39.502053 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:39.502537 19213 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.468947 20478 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.506536 20478 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.507014 20478 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.507339 20478 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:39.507670 20478 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.476718 20469 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.376749 19139 rpcz_store.cc:276] 0709 13:18:37.835769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.847976 (+ 12207us) service_pool.cc:224] Handling call
0709 13:18:39.104157 (+1256181us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:39.104352 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.116069 (+ 11717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.116966 (+   897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.118243 (+  1277us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:39.118289 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.229513 (+111224us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b54002d8f54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:39.234249 (+  4736us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.252409 (+ 18160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22226048}
W20260709 13:18:39.513063 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 217734us
I20260709 13:18:39.494107 20442 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:39.472456 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 63571.9us
I20260709 13:18:39.424153 20406 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:39.478067 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:39.480192 19143 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:39.480588 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.524495 19146 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:39.480594 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.480639 19750 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:39.482195 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1152) took 1218 ms. Trace:
I20260709 13:18:39.483963 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.470722 20413 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.474417 20434 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.549516 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 935) took 1248 ms. Trace:
I20260709 13:18:39.549979 19218 rpcz_store.cc:276] 0709 13:18:38.300844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.383020 (+ 82176us) service_pool.cc:224] Handling call
0709 13:18:39.549311 (+1166291us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b54002698d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:39.549436 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28986624}
I20260709 13:18:39.515336 20465 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.490835 19142 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:39.469070 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.582553 19144 raft_consensus.cc:2368] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3.
W20260709 13:18:39.606868 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 91059.8us
I20260709 13:18:39.607848 19113 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:39.493046 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.487818 19138 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:39.581730 20465 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.476164 20409 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.473924 20403 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:39.498234 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.512549 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.446013 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:39.460799 20380 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.529944 19215 rpcz_store.cc:276] 0709 13:18:38.263310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.263431 (+   121us) service_pool.cc:224] Handling call
0709 13:18:39.481995 (+1218564us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54000749d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:39.482128 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159872384}
I20260709 13:18:39.679837 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.534366 19743 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.485402 20457 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.535825 19069 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:39.687584 20452 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.688408 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.688786 19147 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:39.689010 19069 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:39.688906 20403 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:39.548622 20495 log.cc:927] Time spent T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 1.565s	user 0.000s	sys 0.014s
I20260709 13:18:39.465900 19067 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:39.572190 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:39.524257 20406 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.573609 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:39.575218 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.576761 20516 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.577116 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.578605 20444 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.492637 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:39.623679 19213 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:39.666296 20426 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.666687 20472 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:39.674448 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 367829us
W20260709 13:18:39.677198 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 231235us
I20260709 13:18:39.685760 20484 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.690110 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.700227 18969 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60506 (request call id 203) took 3122 ms. Trace:
I20260709 13:18:39.696518 18966 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 232) took 3582 ms. Trace:
I20260709 13:18:39.693853 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:39.876988 19063 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.878015 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.879004 19069 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.879844 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.877226 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:39.870455 19218 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:39.882426 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:39.883134 19218 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:39.870404 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 479063us
I20260709 13:18:39.873976 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.890574 19219 raft_consensus.cc:2410] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:18:39.869352 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:39.891913 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.893505 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:39.894207 19069 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.879177 18968 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 2 to 3, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.898658 20522 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.899181 20522 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.900022 19063 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:39.901813 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.869947 18969 rpcz_store.cc:276] 0709 13:18:36.578004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.578172 (+   168us) service_pool.cc:224] Handling call
0709 13:18:39.700156 (+3121984us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.634815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.635333 (+   518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.635361 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:18:36.635376 (+    15us) tablet.cc:662] Decoding operations
0709 13:18:36.635691 (+   315us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.635737 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.635771 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:36.635937 (+   166us) tablet.cc:701] Row locks acquired
0709 13:18:36.635958 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:36.636082 (+   124us) write_op.cc:270] Start()
0709 13:18:36.636184 (+   102us) write_op.cc:276] Timestamp: P: 1783603116636040 usec, L: 0
0709 13:18:36.636207 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:36.636800 (+   593us) log.cc:844] Serialized 533 byte log entry
0709 13:18:38.340644 (+1703844us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.393018 (+ 52374us) write_op.cc:301] APPLY: starting
0709 13:18:38.393082 (+    64us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.393189 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.393278 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.393488 (+   210us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.393635 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:38.393679 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:38.393836 (+   157us) log.cc:844] Serialized 23 byte log entry
0709 13:18:38.393977 (+   141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.394043 (+    66us) write_op.cc:454] Released schema lock
0709 13:18:38.394079 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.394361 (+   282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.394395 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1301479,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":52133,"apply.run_cpu_time_us":1323,"apply.run_wall_time_us":1324,"num_ops":1,"prepare.queue_time_us":1167,"prepare.run_cpu_time_us":2238,"prepare.run_wall_time_us":2239,"replication_time_us":1704296,"thread_start_us":33489,"threads_started":1}]]}
I20260709 13:18:39.902963 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.903519 19750 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:39.884815 19217 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.900828 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.904536 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:39.905099 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.905782 19070 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:39.905701 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:39.875308 20476 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:39.906561 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.907325 19070 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:39.905134 19063 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:39.908370 19070 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.908485 19063 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:39.829716 20453 consensus_meta.cc:287] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.000s
I20260709 13:18:39.911022 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:39.788466 20435 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.000s
W20260709 13:18:39.692333 20519 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:18:39.701808 19065 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.927017 19141 raft_consensus.cc:2410] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:39.929324 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43616.2us
I20260709 13:18:39.932576 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.870122 20484 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.941630 20458 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.872983 20413 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.691166 20503 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.695022 20451 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.953805 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:39.941931 20522 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.919260 19064 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.919003 20444 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.870875 20425 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.959810 19745 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:39.943549 20380 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:39.943696 20403 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.973137 20425 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.973500 20403 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.973939 20403 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.974442 20425 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:39.925540 20369 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.936224 20435 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.699795 20258 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.962647 19218 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:39.904695 20478 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.944131 20484 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.969537 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:39.977366 20369 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:39.986711 19747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.014s	sys 0.014s
I20260709 13:18:39.870860 18966 rpcz_store.cc:276] 0709 13:18:36.113980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.114947 (+   967us) service_pool.cc:224] Handling call
0709 13:18:39.696442 (+3581495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.491267 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.491807 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.491845 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:36.491868 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:36.492229 (+   361us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.492328 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.492376 (+    48us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:36.492587 (+   211us) tablet.cc:701] Row locks acquired
0709 13:18:36.492608 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:36.492762 (+   154us) write_op.cc:270] Start()
0709 13:18:36.492916 (+   154us) write_op.cc:276] Timestamp: P: 1783603116492714 usec, L: 0
0709 13:18:36.492943 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:36.493697 (+   754us) log.cc:844] Serialized 533 byte log entry
0709 13:18:37.206492 (+712795us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.241980 (+1035488us) write_op.cc:301] APPLY: starting
0709 13:18:38.242064 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.242170 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.242295 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.291999 (+ 49704us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.323770 (+ 31771us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:38.327137 (+  3367us) write_op.cc:312] APPLY: finished
0709 13:18:38.344317 (+ 17180us) log.cc:844] Serialized 23 byte log entry
0709 13:18:38.842625 (+498308us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.856512 (+ 13887us) write_op.cc:454] Released schema lock
0709 13:18:38.860994 (+  4482us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.056410 (+195416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.058283 (+  1873us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65836,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1035180,"apply.run_cpu_time_us":80899,"apply.run_wall_time_us":803017,"num_ops":1,"prepare.queue_time_us":272320,"prepare.run_cpu_time_us":2724,"prepare.run_wall_time_us":2725,"replication_time_us":713379,"thread_start_us":1386921,"threads_started":3,"wal-append.queue_time_us":503875}]]}
I20260709 13:18:39.957690 20453 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:39.987063 19747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.014s	sys 0.014s
I20260709 13:18:39.962532 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:39.955816 20248 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.925752 20475 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:39.987938 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1155) took 1721 ms. Trace:
W20260709 13:18:39.992954 19066 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.016s	sys 0.052s
W20260709 13:18:39.993243 19066 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.016s	sys 0.052s
I20260709 13:18:39.992432 19221 rpcz_store.cc:276] 0709 13:18:38.266468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.863987 (+597519us) service_pool.cc:224] Handling call
0709 13:18:38.864310 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.063019 (+198709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.063043 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.073609 (+ 10566us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.166660 (+ 93051us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:39.166697 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.166757 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.691785 (+525028us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:39.977780 (+285995us) raft_consensus.cc:1685] finished
0709 13:18:39.977808 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.987868 (+ 10060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3145,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":82427264,"thread_start_us":92383,"threads_started":1,"wal-append.queue_time_us":157224}
I20260709 13:18:39.992591 19035 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:39.969496 20434 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:39.985977 20454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.016s	sys 0.030s
I20260709 13:18:39.996635 19215 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:39.967836 20452 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:39.974897 20425 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:39.955514 20458 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:39.975670 20254 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:18:39.989238 20369 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:40.001169 19212 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.612s	user 0.004s	sys 0.004s
I20260709 13:18:40.001358 20472 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.995450 20538 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.037019 20425 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.037401 19221 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.082608 19069 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:40.039467 19072 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:39.991411 20444 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:18:40.015664 20454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.016s	sys 0.031s
I20260709 13:18:40.001173 20426 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:40.049700 20258 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.050630 20403 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:40.051141 19751 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.020s	sys 0.016s
W20260709 13:18:40.091037 19751 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.020s	sys 0.016s
I20260709 13:18:40.016729 19035 leader_election.cc:400] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3.
I20260709 13:18:40.132578 19035 leader_election.cc:403] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:40.133245 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 137663us
I20260709 13:18:40.011853 20453 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:40.001478 20435 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:18:39.991799 20526 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.064988 20472 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.065361 19212 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
W20260709 13:18:40.146152 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 235202us
W20260709 13:18:40.141101 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47770.1us
I20260709 13:18:40.141223 19067 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:18:40.161876 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 208152us
I20260709 13:18:40.088361 20426 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:40.167254 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:40.171216 19748 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:40.093246 19743 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
W20260709 13:18:40.173214 19113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.004s	sys 0.030s
I20260709 13:18:40.171211 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:40.141584 20254 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3.
W20260709 13:18:40.198168 19113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.009s	sys 0.031s
I20260709 13:18:40.146862 20472 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.214248 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.215500 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.216442 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.216936 20425 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.197873 20403 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.217671 20403 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.218040 20403 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.218958 20457 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.221227 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1174) took 1114 ms. Trace:
I20260709 13:18:40.221657 19065 rpcz_store.cc:276] 0709 13:18:39.106762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.346939 (+240177us) service_pool.cc:224] Handling call
0709 13:18:39.426209 (+ 79270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.940760 (+514551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.220973 (+280213us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54002170d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:40.221164 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582043008}
W20260709 13:18:40.227839 19141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 937) took 1794 ms (client timeout 1885 ms). Trace:
W20260709 13:18:40.228257 19141 rpcz_store.cc:269] 0709 13:18:38.433824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.434631 (+   807us) service_pool.cc:224] Handling call
0709 13:18:40.227654 (+1793023us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002d8a54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:40.227784 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878384512}
I20260709 13:18:40.229653 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.231141 20512 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.231606 20512 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.232496 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:40.201624 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:40.206077 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 598276us
W20260709 13:18:40.233414 20539 log.cc:927] Time spent T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:18:40.166087 20426 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.234686 20453 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.235822 20478 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.236768 20458 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.236840 20304 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.224704 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1499) took 1048 ms. Trace:
I20260709 13:18:40.238539 20526 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.143435 20527 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:40.238705 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.266070 19145 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:40.239849 20465 consensus_meta.cc:287] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.572s	user 0.014s	sys 0.001s
W20260709 13:18:40.273276 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 138117us
I20260709 13:18:40.202522 19217 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:40.243908 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1178) took 1136 ms. Trace:
I20260709 13:18:40.246830 20444 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.248900 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.088655 20538 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.274617 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:40.274245 19072 rpcz_store.cc:276] 0709 13:18:39.107815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.174220 (+ 66405us) service_pool.cc:224] Handling call
0709 13:18:40.243726 (+1069506us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400209c54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:40.243843 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873846656}
W20260709 13:18:40.277731 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.250943 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:40.251499 19142 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:40.170305 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:40.172712 20367 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:40.258849 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57338.4us
I20260709 13:18:40.170277 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1164) took 1023 ms. Trace:
I20260709 13:18:40.261086 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:40.261286 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:40.255524 20425 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:40.244499 20406 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.314769 20110 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:40.319932 20110 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:40.290750 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 120690us
I20260709 13:18:40.321894 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:40.323669 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:40.281347 19214 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:40.324110 20512 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.281885 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.281286 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:40.274842 19146 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:40.282677 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 315) took 2431 ms. Trace:
I20260709 13:18:40.326283 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:40.279234 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.327450 20110 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.255955 20442 raft_consensus.cc:2764] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:40.287053 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:40.329241 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 68264.8us
I20260709 13:18:40.329633 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:40.326207 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:40.324553 20258 raft_consensus.cc:2764] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:40.282085 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.330466 20110 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.330772 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:40.323601 20248 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:40.325039 19144 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.328043 19142 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:40.260198 20466 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:18:40.329902 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:40.263691 20457 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.326954 19747 rpcz_store.cc:276] 0709 13:18:37.833464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.833609 (+   145us) service_pool.cc:224] Handling call
0709 13:18:39.264552 (+1430943us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:39.264710 (+   158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.305726 (+ 41016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.305753 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.369801 (+ 64048us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.990012 (+620211us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:39.990048 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.990111 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.250147 (+260036us) raft_consensus.cc:1685] finished
0709 13:18:40.250171 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.265214 (+ 15043us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6068,"spinlock_wait_cycles":2841984,"thread_start_us":563558,"threads_started":1,"wal-append.queue_time_us":739282}
I20260709 13:18:40.334638 20516 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:40.335379 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 942) took 1068 ms. Trace:
I20260709 13:18:40.347185 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.347827 19139 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:40.347376 19219 rpcz_store.cc:276] 0709 13:18:39.266669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.892445 (+625776us) service_pool.cc:224] Handling call
0709 13:18:39.910442 (+ 17997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.912450 (+  2008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.912493 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.914108 (+  1615us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.190054 (+275946us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:40.190109 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.190207 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.335183 (+144976us) raft_consensus.cc:1685] finished
0709 13:18:40.335202 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.335325 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"raft.queue_time_us":1624,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":19582,"thread_start_us":231846,"threads_started":1,"wal-append.queue_time_us":392752}
I20260709 13:18:40.289641 20469 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.348855 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.349218 20469 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:40.349373 20535 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:40.349618 20469 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.350184 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.350821 19139 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:40.339437 20476 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.271217 19138 rpcz_store.cc:276] 0709 13:18:39.176444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.237320 (+ 60876us) service_pool.cc:224] Handling call
0709 13:18:40.224499 (+987179us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54002d8054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:40.224650 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128508672}
I20260709 13:18:40.354051 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:40.336303 20536 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.285960 20435 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.281540 20454 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:18:40.342005 20110 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:40.342470 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:40.342489 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.369153 19146 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.287873 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 946) took 1020 ms. Trace:
I20260709 13:18:40.288115 20451 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.338977 20452 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:40.319134 20304 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:40.361831 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 80612.7us
I20260709 13:18:40.364974 19219 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.284133 20388 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.286708 20472 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.362130 20434 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:40.361667 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:40.336565 20527 consensus_queue.cc:1243] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:40.340523 20503 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.284047 20465 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.397158 20503 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.397729 20503 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.398643 20465 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.340669 20413 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.401157 20413 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.401628 20413 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.405265 19140 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:40.356221 20536 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.405961 20536 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:40.386327 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43968.6us
I20260709 13:18:40.387228 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:40.409449 20480 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.409602 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:40.409837 20480 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.410193 20480 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.410436 20110 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.410776 20110 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:40.411130 20110 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.414994 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.416416 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:40.417026 19747 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:40.417367 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:40.418120 20475 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:40.418501 20475 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:40.418530 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.418999 20475 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.419477 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.420284 19065 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:40.419330 20110 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.421255 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.421487 19745 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:40.422318 20110 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.422888 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.423971 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.423282 20480 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.379586 19144 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:40.425155 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:40.425472 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 946) took 1069 ms. Trace:
I20260709 13:18:40.426296 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:40.426614 20480 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.426928 19749 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.427040 20442 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:40.284323 19212 rpcz_store.cc:276] 0709 13:18:39.143525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.162634 (+ 19109us) service_pool.cc:224] Handling call
0709 13:18:40.166482 (+1003848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.367167 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.424546 19063 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:40.429311 19139 raft_consensus.cc:2410] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:40.423484 19068 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:40.430245 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.430477 19071 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:40.430846 19139 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.433382 19749 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:40.426271 19144 rpcz_store.cc:276] 0709 13:18:39.363991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.281660 (+917669us) service_pool.cc:224] Handling call
0709 13:18:40.425209 (+143549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.436061 20475 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.437222 19069 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:40.438376 20475 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.439332 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.439895 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:40.438555 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.443557 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:40.382053 20476 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:40.383322 20435 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:40.451990 19146 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
W20260709 13:18:40.446105 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 116547us
W20260709 13:18:40.385684 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 53630.8us
I20260709 13:18:40.368664 20549 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.454058 20549 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:40.388756 20409 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.005s
I20260709 13:18:40.454277 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.438742 19139 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:40.454771 20409 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.455719 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.455893 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.457124 19141 raft_consensus.cc:2368] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:40.444234 19748 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:40.454371 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:40.457526 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.456795 20409 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.454437 20549 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.458412 19146 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:40.442477 19144 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.465493 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.466082 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:40.467491 19146 raft_consensus.cc:2410] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:18:40.467633 20458 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.468210 20458 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.468420 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.468698 20458 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.469194 19146 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.390060 20463 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.380851 19217 rpcz_store.cc:276] 0709 13:18:39.267937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.572892 (+304955us) service_pool.cc:224] Handling call
0709 13:18:40.284927 (+712035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.473259 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:40.477315 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:40.525174 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:40.526047 19139 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:40.485370 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:40.527424 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:40.450631 20364 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.532393 19219 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:40.529026 19214 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
W20260709 13:18:40.539674 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54427.6us
I20260709 13:18:40.544216 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:40.545542 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:40.450702 20476 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:40.450459 20465 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:40.477946 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:40.478361 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:40.565083 19220 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:40.505395 19146 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:40.478065 20434 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.464818 20478 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.586926 19144 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:40.440922 20388 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.567129 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.577538 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:40.577551 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 104362us
I20260709 13:18:40.394178 20522 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:18:40.622452 20463 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:40.623265 20457 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:40.578837 20476 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.451545 20304 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:40.560866 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:40.440958 20425 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.531656 20409 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.561393 20369 consensus_meta.cc:287] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:18:40.628616 20478 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.623456 20452 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:40.622265 20454 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:40.472863 20552 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.161s
I20260709 13:18:40.640339 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:40.642153 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1181) took 1318 ms. Trace:
I20260709 13:18:40.591997 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:40.648118 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 259796us
I20260709 13:18:40.680955 20454 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.584393 20258 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.626237 20554 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:18:40.562002 20480 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.561735 20475 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:40.660578 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1497) took 1484 ms (client timeout 1820 ms). Trace:
W20260709 13:18:40.660025 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.561656 20442 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.577716 20248 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:40.622489 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:40.625485 20406 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.655431 20457 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.678295 19067 rpcz_store.cc:276] 0709 13:18:39.323276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.894305 (+571029us) service_pool.cc:224] Handling call
0709 13:18:39.930160 (+ 35855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.165660 (+235500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.641921 (+476261us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400036e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:40.642104 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484775168}
I20260709 13:18:40.664855 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:40.660260 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 94683.6us
I20260709 13:18:40.577484 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:40.635871 20548 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:40.662024 19064 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.002s
I20260709 13:18:40.564858 20364 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.594120 20465 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.588507 20549 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:40.701076 19140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 950) took 1228 ms (client timeout 1534 ms). Trace:
I20260709 13:18:40.705571 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:40.707458 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1504) took 1327 ms. Trace:
I20260709 13:18:40.678545 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.659776 20304 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.708499 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:40.712693 19147 rpcz_store.cc:269] 0709 13:18:39.175969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.177318 (+  1349us) service_pool.cc:224] Handling call
0709 13:18:40.660365 (+1483047us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400189554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:40.660516 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042567040}
I20260709 13:18:40.726246 20442 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:40.723479 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:40.727231 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 62458.4us
I20260709 13:18:40.681762 20452 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.663267 20409 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.712889 20480 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:40.787195 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 63791.4us
I20260709 13:18:40.789170 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:40.749020 20548 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.678066 20369 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.718132 20475 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.723995 20248 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.728713 19064 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
W20260709 13:18:40.754943 19140 rpcz_store.cc:269] 0709 13:18:39.472869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.492415 (+ 19546us) service_pool.cc:224] Handling call
0709 13:18:40.700814 (+1208399us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54002b84d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:40.700999 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214468480}
W20260709 13:18:40.726909 20403 consensus_meta.cc:287] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.001s
I20260709 13:18:40.757823 19142 rpcz_store.cc:276] 0709 13:18:39.379850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.706548 (+1326698us) service_pool.cc:224] Handling call
0709 13:18:40.706891 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.707090 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.707126 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.707180 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:40.707218 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.707274 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.707394 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:40.748353 20547 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:18:40.729653 19217 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.813930 20475 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.826671 20578 raft_consensus.cc:2764] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:40.761292 19068 raft_consensus.cc:2368] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:40.792220 20472 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.779759 20458 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.828722 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 964) took 1319 ms. Trace:
I20260709 13:18:40.834712 19143 rpcz_store.cc:276] 0709 13:18:39.516359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.708140 (+1191781us) service_pool.cc:224] Handling call
0709 13:18:40.828638 (+120498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.835516 20457 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.812068 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 956) took 1305 ms. Trace:
I20260709 13:18:40.836436 19138 rpcz_store.cc:276] 0709 13:18:39.506872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.353465 (+846593us) service_pool.cc:224] Handling call
0709 13:18:40.705372 (+351907us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:40.798666 (+ 93294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34038016}
W20260709 13:18:40.757444 20550 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:18:40.837746 19217 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:40.837945 19072 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:40.838083 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 952) took 1332 ms. Trace:
I20260709 13:18:40.764609 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.769373 20465 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.769563 20454 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:40.769915 20534 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.600s	user 0.004s	sys 0.000s
I20260709 13:18:40.770504 20573 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.772231 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:40.731138 20563 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:40.773262 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:40.774657 20503 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.775837 20469 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.776917 20304 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.778386 20364 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.749272 20463 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.779812 20549 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.763976 19139 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.780930 20478 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:40.780488 20442 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.687963 20435 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:40.752846 20538 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.782197 20367 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:40.782799 20452 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:40.783257 20536 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.721181 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:40.769387 20569 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:18:40.790655 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:40.689507 20567 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.808619 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:40.811385 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:40.812757 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:40.811646 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.814242 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1167) took 1634 ms. Trace:
I20260709 13:18:40.810169 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:40.819456 19146 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:40.815351 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:40.815420 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 222834us
I20260709 13:18:40.824785 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:40.828577 20403 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.699116 20258 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.822180 20544 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.791896 20552 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:40.791884 20480 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.838666 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:40.839035 19147 raft_consensus.cc:2410] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:40.988821 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 198226us
I20260709 13:18:40.989050 19218 raft_consensus.cc:2368] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:40.989864 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:40.991393 19145 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.991750 19213 rpcz_store.cc:276] 0709 13:18:39.179771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.918231 (+738460us) service_pool.cc:224] Handling call
0709 13:18:39.918461 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.918620 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:40.090839 (+172219us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.813644 (+722805us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b1800335fe0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:18:40.813849 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.813909 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:40.813960 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.814049 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.814179 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6953,"prepare.queue_time_us":331642,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"spinlock_wait_cycles":8274688,"thread_start_us":308593,"threads_started":2,"wal-append.queue_time_us":245823}
I20260709 13:18:40.988032 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1519) took 1490 ms. Trace:
I20260709 13:18:40.990574 19214 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:18:40.989064 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 176392us
I20260709 13:18:40.809418 20425 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.006349 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:40.874389 20484 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.883s	user 0.006s	sys 0.004s
I20260709 13:18:41.001308 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:40.871871 20572 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:41.041886 19144 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:40.817147 20388 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:41.042397 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:41.000633 19217 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:41.044297 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.045850 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.046640 19217 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
W20260709 13:18:40.950300 20505 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:18:41.037978 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 226666us
I20260709 13:18:41.049326 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:41.049433 19220 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:41.047845 19213 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
W20260709 13:18:41.052661 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 62914.6us
I20260709 13:18:41.001827 19070 rpcz_store.cc:276] 0709 13:18:39.497928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.911361 (+413433us) service_pool.cc:224] Handling call
0709 13:18:39.940152 (+ 28791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.940497 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.940535 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.955313 (+ 14778us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.166973 (+211660us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:40.167009 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.167071 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.837399 (+670328us) raft_consensus.cc:1685] finished
0709 13:18:40.837419 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.987973 (+150554us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":892,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":211331,"threads_started":1,"wal-append.queue_time_us":430427}
I20260709 13:18:40.921746 20530 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.833642 20406 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.050968 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 957) took 1543 ms. Trace:
I20260709 13:18:40.830228 20432 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.839450 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:18:40.999261 20426 consensus_meta.cc:287] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.740s	user 0.007s	sys 0.003s
I20260709 13:18:41.085857 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.074828 19214 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:40.829954 20248 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:40.830062 19064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1511) took 1390 ms (client timeout 1562 ms). Trace:
I20260709 13:18:40.829876 20369 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:40.996477 20367 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.831512 20548 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.041194 20484 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:40.847103 20413 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.072654 19147 rpcz_store.cc:276] 0709 13:18:39.507138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.050153 (+1543015us) service_pool.cc:224] Handling call
0709 13:18:41.050405 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.050591 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.050621 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.050671 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:41.050712 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.050781 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.050904 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.084712 20559 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.059006 20549 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.085209 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 951) took 1579 ms. Trace:
I20260709 13:18:41.073751 19145 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:40.922752 20560 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:41.087014 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:41.154676 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 101156us
W20260709 13:18:41.301910 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 252793us
W20260709 13:18:41.187345 19215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.018s	sys 0.034s
W20260709 13:18:41.144694 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 131460us
W20260709 13:18:41.302886 19215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.028s	sys 0.049s
I20260709 13:18:41.295280 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.304060 19063 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.303956 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.305145 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.305208 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.087442 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:40.999459 20457 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.999051 20578 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:41.319999 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.309585 19214 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:41.321331 19063 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:41.303131 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.302549 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:41.321928 19213 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.312253 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.322501 19067 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:41.041908 20573 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:41.315963 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:41.315869 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:41.008000 20425 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.185299 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1171) took 2083 ms. Trace:
I20260709 13:18:41.323484 19145 raft_consensus.cc:2368] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3.
I20260709 13:18:40.838501 19138 rpcz_store.cc:276] 0709 13:18:39.505788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.837276 (+1331488us) service_pool.cc:224] Handling call
0709 13:18:40.837582 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.837762 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.837790 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.837833 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:40.837870 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.837929 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.838030 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.049469 20472 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.330590 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.331058 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.334306 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:41.140419 20581 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:18:41.328740 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.331660 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.077121 20530 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:41.078099 20444 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.332423 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.332505 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:41.167462 20561 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.155521 19065 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:41.335247 19221 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:41.172973 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.171512 20565 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:41.185425 20458 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.324841 19145 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:41.453013 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 965) took 1535 ms. Trace:
I20260709 13:18:41.453194 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.156595 20426 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.395658 19067 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:41.338173 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:41.396239 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 93748.1us
W20260709 13:18:41.458475 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 120395us
I20260709 13:18:41.458845 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.459218 19113 leader_election.cc:400] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:41.459513 19113 leader_election.cc:403] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:41.319628 20548 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:41.008316 20552 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.314298 20560 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:41.295034 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 597163us
I20260709 13:18:41.071851 20476 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.306362 20254 raft_consensus.cc:2764] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:41.450985 19213 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:41.291666 20503 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:41.089107 20406 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.454077 19214 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:41.478528 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.448195 20512 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.453457 19145 rpcz_store.cc:276] 0709 13:18:39.917618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.324208 (+1406590us) service_pool.cc:224] Handling call
0709 13:18:41.324676 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.452674 (+127998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.452944 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.320524 20578 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.076762 20432 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:41.328786 20577 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.326555 20425 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.318063 20457 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.332921 20472 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:41.466150 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:41.323762 19066 rpcz_store.cc:276] 0709 13:18:39.102023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.249787 (+147764us) service_pool.cc:224] Handling call
0709 13:18:39.250078 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.250366 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.250390 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.250810 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.993707 (+742897us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:39.993744 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.993806 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.769350 (+775544us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:41.168212 (+398862us) raft_consensus.cc:1685] finished
0709 13:18:41.168238 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.185215 (+ 16977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":419,"raft.queue_time_us":1735,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1226,"spinlock_wait_cycles":50050816,"thread_start_us":698418,"threads_started":1,"wal-append.queue_time_us":828385}
I20260709 13:18:41.337450 20451 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.489346 20254 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:41.492434 19068 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:41.489746 20472 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.493690 20426 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.493698 19068 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.484930 20258 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:41.495604 19068 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:41.497349 20475 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.000s
I20260709 13:18:41.398594 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:41.393692 20563 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.422554 20248 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:18:41.304360 19064 rpcz_store.cc:269] 0709 13:18:39.439847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.521223 (+ 81376us) service_pool.cc:224] Handling call
0709 13:18:40.829999 (+1308776us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:41.475576 19184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.012s	sys 0.018s
I20260709 13:18:41.475600 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:41.521049 19184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.012s	sys 0.018s
W20260709 13:18:41.521441 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 881706us
I20260709 13:18:41.476677 19140 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:41.479557 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.522778 19214 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:41.523690 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.524441 19214 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:41.339287 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:41.525519 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 186379us
I20260709 13:18:41.458402 20538 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:41.526435 20426 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.480378 19071 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.526739 20538 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:41.527032 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.527956 19071 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.527660 20538 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.528082 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.427983 20434 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.529026 20434 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:41.529877 20434 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.456810 20409 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.482373 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1511) took 1232 ms. Trace:
I20260709 13:18:41.530858 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:41.531226 19145 rpcz_store.cc:276] 0709 13:18:40.249652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.481781 (+1232129us) service_pool.cc:224] Handling call
0709 13:18:41.482020 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.482164 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.482192 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.482219 (+    27us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:41.482236 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.482272 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.482335 (+    63us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.532155 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:41.532611 19145 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.533025 20575 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.533099 20254 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.533522 20575 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:41.533169 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1513) took 1283 ms. Trace:
I20260709 13:18:41.534031 20575 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.534061 19145 rpcz_store.cc:276] 0709 13:18:40.250177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.532182 (+1282005us) service_pool.cc:224] Handling call
0709 13:18:41.532467 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.532961 (+   494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.533119 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.474073 20548 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.454743 20444 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:41.536656 20444 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.537267 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.537938 19214 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:41.305063 19143 rpcz_store.cc:276] 0709 13:18:39.505457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.835472 (+1330015us) service_pool.cc:224] Handling call
0709 13:18:40.835801 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.006400 (+170599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.040266 (+ 33866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.049968 (+  9702us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:41.071631 (+ 21663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.084968 (+ 13337us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.085137 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.470242 20364 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:41.461297 20403 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.467999 20454 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.487160 19141 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.540475 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.540957 19143 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:41.541098 19214 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:41.541600 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 971) took 1278 ms. Trace:
I20260709 13:18:41.544059 19143 rpcz_store.cc:276] 0709 13:18:40.263372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.538910 (+1275538us) service_pool.cc:224] Handling call
0709 13:18:41.539338 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.541350 (+  2012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.541530 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.489297 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:41.546384 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 57163.2us
I20260709 13:18:41.547176 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:41.548089 20458 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:41.548610 20458 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:41.421919 20478 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:41.477700 20469 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.501237 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1502) took 2122 ms. Trace:
I20260709 13:18:41.549034 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:41.500025 20559 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:18:41.549489 20458 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.550266 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:41.550518 20469 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.508474 20432 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.551060 20558 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.551716 20432 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.551878 19067 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.508994 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1186) took 1024 ms. Trace:
I20260709 13:18:41.485036 20536 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.484692 20578 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.552678 19220 rpcz_store.cc:276] 0709 13:18:40.484994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.990400 (+505406us) service_pool.cc:224] Handling call
0709 13:18:40.990991 (+   591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.050209 (+ 59218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.508751 (+458542us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b5400073fd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:41.508938 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117562240}
I20260709 13:18:41.553578 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.488088 20457 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.554982 19220 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:41.528574 19218 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.547505 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.557785 20558 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.558269 20558 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:41.559069 20558 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.528797 19110 leader_election.cc:400] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:41.468324 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:41.561190 19743 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:41.560420 20578 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.546471 20254 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.467789 20583 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.562269 20254 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:41.562343 20583 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:41.563184 20254 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.563517 20583 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.462463 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:41.565253 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 102860us
I20260709 13:18:41.565948 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:41.566795 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:41.549407 19144 rpcz_store.cc:276] 0709 13:18:39.378994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.800311 (+1421317us) service_pool.cc:224] Handling call
0709 13:18:40.800697 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.042344 (+241647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.500954 (+458610us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400121454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:41.501179 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554108160}
I20260709 13:18:41.569037 20426 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.569172 20403 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.569541 20426 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.569693 20403 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:41.569926 20426 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.570160 19144 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:41.541875 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.570554 20403 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.569038 20364 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.550031 20559 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:41.573441 20364 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:41.573803 20559 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:41.574884 20559 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.576094 20559 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.560449 19110 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.573869 20364 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.522019 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.578686 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:41.580911 19110 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.582333 19218 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:41.497745 20413 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:41.522042 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.456250 20565 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:41.586642 20589 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:41.586997 20512 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.587318 20465 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.587682 20574 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.589097 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:41.590206 20466 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.595978 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.497710 20475 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.595428 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1187) took 1110 ms. Trace:
I20260709 13:18:41.603328 20454 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:41.604782 19141 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:41.605566 20426 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:41.592922 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 65982.5us
I20260709 13:18:41.593164 20478 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.612820 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.594142 20452 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.630095 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.653580 19218 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:41.488226 20577 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:41.629079 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 107107us
I20260709 13:18:41.659461 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.481254 20530 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.583060 20248 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.596388 20388 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:41.639025 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.616055 20484 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:41.637629 19219 rpcz_store.cc:276] 0709 13:18:40.485299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.998160 (+512861us) service_pool.cc:224] Handling call
0709 13:18:40.998436 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.042822 (+ 44386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.042851 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.042892 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:41.042919 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.595165 (+552246us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54003903d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:41.595231 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.595363 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101604224}
I20260709 13:18:41.670194 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.671590 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.606181 20364 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.646970 20254 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.643738 20574 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:41.651584 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.661187 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1505) took 2281 ms. Trace:
I20260709 13:18:41.683806 19140 rpcz_store.cc:276] 0709 13:18:39.380249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.839508 (+1459259us) service_pool.cc:224] Handling call
0709 13:18:40.839848 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.522296 (+682448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.660903 (+138607us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540017bbd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:41.661114 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464006016}
I20260709 13:18:41.684926 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:41.685554 19140 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:41.686337 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:41.661369 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.686964 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.687955 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:41.662328 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:41.631253 20512 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.664422 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 969) took 1401 ms. Trace:
I20260709 13:18:41.695065 19146 rpcz_store.cc:276] 0709 13:18:40.262758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.566915 (+304157us) service_pool.cc:224] Handling call
0709 13:18:41.664226 (+1097311us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400327b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:41.664350 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419809536}
I20260709 13:18:41.695647 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.631903 20413 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.663527 20578 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.631529 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1181) took 1155 ms. Trace:
I20260709 13:18:41.491865 20573 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.633049 20583 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.697137 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.630435 20565 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.638338 19147 raft_consensus.cc:2376] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2. Re-sending same reply.
I20260709 13:18:41.615487 20575 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.689092 19070 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.697271 20512 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.689678 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.689916 20560 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:41.690739 20590 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:18:41.692389 20478 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:41.693161 20475 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.696055 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.624933 20458 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:18:41.640568 20406 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:41.697492 19217 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.633220 20611 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:41.738200 20611 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.666005 20591 raft_consensus.cc:2764] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:41.745360 20611 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.747402 20574 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.748293 20458 raft_consensus.cc:3055] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:41.697304 20563 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:41.749437 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 173) took 1330 ms. Trace:
I20260709 13:18:41.637377 20457 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:41.693406 20603 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:18:41.700316 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.702275 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:41.755056 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52860.7us
I20260709 13:18:41.700788 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.674919 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:41.703647 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.757740 19071 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.697178 20530 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.698868 20453 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:41.698061 20480 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.001s
I20260709 13:18:41.698938 20484 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.711382 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.766016 19070 raft_consensus.cc:2368] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:41.711378 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1180) took 1236 ms. Trace:
I20260709 13:18:41.766415 19221 rpcz_store.cc:276] 0709 13:18:40.475420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.527149 (+ 51729us) service_pool.cc:224] Handling call
0709 13:18:40.815177 (+288028us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:41.711135 (+895958us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54002da5d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:41.711310 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834406016}
I20260709 13:18:41.713135 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 970) took 1450 ms. Trace:
I20260709 13:18:41.767374 19145 rpcz_store.cc:276] 0709 13:18:40.263080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.534947 (+1271867us) service_pool.cc:224] Handling call
0709 13:18:41.535748 (+   801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.542559 (+  6811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.542584 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.543311 (+   727us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:41.543355 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.712838 (+169483us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b540010ed54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:41.712913 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.713065 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15278848}
I20260709 13:18:41.714861 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.717657 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:41.770584 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:41.771307 19213 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:41.735126 20560 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.710925 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:41.734701 20552 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.756886 19072 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:41.749974 19747 rpcz_store.cc:276] 0709 13:18:40.419128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.419253 (+   125us) service_pool.cc:224] Handling call
0709 13:18:40.419523 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.682943 (+263420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.682969 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.714228 (+ 31259us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.027148 (+312920us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b180021e9e0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:18:41.201157 (+174009us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:41.201211 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.666659 (+465448us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54005b4ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:41.666740 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.749211 (+ 82471us) raft_consensus.cc:1685] finished
0709 13:18:41.749238 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.749370 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19607,"raft.queue_time_us":21085,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":51721,"spinlock_wait_cycles":566923776,"thread_start_us":167015,"threads_started":1,"wal-append.queue_time_us":694942}
I20260709 13:18:41.707047 20583 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:41.773666 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:41.778009 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 60450.6us
I20260709 13:18:41.748703 20458 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:41.732666 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:41.794647 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 62042.4us
I20260709 13:18:41.784614 19213 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.795601 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.696830 19219 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.788424 19070 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.797621 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.798434 20560 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.814889 20560 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:41.815501 20560 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.817293 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:41.762296 20409 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.777535 20484 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:41.823470 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.830355 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.831626 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.790797 20478 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.777675 20453 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:41.822058 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:41.822775 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:41.824048 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:41.812618 20591 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.859148 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:41.860046 19141 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:41.837253 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:41.840155 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:41.840598 20577 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:41.818781 20406 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.812089 20426 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.777294 20454 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:18:41.871836 19747 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:41.879953 20591 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:41.880165 19743 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:41.846903 20548 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:41.875932 19064 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:41.879487 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:41.896307 20591 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.856083 20583 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:41.876272 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:41.827288 20258 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.835727 20484 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.836642 20478 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.786748 20480 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:41.842017 20248 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:41.848278 20453 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:41.883754 19139 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.003s
I20260709 13:18:41.894073 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:41.793552 20425 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:41.876284 20611 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.880368 20503 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.904927 20544 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:41.896981 20575 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.878384 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:41.878891 19217 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:41.909936 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:41.909935 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:41.881917 20406 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:41.943202 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:41.906162 20364 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:41.950996 19146 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:41.961402 19069 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:41.910697 20478 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.699952 19216 rpcz_store.cc:276] 0709 13:18:40.475727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.478535 (+  2808us) service_pool.cc:224] Handling call
0709 13:18:40.592840 (+114305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.695349 (+102509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.711558 (+ 16209us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.922953 (+211395us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.075022 (+152069us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:41.084818 (+  9796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.084909 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.631319 (+546410us) raft_consensus.cc:1685] finished
0709 13:18:41.631337 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.631474 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141414,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":19551,"thread_start_us":191659,"threads_started":2,"wal-append.queue_time_us":562518}
W20260709 13:18:41.947379 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7523360420000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:18:41.996809 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7235360419999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:18:41.997227 19184 connection.cc:256] RPC call timeout handler was delayed by -1.6596360419998746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 13:18:41.997735 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0428992770000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 13:18:42.000524 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:41.951506 19747 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.920933 20258 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:41.885639 20458 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:41.967526 20367 consensus_meta.cc:287] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.642s	user 0.004s	sys 0.003s
I20260709 13:18:42.008623 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.946148 20544 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.043228 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:42.046092 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:41.956624 19742 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:42.058282 19742 pending_rounds.cc:85] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 4
I20260709 13:18:42.058656 19742 pending_rounds.cc:107] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:41.957881 20413 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.059648 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:42.055537 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:41.971712 20406 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.966645 20457 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:41.968199 20586 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.057466 19072 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:18:42.037387 20472 consensus_meta.cc:287] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.002s
I20260709 13:18:41.948944 19139 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:41.958914 20503 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.058998 19742 raft_consensus.cc:2889] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.985626 19746 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:42.076347 20586 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.079742 20472 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.080911 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1197) took 1665 ms. Trace:
I20260709 13:18:42.082718 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1204) took 1633 ms. Trace:
I20260709 13:18:42.131891 19069 rpcz_store.cc:276] 0709 13:18:40.449790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.702974 (+253184us) service_pool.cc:224] Handling call
0709 13:18:40.703384 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.977741 (+1274357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.082468 (+104727us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001211d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:42.082662 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2892414336}
I20260709 13:18:42.084358 19071 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:42.134419 19070 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:42.074491 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:42.087025 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 454318us
I20260709 13:18:41.959160 20611 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.056362 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:42.041692 20565 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:42.064512 20413 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.090703 20406 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.099565 20538 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.099681 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 966) took 2172 ms. Trace:
W20260709 13:18:42.100621 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 306724us
I20260709 13:18:42.154383 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:42.063951 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42370 (request call id 9) took 1582 ms. Trace:
I20260709 13:18:42.089085 20465 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:42.140962 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 474644us
I20260709 13:18:42.077441 20458 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.203013 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:42.133169 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:42.135351 19072 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.057142 20367 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.155155 19113 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:42.207652 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52594.8us
W20260709 13:18:42.168973 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.024s	sys 0.054s
I20260709 13:18:42.162195 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:42.210940 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.028s	sys 0.058s
W20260709 13:18:42.211488 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49390.6us
W20260709 13:18:42.211668 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 622584us
I20260709 13:18:42.212970 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:42.216730 20544 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:42.218169 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.218357 19219 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:42.219614 20544 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:42.094393 19139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 954) took 2586 ms (client timeout 3159 ms). Trace:
I20260709 13:18:42.145711 20577 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:42.145473 20552 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:42.223165 19220 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.017s
W20260709 13:18:42.230978 19220 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.009s	sys 0.017s
I20260709 13:18:42.152654 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:42.167043 20611 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:42.224692 20559 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.648s	user 0.003s	sys 0.008s
I20260709 13:18:42.167963 20475 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:42.233182 19064 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:42.225021 20575 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:42.274788 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:42.230497 20403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.017s	sys 0.035s
W20260709 13:18:42.236176 20451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.008s	sys 0.015s
I20260709 13:18:42.223786 20457 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.229429 20577 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:42.201217 20565 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:42.237665 19749 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.146303 19065 rpcz_store.cc:276] 0709 13:18:40.415356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.422137 (+  6781us) service_pool.cc:224] Handling call
0709 13:18:40.422430 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.457895 (+1035465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.080597 (+622702us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400057b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:42.080831 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425010432}
I20260709 13:18:42.198972 19212 rpcz_store.cc:276] 0709 13:18:40.472951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.511275 (+ 38324us) service_pool.cc:224] Handling call
0709 13:18:42.004132 (+1492857us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54000749d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103590735 00007f6108550d29 00007f6101acf1d4 00007f6101acf162 00007f6101acf091 00007f6101acf00c 00007f6101ace2c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:42.040086 (+ 35954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862407424}
W20260709 13:18:42.237709 20588 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.014s
I20260709 13:18:42.164940 20258 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.242208 20563 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:42.227236 20549 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:18:42.238101 20541 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:18:42.283977 20583 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:42.224644 19139 rpcz_store.cc:269] 0709 13:18:39.506307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.635276 (+1128969us) service_pool.cc:224] Handling call
0709 13:18:42.092894 (+1457618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.296365 20577 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:42.221398 20576 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.056s
I20260709 13:18:42.243032 20578 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:42.221882 20254 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:42.288257 20403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.017s	sys 0.035s
W20260709 13:18:42.364537 20466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.003s	sys 0.045s
W20260709 13:18:42.286466 20451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.009s	sys 0.015s
W20260709 13:18:42.304654 19066 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.054s
W20260709 13:18:42.385767 20466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.003s	sys 0.045s
W20260709 13:18:42.386034 19066 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.012s	sys 0.054s
I20260709 13:18:42.386377 20110 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:42.387761 20466 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:42.388471 20466 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.391103 20466 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:42.392441 20561 consensus_meta.cc:287] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.934s	user 0.011s	sys 0.000s
I20260709 13:18:42.296411 19072 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:42.279546 20558 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:42.295563 19714 leader_election.cc:400] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3.
I20260709 13:18:42.242090 20388 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:18:42.363375 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:42.290308 20575 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:42.303138 20588 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.010s	sys 0.014s
I20260709 13:18:42.279771 20475 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.309254 20563 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.395141 20578 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:42.533062 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.382266 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.019s
W20260709 13:18:42.617928 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.000s	sys 0.020s
W20260709 13:18:42.618321 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 862095us
I20260709 13:18:42.619136 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:42.382584 19111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.002s	sys 0.015s
W20260709 13:18:42.310698 19143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.008s	sys 0.018s
I20260709 13:18:42.306740 20425 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:42.284747 20480 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:42.423074 20576 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.010s	sys 0.064s
I20260709 13:18:42.452407 19714 leader_election.cc:403] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:18:42.588508 20530 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.006s
W20260709 13:18:42.617602 20444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.008s	sys 0.008s
W20260709 13:18:42.650024 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 74) took 1596 ms (client timeout 1833 ms). Trace:
I20260709 13:18:42.442754 20561 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:42.633011 20622 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:18:42.632718 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:42.633873 20612 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:18:42.624796 19071 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
W20260709 13:18:42.638386 19747 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.001s
I20260709 13:18:42.676807 19747 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:42.640087 20578 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:42.639684 20413 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:42.307931 20463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.010s	sys 0.008s
W20260709 13:18:42.686973 20463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.010s	sys 0.008s
W20260709 13:18:42.650439 19147 rpcz_store.cc:269] 0709 13:18:41.053957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.315656 (+261699us) service_pool.cc:224] Handling call
0709 13:18:42.649860 (+1334204us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54000ff0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:42.649967 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723714432}
I20260709 13:18:42.688081 19140 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:18:42.620253 19111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.003s	sys 0.015s
I20260709 13:18:42.618376 20472 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:42.647296 20575 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:42.622740 19143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.009s	sys 0.018s
I20260709 13:18:42.619413 20503 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:42.660244 20618 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:18:42.667557 20478 consensus_meta.cc:287] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.000s
I20260709 13:18:42.668092 20586 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:42.674569 20380 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.672508 19744 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:42.679802 19063 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:42.458636 20558 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.734998 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:42.735803 19147 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:42.722406 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1209) took 1066 ms. Trace:
W20260709 13:18:42.685207 20560 consensus_meta.cc:287] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.004s
W20260709 13:18:42.648162 20444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.009s	sys 0.008s
I20260709 13:18:42.198753 19138 rpcz_store.cc:276] 0709 13:18:39.927587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.398720 (+1471133us) service_pool.cc:224] Handling call
0709 13:18:41.424727 (+ 26007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.424973 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:41.636094 (+211121us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.099277 (+463183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.099332 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:42.099383 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.099478 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.099624 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17621,"prepare.queue_time_us":49694,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1328,"raft.queue_time_us":66,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":591538,"threads_started":2}
I20260709 13:18:42.737179 19217 rpcz_store.cc:276] 0709 13:18:41.656075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.656780 (+   705us) service_pool.cc:224] Handling call
0709 13:18:42.720785 (+1064005us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54002698d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:42.722332 (+  1547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23491840}
I20260709 13:18:42.752789 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:42.754334 19217 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.743119 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:42.755120 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:42.746870 20587 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.152s	user 0.005s	sys 0.000s
I20260709 13:18:42.727034 20536 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.764122 19217 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:42.723043 20406 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:42.768030 19214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.168s	user 0.027s	sys 0.058s
I20260709 13:18:42.784768 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:42.787014 19214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.027s	sys 0.058s
W20260709 13:18:42.766016 20574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.019s	sys 0.054s
W20260709 13:18:42.767614 20573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.007s	sys 0.019s
I20260709 13:18:42.788365 20563 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:42.788196 20573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.007s	sys 0.019s
I20260709 13:18:42.789161 20563 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:42.790134 20574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.019s	sys 0.055s
I20260709 13:18:42.790266 20563 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:42.790760 20574 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:42.790946 20563 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:42.791345 20574 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:18:42.770699 20248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.024s	sys 0.094s
I20260709 13:18:42.791185 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:42.726029 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 470535us
I20260709 13:18:42.723906 20451 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:18:42.751768 20367 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:42.766366 20472 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.767843 20475 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:42.736802 20478 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.740501 20380 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:42.802054 20248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.024s	sys 0.095s
I20260709 13:18:42.792619 20574 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:42.827243 20512 consensus_meta.cc:287] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.104s	user 0.005s	sys 0.010s
I20260709 13:18:42.827647 20512 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.829052 20626 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.829739 20626 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:42.830314 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1506) took 3420 ms. Trace:
I20260709 13:18:42.786710 20565 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:42.751933 20560 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.839615 20633 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.840953 19145 raft_consensus.cc:2368] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:42.830842 19142 rpcz_store.cc:276] 0709 13:18:39.409984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.823299 (+1413315us) service_pool.cc:224] Handling call
0709 13:18:40.823609 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.823804 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.823827 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.828806 (+  4979us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.172277 (+343471us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:41.172340 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.172428 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.746171 (+1573743us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:42.829968 (+ 83797us) raft_consensus.cc:1685] finished
0709 13:18:42.829996 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.830241 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18832640,"thread_start_us":343089,"threads_started":1,"wal-append.queue_time_us":659559}
W20260709 13:18:42.860700 19751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.048s	sys 0.091s
W20260709 13:18:42.863438 19751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.048s	sys 0.091s
I20260709 13:18:42.811044 20472 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:42.836462 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.915663 19220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.015s	sys 0.010s
W20260709 13:18:42.917312 19220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.015s	sys 0.010s
I20260709 13:18:42.921171 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 971) took 1465 ms. Trace:
I20260709 13:18:42.925787 19218 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:42.837435 20403 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.792203 20563 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.835512 20406 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:42.935585 19220 rpcz_store.cc:276] 0709 13:18:41.455811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.587830 (+132019us) service_pool.cc:224] Handling call
0709 13:18:41.588117 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.588301 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:42.231515 (+643214us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.919679 (+688164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.919755 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:42.919817 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.920923 (+  1106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.921094 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11729,"prepare.queue_time_us":105085,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1063,"raft.queue_time_us":5966,"thread_start_us":1311442,"threads_started":2}
W20260709 13:18:42.967176 19714 connection.cc:256] RPC call timeout handler was delayed by -2.9758271660000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:18:42.972921 19714 connection.cc:256] RPC call timeout handler was delayed by -1.7005363480000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:18:42.974005 19714 connection.cc:256] RPC call timeout handler was delayed by -1.4431363480000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:18:42.974867 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:42.981863 20453 consensus_meta.cc:287] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.034s	user 0.011s	sys 0.000s
I20260709 13:18:42.982054 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 295) took 1135 ms. Trace:
I20260709 13:18:42.982414 20453 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:42.923681 20544 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.982719 19744 rpcz_store.cc:276] 0709 13:18:41.846417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.856078 (+  9661us) service_pool.cc:224] Handling call
0709 13:18:42.981850 (+1125772us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400572454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:42.981984 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710828288}
I20260709 13:18:42.981885 20512 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:42.986079 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:42.986930 19220 raft_consensus.cc:2368] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5.
W20260709 13:18:42.987726 20630 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:42.987828 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:42.896397 20388 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:18:42.991062 20388 raft_consensus.cc:2764] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:42.999169 20472 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:43.010074 20458 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.789s	user 0.006s	sys 0.004s
W20260709 13:18:43.010578 20484 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.067s	user 0.009s	sys 0.000s
I20260709 13:18:42.971006 20565 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.013018 19215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.008s	sys 0.029s
I20260709 13:18:43.014058 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:43.018870 19217 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:43.027361 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:43.028599 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:43.029928 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:43.019387 19215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.008s	sys 0.030s
I20260709 13:18:42.971350 20403 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:42.929646 20633 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.979794 20406 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:42.991873 20388 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:18:43.038138 20457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.014s	sys 0.019s
I20260709 13:18:43.038894 20626 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:43.038911 20558 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:43.063369 19716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.005s	sys 0.045s
I20260709 13:18:43.012725 20476 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:43.050268 20457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.014s	sys 0.020s
W20260709 13:18:43.068683 19716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.005s	sys 0.047s
I20260709 13:18:43.018985 20484 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:43.018646 20565 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:43.087796 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.094197 20403 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:43.097136 20453 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:43.098901 20639 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:43.111295 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:43.118988 20633 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:43.119354 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1537) took 1053 ms. Trace:
I20260709 13:18:43.124836 19071 rpcz_store.cc:276] 0709 13:18:42.065629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.233504 (+167875us) service_pool.cc:224] Handling call
0709 13:18:43.119147 (+885643us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54003a07d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:43.119280 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797143296}
I20260709 13:18:43.121093 20406 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:43.126765 20633 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:43.162588 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:43.163923 19748 raft_consensus.cc:2410] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:43.089496 20626 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:43.142280 20560 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:43.207633 19751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 294) took 1362 ms. Trace:
I20260709 13:18:43.207990 19748 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:43.205652 19747 raft_consensus.cc:3055] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:43.216239 19747 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:43.208190 19751 rpcz_store.cc:276] 0709 13:18:41.845433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.845545 (+   112us) service_pool.cc:224] Handling call
0709 13:18:41.873480 (+ 27935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.874003 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.874041 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.910149 (+ 36108us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.911777 (+1001628us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:42.911821 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.911911 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.207377 (+295466us) raft_consensus.cc:1685] finished
0709 13:18:43.207404 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.207567 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9936,"thread_start_us":886835,"threads_started":1,"wal-append.queue_time_us":1208914}
W20260709 13:18:43.203188 20577 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.003s
I20260709 13:18:43.201529 20380 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:43.168207 20633 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:43.232292 19747 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:43.395373 19747 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.457474 20651 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.175760 20576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.007s	sys 0.010s
W20260709 13:18:43.546113 20576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.007s	sys 0.014s
I20260709 13:18:43.546036 20651 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:43.545516 20642 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:18:43.260667 20626 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:43.233115 20577 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:18:43.572433 19715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.017s
I20260709 13:18:43.548333 20651 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:43.584560 19715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.018s
W20260709 13:18:43.585522 19749 consensus_meta.cc:287] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.279s	user 0.011s	sys 0.002s
W20260709 13:18:43.592906 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.593315 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.585141 20565 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:43.636781 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.674257 20655 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:43.709875 20651 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.710700 20651 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:43.713259 20651 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:43.715248 20654 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:18:43.692571 20577 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:43.813336 20633 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:43.816905 20565 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:43.817708 20565 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:43.820454 20565 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:43.592444 19749 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:43.927132 20530 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3.
W20260709 13:18:43.928267 19749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 332) took 2607 ms (client timeout 2115 ms). Trace:
W20260709 13:18:43.928928 19749 rpcz_store.cc:269] 0709 13:18:41.320998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.324822 (+  3824us) service_pool.cc:224] Handling call
0709 13:18:42.094103 (+769281us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:43.928133 (+1834030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13012352}
W20260709 13:18:43.925247 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.926132 19745 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:43.942523 19745 pending_rounds.cc:85] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 4
I20260709 13:18:43.942860 19745 pending_rounds.cc:107] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:43.943122 19745 raft_consensus.cc:2889] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.943852 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 335) took 2249 ms. Trace:
I20260709 13:18:43.944221 19745 rpcz_store.cc:276] 0709 13:18:41.694452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.697020 (+  2568us) service_pool.cc:224] Handling call
0709 13:18:43.925403 (+2228383us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465eee 0000000000375939 00007f61084d91e0 00007f61085a20c4 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:43.925626 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.943581 (+ 17955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.943795 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4562176}
I20260709 13:18:43.942364 20566 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:43.945387 20566 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:43.924647 19067 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:18:43.948573 19068 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.324s	user 0.057s	sys 0.037s
I20260709 13:18:43.949352 20566 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:43.999274 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1208) took 2399 ms. Trace:
I20260709 13:18:44.017244 20469 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:44.033484 19184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.963s	user 0.036s	sys 0.034s
I20260709 13:18:44.033504 20469 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:44.033888 19184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.963s	user 0.036s	sys 0.034s
W20260709 13:18:44.034409 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 1.97466e+06us
I20260709 13:18:44.034513 20469 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.035418 20469 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.035590 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.036314 20544 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:44.040474 20661 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.459s	user 0.004s	sys 0.000s
I20260709 13:18:44.031831 20577 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:44.053216 20577 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.055394 20577 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:44.079329 19066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.693s	user 0.012s	sys 0.039s
W20260709 13:18:44.089529 19066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.703s	user 0.013s	sys 0.040s
W20260709 13:18:44.064069 20600 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.985s	user 0.000s	sys 0.018s
W20260709 13:18:44.089951 19747 consensus_meta.cc:287] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.000s
I20260709 13:18:44.090687 19747 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:44.090976 19747 pending_rounds.cc:85] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 4
W20260709 13:18:44.067629 20591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.101s	user 0.071s	sys 0.153s
W20260709 13:18:44.091439 20591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.125s	user 0.071s	sys 0.154s
W20260709 13:18:44.068830 20258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.045s	sys 0.134s
I20260709 13:18:44.037050 19218 rpcz_store.cc:276] 0709 13:18:41.599411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.801563 (+202152us) service_pool.cc:224] Handling call
0709 13:18:41.801917 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.930792 (+1128875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.998879 (+1068087us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540034c454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:43.999157 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584122240}
I20260709 13:18:44.067229 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1522) took 2247 ms. Trace:
I20260709 13:18:44.032644 20626 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.093077 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 976) took 1479 ms. Trace:
I20260709 13:18:44.072593 20484 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:44.092198 19070 rpcz_store.cc:276] 0709 13:18:41.819607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.824543 (+  4936us) service_pool.cc:224] Handling call
0709 13:18:42.134196 (+309653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.146514 (+ 12318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.067010 (+1920496us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400057650. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:44.067154 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711462656}
I20260709 13:18:44.093444 19218 rpcz_store.cc:276] 0709 13:18:42.613432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.092248 (+1478816us) service_pool.cc:224] Handling call
0709 13:18:44.092565 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.092736 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.092764 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.092802 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:44.092829 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.092895 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.093021 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:44.094929 19068 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.470s	user 0.057s	sys 0.040s
I20260709 13:18:44.095340 19218 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:44.091180 19747 pending_rounds.cc:107] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:44.085567 19217 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.096235 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 55) took 2781 ms. Trace:
I20260709 13:18:44.098537 19213 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.099202 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 981) took 1484 ms. Trace:
I20260709 13:18:44.099566 19213 rpcz_store.cc:276] 0709 13:18:42.614790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.098006 (+1483216us) service_pool.cc:224] Handling call
0709 13:18:44.098262 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.098939 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.099134 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.096787 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 980) took 1482 ms. Trace:
I20260709 13:18:44.101257 19218 rpcz_store.cc:276] 0709 13:18:42.614522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.094754 (+1480232us) service_pool.cc:224] Handling call
0709 13:18:44.095042 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.095712 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.096734 (+  1022us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:44.082326 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.055s	sys 0.091s
W20260709 13:18:44.102027 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.055s	sys 0.091s
I20260709 13:18:44.102649 19218 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:44.102988 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 1.12586e+06us
I20260709 13:18:44.104841 20656 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:44.105254 20657 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:44.105641 20656 raft_consensus.cc:3055] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.105960 20657 consensus_queue.cc:1243] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:44.105996 20656 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:44.106400 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.643s (SENT) [suppressed 4 similar messages]
I20260709 13:18:44.103227 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1221) took 1353 ms. Trace:
I20260709 13:18:44.097878 19066 rpcz_store.cc:276] 0709 13:18:41.315247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.488641 (+173394us) service_pool.cc:224] Handling call
0709 13:18:41.488959 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.489277 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.489312 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.490513 (+  1201us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.726027 (+235514us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:42.386438 (+660411us) log.cc:844] Serialized 14 byte log entry
0709 13:18:44.063432 (+1676994us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:44.089953 (+ 26521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.090031 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.095955 (+  5924us) raft_consensus.cc:1685] finished
0709 13:18:44.096046 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.096179 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1107263,"prepare.run_cpu_time_us":7521,"prepare.run_wall_time_us":46517,"raft.queue_time_us":67554,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":24564,"spinlock_wait_cycles":21356160,"thread_start_us":2582087,"threads_started":3,"wal-append.queue_time_us":583936}
I20260709 13:18:44.107115 20656 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.108299 20656 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:44.108842 19715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.003s	sys 0.011s
I20260709 13:18:44.109031 19217 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:44.107138 19218 rpcz_store.cc:276] 0709 13:18:42.749956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.102057 (+1352101us) service_pool.cc:224] Handling call
0709 13:18:44.102368 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.102994 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.103163 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:44.079350 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 43822.6us
I20260709 13:18:44.110492 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1223) took 1149 ms. Trace:
W20260709 13:18:44.109189 19715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.003s	sys 0.011s
I20260709 13:18:44.111120 19184 leader_election.cc:400] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:44.111464 19184 leader_election.cc:403] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.112010 20484 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:44.110798 19218 rpcz_store.cc:276] 0709 13:18:42.961236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.109785 (+1148549us) service_pool.cc:224] Handling call
0709 13:18:44.110045 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.110201 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.110235 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.110274 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.110301 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.110350 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.110445 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.113620 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1224) took 1141 ms. Trace:
I20260709 13:18:44.113902 19218 rpcz_store.cc:276] 0709 13:18:42.972208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.112909 (+1140701us) service_pool.cc:224] Handling call
0709 13:18:44.113152 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.113316 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.113342 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.113379 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.113407 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.113462 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.113574 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:44.114753 19747 raft_consensus.cc:2889] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:44.117072 19714 leader_election.cc:336] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.833s (SENT)
W20260709 13:18:44.117682 19216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.000s	sys 0.000s
W20260709 13:18:44.118006 19216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.000s	sys 0.000s
I20260709 13:18:44.119238 20484 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.119740 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 76) took 3065 ms. Trace:
I20260709 13:18:44.120332 20544 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:44.120584 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1218) took 1507 ms. Trace:
W20260709 13:18:44.121749 19067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1219) took 2436 ms (client timeout 2013 ms). Trace:
I20260709 13:18:44.120996 19216 rpcz_store.cc:276] 0709 13:18:42.612836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.227385 (+614549us) service_pool.cc:224] Handling call
0709 13:18:43.397167 (+169782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.568614 (+171447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.573788 (+  5174us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.580526 (+  6738us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.118416 (+537890us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.118462 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.118532 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.120358 (+  1826us) raft_consensus.cc:1685] finished
0709 13:18:44.120391 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.120534 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3976,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":21301,"thread_start_us":537429,"threads_started":1,"wal-append.queue_time_us":536928}
W20260709 13:18:44.122386 19067 rpcz_store.cc:269] 0709 13:18:41.685274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.686690 (+  1416us) service_pool.cc:224] Handling call
0709 13:18:44.121475 (+2434785us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54002170d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:44.121632 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4990270720}
I20260709 13:18:44.123529 20577 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.124038 20577 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:44.125020 20577 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:44.096885 20258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.045s	sys 0.134s
I20260709 13:18:44.120080 19140 rpcz_store.cc:276] 0709 13:18:41.054391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.698111 (+643720us) service_pool.cc:224] Handling call
0709 13:18:41.698385 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.688484 (+990099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.119486 (+1431002us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54002b7ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:44.119654 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275443456}
W20260709 13:18:44.133849 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.134506 20565 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.134934 20565 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.137018 20530 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.137725 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 975) took 1524 ms. Trace:
I20260709 13:18:44.137493 20530 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.140165 20530 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:44.141144 20565 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.138056 19219 rpcz_store.cc:276] 0709 13:18:42.613162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.070022 (+1456860us) service_pool.cc:224] Handling call
0709 13:18:44.070453 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.070662 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.070691 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.071225 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.137398 (+ 66173us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.137434 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.137494 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.137537 (+    43us) raft_consensus.cc:1685] finished
0709 13:18:44.137548 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.137676 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":65782,"threads_started":1,"wal-append.queue_time_us":64509}
W20260709 13:18:44.151172 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.935s	user 0.039s	sys 0.050s
W20260709 13:18:44.151707 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.936s	user 0.039s	sys 0.050s
I20260709 13:18:44.152295 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 58) took 2757 ms. Trace:
I20260709 13:18:44.159582 20552 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:44.160317 20552 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.167559 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:44.168299 19750 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:18:44.168678 19750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 300) took 2270 ms (client timeout 1968 ms). Trace:
W20260709 13:18:44.169008 19750 rpcz_store.cc:269] 0709 13:18:41.898384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.898522 (+   138us) service_pool.cc:224] Handling call
0709 13:18:44.167422 (+2268900us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:44.168618 (+  1196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3242880}
I20260709 13:18:44.169678 20669 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:44.172495 20670 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:44.172833 20670 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:44.173825 20670 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.178807 20673 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:44.183594 20673 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.188936 20673 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.195484 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 972) took 3918 ms. Trace:
I20260709 13:18:44.196014 19143 rpcz_store.cc:276] 0709 13:18:40.277375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.546944 (+1269569us) service_pool.cc:224] Handling call
0709 13:18:41.547265 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.548706 (+  1441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.548739 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.648088 (+ 99349us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.723672 (+1075584us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:42.726510 (+  2838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.726642 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.195182 (+1468540us) raft_consensus.cc:1685] finished
0709 13:18:44.195219 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.195402 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":861,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":998026,"threads_started":1,"wal-append.queue_time_us":1353182,"wal-append.run_cpu_time_us":1979,"wal-append.run_wall_time_us":1068921}
I20260709 13:18:44.187021 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1191) took 3362 ms. Trace:
W20260709 13:18:44.201594 20659 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.620s	user 0.006s	sys 0.000s
I20260709 13:18:44.200836 19215 rpcz_store.cc:276] 0709 13:18:40.824324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.314508 (+490184us) service_pool.cc:224] Handling call
0709 13:18:41.314763 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.486273 (+171510us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:41.874847 (+388574us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.031330 (+1156483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.031398 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:43.031455 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.186729 (+1155274us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400161054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:44.186792 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.186952 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125221,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":96,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":9108,"spinlock_wait_cycles":393853824,"thread_start_us":1479331,"threads_started":2,"wal-append.queue_time_us":1290943}
I20260709 13:18:44.180084 20552 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.189388 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1220) took 1513 ms. Trace:
I20260709 13:18:44.203263 19213 rpcz_store.cc:276] 0709 13:18:42.676370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.100351 (+1423981us) service_pool.cc:224] Handling call
0709 13:18:44.100643 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.166632 (+ 65989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.166670 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.167100 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.189050 (+ 21950us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.189092 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.189163 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.189206 (+    43us) raft_consensus.cc:1685] finished
0709 13:18:44.189225 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.189334 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2111,"raft.queue_time_us":47567,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":121,"thread_start_us":54982,"threads_started":2,"wal-append.queue_time_us":7113}
I20260709 13:18:44.206398 20552 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.207746 19038 leader_election.cc:400] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5.
I20260709 13:18:44.208060 19038 leader_election.cc:403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.208105 20668 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:44.209056 20466 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:44.210067 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 77244.6us
I20260709 13:18:44.211961 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:44.212569 20484 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.212947 20484 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:44.209743 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:44.214192 20110 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.215449 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.215728 20110 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.216361 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.217131 20110 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.217187 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:44.219897 19111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.480s	user 0.003s	sys 0.022s
W20260709 13:18:44.220216 19111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.003s	sys 0.022s
I20260709 13:18:44.220925 20466 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5.
I20260709 13:18:44.152740 19068 rpcz_store.cc:276] 0709 13:18:41.395023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.496297 (+101274us) service_pool.cc:224] Handling call
0709 13:18:41.496576 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.497161 (+   585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.497194 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.497633 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.624132 (+126499us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:44.095352 (+2471220us) log.cc:844] Serialized 14 byte log entry
0709 13:18:44.151944 (+ 56592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.152021 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.152059 (+    38us) raft_consensus.cc:1685] finished
0709 13:18:44.152077 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.152237 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1025657,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":11382,"raft.queue_time_us":162,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":192,"thread_start_us":2653153,"threads_started":3,"wal-append.queue_time_us":181596,"wal-append.run_cpu_time_us":3200,"wal-append.run_wall_time_us":1204714}
I20260709 13:18:44.222968 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:44.213296 20484 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.234710 19750 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:44.234735 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:44.223778 20444 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:44.235647 20444 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.236539 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.237633 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.238880 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:44.225145 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.223327 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.225872 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.240121 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.226392 19139 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:44.226605 19071 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:44.225484 19220 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.228120 20409 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.228292 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.228704 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.227036 20110 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.231732 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:44.243360 19747 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:44.243561 19067 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:18:44.233729 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.223832 19066 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:44.244767 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.244808 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.238787 20675 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:44.240254 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.227517 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.241914 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.249716 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.208729 20668 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.246387 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:44.249768 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.281580 19138 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.276520 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.282173 19143 raft_consensus.cc:2368] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:44.283035 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.284140 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.284479 20454 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:44.278117 19216 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:44.260798 20548 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.280138 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.285790 19071 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:44.240789 20633 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:44.256083 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.286522 20633 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.287060 19071 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:44.287473 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.288177 19140 raft_consensus.cc:2368] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:18:44.288549 20633 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.249475 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:44.285805 20548 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.291074 19066 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:44.279706 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.291678 20668 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:44.292380 19068 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:44.249318 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.288643 19141 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:44.293435 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:44.294440 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.294967 19141 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:44.296042 19141 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.238059 20673 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:44.284646 19215 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:44.285153 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.297518 19138 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:44.297968 19213 raft_consensus.cc:2368] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
W20260709 13:18:44.256927 19186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.668s	user 0.009s	sys 0.030s
I20260709 13:18:44.286546 19218 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:44.242393 20409 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:44.289721 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.285360 20563 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.266811 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:44.267843 20671 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:44.248404 20110 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.272349 19220 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:44.301328 19069 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:44.302170 19070 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:44.292481 20548 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.289881 19216 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:44.306097 19186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.717s	user 0.009s	sys 0.031s
W20260709 13:18:44.307201 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.307336 19140 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 13:18:44.307416 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 70980.5us
I20260709 13:18:44.307933 19140 pending_rounds.cc:85] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 4
I20260709 13:18:44.308640 19140 pending_rounds.cc:107] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:44.309033 19218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:44.309752 19218 raft_consensus.cc:606] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.310258 19218 raft_consensus.cc:614] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:44.311071 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.312587 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.313380 19215 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:44.314344 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.315009 19215 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:44.316006 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.318163 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:44.331970 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.332469 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.352593 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.353438 19215 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.309069 19140 raft_consensus.cc:2889] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.255375 20413 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:44.303222 20563 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:44.250730 20444 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.357182 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.357710 19140 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.358150 19219 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:44.261438 20425 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.359246 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.359344 20425 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.261274 20536 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.349912 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.368007 20110 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:44.283058 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.363041 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.360710 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.365089 19146 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:44.368462 20110 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.302970 20633 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:18:44.374290 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.371304 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.375811 20536 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.378260 20536 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.379938 19147 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:44.376176 20679 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.402577 20679 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:44.456550 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 152830us
W20260709 13:18:44.487528 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.505096 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 45850.1us
I20260709 13:18:44.507253 20680 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:44.522563 20679 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:44.523458 20679 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:44.524041 20679 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.526798 20679 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:44.532493 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.535334 20552 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:44.536195 20552 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:44.548009 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 176751us
I20260709 13:18:44.549795 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.550387 19218 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:44.373963 20678 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.553434 20678 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.555848 20678 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:44.556425 19138 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:44.558188 20110 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:44.354741 20530 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.559017 20530 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.561759 20530 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:44.563484 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.371976 20409 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:44.556567 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.597952 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 90381.7us
I20260709 13:18:44.306280 20671 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:44.602218 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52507.5us
I20260709 13:18:44.546789 20413 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.572708 20409 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.610503 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.611508 20671 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:44.612051 20671 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.612063 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.604368 20484 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.613070 20563 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.613483 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:44.614271 20563 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.614351 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:44.614588 20484 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:44.604776 20677 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:44.566229 19143 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:44.605208 20678 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.608932 20466 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:44.609378 20552 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:44.614609 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1216) took 2002 ms (client timeout 1874 ms). Trace:
W20260709 13:18:44.622309 19220 rpcz_store.cc:269] 0709 13:18:42.612269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.987551 (+375282us) service_pool.cc:224] Handling call
0709 13:18:44.614452 (+1626901us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540032dcd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:44.614546 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2844455808}
I20260709 13:18:44.623703 20466 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.616338 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.625829 20466 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.618682 20413 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.362160 20425 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.627306 19220 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:44.611987 20478 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.621598 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.633842 19221 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:44.572461 20668 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.618783 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1527) took 2784 ms. Trace:
I20260709 13:18:44.600286 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:44.618233 20484 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.619197 20671 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:44.640585 19113 leader_election.cc:400] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:44.640930 19113 leader_election.cc:403] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.636088 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.642724 19221 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:44.642948 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:44.644358 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:44.620909 20677 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.643471 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.646232 20530 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.651911 20530 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.651984 19221 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:44.652354 20530 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:44.646853 19145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1516) took 2826 ms (client timeout 2118 ms). Trace:
I20260709 13:18:44.653163 20677 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:44.653405 19145 rpcz_store.cc:269] 0709 13:18:41.820818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.823845 (+  3027us) service_pool.cc:224] Handling call
0709 13:18:44.646615 (+2822770us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400327b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:44.646751 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288962304}
I20260709 13:18:44.655387 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:44.656240 19064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1526) took 2831 ms (client timeout 2129 ms). Trace:
I20260709 13:18:44.641336 20671 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:44.657974 20671 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.637554 19065 rpcz_store.cc:276] 0709 13:18:41.833111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.659933 (+826822us) service_pool.cc:224] Handling call
0709 13:18:42.660302 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.780944 (+120642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.782334 (+  1390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.794215 (+ 11881us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:42.797405 (+  3190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.601749 (+1804344us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001ba654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:44.609955 (+  8206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.617354 (+  7399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244020096}
I20260709 13:18:44.661319 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:44.656625 19064 rpcz_store.cc:269] 0709 13:18:41.825128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.304476 (+479348us) service_pool.cc:224] Handling call
0709 13:18:44.655225 (+2350749us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:44.656158 (+   933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7684864}
I20260709 13:18:44.662794 20538 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:44.665014 20538 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:44.665963 20538 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.666661 20538 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:44.667832 20538 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:44.671653 20538 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.639153 20425 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:44.950680 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:44.951086 20425 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:44.951694 20425 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.951819 19142 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:44.702693 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.953693 19065 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:44.954936 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.698099 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.709432 19038 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:44.957098 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 247610us
I20260709 13:18:44.687511 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.686308 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:44.688352 19069 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:44.690847 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.650545 19215 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
W20260709 13:18:44.708526 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.958s	user 0.011s	sys 0.010s
W20260709 13:18:44.679455 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 65160.5us
I20260709 13:18:44.679347 20552 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.002781 20552 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.003299 20552 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.651314 20625 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.006666 20625 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.007154 20625 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.708490 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.965022 20258 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:45.010447 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.011258 19219 raft_consensus.cc:2376] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5. Re-sending same reply.
I20260709 13:18:45.012396 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.652915 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.689308 20677 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.013720 20677 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.014449 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.015802 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:44.689090 20684 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.017870 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.017279 20684 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:45.019758 20684 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.020555 19071 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:45.021559 20611 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.022531 20611 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.023051 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.023933 19216 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:44.773352 20680 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:45.024721 20611 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:44.775803 19144 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:44.789295 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1214) took 2177 ms. Trace:
I20260709 13:18:44.790908 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.826916 20530 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:44.827739 20577 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.838479 18968 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60514 (request call id 218) took 7220 ms. Trace:
I20260709 13:18:44.838433 18967 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:44.840552 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.840481 19063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 52) took 3525 ms (client timeout 1643 ms). Trace:
W20260709 13:18:44.838397 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:44.858269 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.876677 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:44.897738 19035 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.167s	user 0.008s	sys 0.026s
W20260709 13:18:44.919270 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.929469 20583 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.898681 19214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.111s	user 0.024s	sys 0.037s
I20260709 13:18:44.957315 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:44.972492 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.222s	user 0.015s	sys 0.010s
I20260709 13:18:44.958325 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.974085 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:44.961520 19212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.314s	user 0.023s	sys 0.024s
I20260709 13:18:44.977535 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:44.977735 20621 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 2.053s	user 0.009s	sys 0.020s
I20260709 13:18:44.978729 20566 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.979707 20565 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.982518 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:44.983394 20626 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.026489 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.028815 19217 rpcz_store.cc:276] 0709 13:18:42.611706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.029666 (+417960us) service_pool.cc:224] Handling call
0709 13:18:44.788801 (+1759135us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540029de54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:44.789065 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2426181376}
W20260709 13:18:45.070518 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 44338us
I20260709 13:18:45.070875 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.983237 20425 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:45.041847 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.986178 19069 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:44.962553 20442 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:44.997881 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:44.999228 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.010486 20258 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:45.016448 20677 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:44.697614 20673 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.047788 19214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.260s	user 0.026s	sys 0.037s
I20260709 13:18:45.072289 19217 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.038033 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.056196 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:45.054427 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 2.43518e+06us
W20260709 13:18:45.056160 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 79032us
W20260709 13:18:45.037061 19063 rpcz_store.cc:269] 0709 13:18:41.314453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.332191 (+ 17738us) service_pool.cc:224] Handling call
0709 13:18:44.840017 (+3507826us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001b9c54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:44.840232 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853304576}
I20260709 13:18:45.041359 19218 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:45.041442 19035 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.311s	user 0.009s	sys 0.026s
W20260709 13:18:45.028627 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.061823 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.055012 19215 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:45.044381 20670 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.033103 20530 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.034888 18967 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:45.055117 19212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.408s	user 0.024s	sys 0.028s
I20260709 13:18:45.064929 20664 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.041955 20409 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.198s
W20260709 13:18:45.241886 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.056301 20566 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:45.053254 19065 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:45.242727 18967 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.231926 20442 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:45.254091 19221 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:18:45.255661 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 199770us
I20260709 13:18:45.258424 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.259130 19219 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:45.259502 20625 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.042148 20583 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.025352 20680 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.251109 20442 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.261775 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:45.255048 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 2.52498e+06us
I20260709 13:18:45.264194 19220 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:45.056799 20565 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.276950 19218 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:45.254248 20626 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.289038 20677 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:45.289875 20566 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.292848 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:45.024868 19216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:45.293200 20409 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:45.288650 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.278167 20530 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.307082 20552 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.309181 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.312201 20425 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.251780 20664 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.316679 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:45.321980 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 80066us
I20260709 13:18:45.325937 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 968) took 3871 ms. Trace:
I20260709 13:18:45.302436 20677 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.315554 20626 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:45.325707 20409 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:45.340410 20672 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.341405 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.340951 20258 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.342720 20683 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:45.343351 20583 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:45.344015 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 55476.2us
I20260709 13:18:45.345278 20673 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.352778 19110 leader_election.cc:400] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3.
I20260709 13:18:45.353008 20626 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.329666 18967 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 4 to 3, term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4), VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) added, now has a pending config: VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1), VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2), VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:18:45.033376 18968 rpcz_store.cc:276] 0709 13:18:37.615878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.616036 (+   158us) service_pool.cc:224] Handling call
0709 13:18:38.867107 (+1251071us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540014ee54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f4090 00007f6103592f3a 00007f61093491cc 00007f610944737e 00007f61079082a4 00007f6107908232 00007f6107908161 00007f61079080dc 00007f6107907392 00007f61018c548c 00007f61018c48c6
0709 13:18:44.836569 (+5969462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:40.333918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:40.334593 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:40.334638 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:18:40.334658 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:40.335002 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:40.335064 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:40.335099 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:40.335292 (+   193us) tablet.cc:701] Row locks acquired
0709 13:18:40.335308 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:40.335446 (+   138us) write_op.cc:270] Start()
0709 13:18:40.335555 (+   109us) write_op.cc:276] Timestamp: P: 1783603120335402 usec, L: 0
0709 13:18:40.335582 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:40.336247 (+   665us) log.cc:844] Serialized 533 byte log entry
0709 13:18:41.499384 (+1163137us) op_driver.cc:464] REPLICATION: finished
0709 13:18:42.811733 (+1312349us) write_op.cc:301] APPLY: starting
0709 13:18:42.837881 (+ 26148us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:42.866671 (+ 28790us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.992790 (+126119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:43.011723 (+ 18933us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:43.011893 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:43.011939 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:43.044032 (+ 32093us) log.cc:844] Serialized 23 byte log entry
0709 13:18:43.461725 (+417693us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:43.461946 (+   221us) write_op.cc:454] Released schema lock
0709 13:18:43.543953 (+ 82007us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:44.072106 (+528153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:44.072135 (+    29us) write_op.cc:454] Released schema lock
0709 13:18:44.201103 (+128968us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
Metrics: {"mutex_wait_us":241054,"reported_tablets":2,"spinlock_wait_cycles":637086080,"child_traces":[["op",{"apply.queue_time_us":1268987,"apply.run_cpu_time_us":13802,"apply.run_wall_time_us":1267011,"num_ops":1,"prepare.queue_time_us":436372,"prepare.run_cpu_time_us":28342,"prepare.run_wall_time_us":357802,"raft.queue_time_us":549821,"raft.run_cpu_time_us":33077,"raft.run_wall_time_us":1151999,"replication_time_us":1151768,"spinlock_wait_cycles":3889920,"thread_start_us":2214489,"threads_started":5,"wal-append.queue_time_us":1037404,"wal-append.run_cpu_time_us":69592,"wal-append.run_wall_time_us":3065754}]]}
I20260709 13:18:45.334604 20684 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.357782 20552 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.359889 20664 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.340420 20536 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.360822 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:45.361337 20680 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:45.333727 20530 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.362011 20672 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:45.346750 20625 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.366465 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.366096 20409 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:45.368602 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.368716 20677 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.381614 19072 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:45.370080 20565 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.370421 20577 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:45.347151 20566 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.397482 20577 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:45.397979 20577 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.327718 19214 rpcz_store.cc:276] 0709 13:18:41.452358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.572824 (+120466us) service_pool.cc:224] Handling call
0709 13:18:41.573104 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.573272 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:42.787513 (+1214241us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.256441 (+2468928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.277717 (+ 21276us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:45.302782 (+ 25065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.314291 (+ 11509us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.323429 (+  9138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8579,"prepare.queue_time_us":78017,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":10826,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":10339,"thread_start_us":3626458,"threads_started":2,"wal-append.queue_time_us":784764,"wal-append.run_cpu_time_us":2113,"wal-append.run_wall_time_us":1181717}
I20260709 13:18:45.401889 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.402761 19214 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.383008 20672 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.405525 18967 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.406528 20530 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.369428 20466 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:45.392817 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.393185 20683 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:45.394109 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 60086.1us
I20260709 13:18:45.393721 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.394556 20454 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:45.394917 20536 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:45.395501 19218 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.417171 19217 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:45.396669 20673 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:45.407747 19216 raft_consensus.cc:606] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:45.408521 20466 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:45.419471 20677 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.414019 20683 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:45.422263 20454 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:45.434974 20684 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.437048 20583 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.424096 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.439019 19216 raft_consensus.cc:614] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:45.445925 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 161698us
W20260709 13:18:45.448974 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 131258us
I20260709 13:18:45.441308 20466 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.444092 20683 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.444542 20454 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.446247 20583 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.463161 19213 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
W20260709 13:18:45.465899 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 73274.8us
I20260709 13:18:45.470446 19214 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:45.465476 20583 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.473934 20669 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.474113 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:45.475275 20254 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:45.475782 20254 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:45.477073 20530 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:45.477321 20704 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:45.477746 20530 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:45.479090 20670 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:45.478873 20530 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.479501 20670 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:45.471482 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:45.481611 20565 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.483322 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.484481 19216 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:45.488291 20258 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.484023 20536 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.474148 20701 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.492519 20701 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.493223 20425 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:45.494304 20680 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:45.494864 20701 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.496255 20680 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:45.496078 20254 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.497540 20254 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.499928 20454 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.500914 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1213) took 2889 ms. Trace:
I20260709 13:18:45.517596 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:45.519641 19218 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:45.466674 20677 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.496801 20680 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:45.537487 19214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
W20260709 13:18:45.547215 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 71054us
I20260709 13:18:45.480538 20670 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:45.549633 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 78552.4us
I20260709 13:18:45.546456 19214 raft_consensus.cc:606] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:45.553529 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:45.556816 19220 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:45.561293 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.561220 20466 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.561949 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:45.562930 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 92529us
I20260709 13:18:45.568122 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 986) took 1256 ms. Trace:
I20260709 13:18:45.568823 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.570122 20466 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.570766 20669 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:45.571168 20669 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:45.571350 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.571630 20669 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.573256 19072 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:45.573266 20538 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:45.573771 20538 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:45.574457 20704 raft_consensus.cc:2764] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:18:45.574785 20538 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.575335 20680 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.576187 20538 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.568478 19213 rpcz_store.cc:276] 0709 13:18:44.311737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.312140 (+   403us) service_pool.cc:224] Handling call
0709 13:18:45.566989 (+1254849us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540034c954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:45.568071 (+  1082us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349680896}
I20260709 13:18:45.553920 20626 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:45.565412 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.579839 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.591655 20673 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:45.591864 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.593984 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.594732 19068 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:45.595767 20577 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.596171 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.563724 20565 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.596908 19068 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.597268 20565 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.599413 20565 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.581092 20552 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:45.602449 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.603662 19072 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.566249 20469 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:45.606187 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.592592 20673 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:18:45.587663 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.612072 19219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:45.615767 19219 raft_consensus.cc:606] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:45.616243 19219 raft_consensus.cc:614] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:45.567153 20684 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:45.615996 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.618500 19214 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.605981 20670 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.618305 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.626032 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.613875 20552 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:45.633183 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 75031.6us
I20260709 13:18:45.614360 20469 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:45.635309 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.617926 20626 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:45.642237 20626 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.629650 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:45.645040 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.645416 19065 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:45.645478 19064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:18:45.646116 19064 raft_consensus.cc:606] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:45.649559 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.619575 20530 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.628230 20254 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:45.660188 19214 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:45.636310 19216 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:45.677239 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.682435 19220 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:45.682978 20695 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.685652 19220 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:45.655177 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 94036us
I20260709 13:18:45.512532 19212 rpcz_store.cc:276] 0709 13:18:42.611279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.622649 (+ 11370us) service_pool.cc:224] Handling call
0709 13:18:42.646924 (+ 24275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.261159 (+2614235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.261206 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.329150 (+ 67944us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.457760 (+128610us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:45.459604 (+  1844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.472712 (+ 13108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.500636 (+ 27924us) raft_consensus.cc:1685] finished
0709 13:18:45.500664 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.500838 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76536,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":23746,"thread_start_us":2691179,"threads_started":2,"wal-append.queue_time_us":125006}
I20260709 13:18:45.668381 20454 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.671871 20683 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:45.672569 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.624936 20442 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.661427 20254 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:45.673678 20711 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:45.674888 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.675707 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:45.676759 20552 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.690237 19213 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:45.685036 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.702390 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:45.693486 19072 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:45.683414 20695 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.697486 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:45.660228 20530 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.702708 19214 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:45.702461 19067 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:45.704826 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.703300 20695 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.709308 19742 raft_consensus.cc:2410] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:45.713073 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08000c4b40 after lost signal to thread 17967
I20260709 13:18:45.713608 19745 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:45.713290 20254 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:45.714460 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3b00 after lost signal to thread 19004
I20260709 13:18:45.714954 20611 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:45.716286 19242 debug-util.cc:398] Leaking SignalData structure 0x7b080032aea0 after lost signal to thread 19096
I20260709 13:18:45.717743 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.718271 19071 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.714421 20254 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.719367 19747 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.717226 20611 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:45.719238 20530 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.722518 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:45.723459 19212 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.724987 20566 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.724848 20669 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.725919 20566 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.726305 20566 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.726639 20566 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.727190 20669 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.728223 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:45.701974 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.730911 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.736274 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.720031 20577 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.748857 19219 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:45.735878 20625 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.750694 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.751461 19067 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:45.754055 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.720746 20583 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.731572 20684 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:18:45.743619 20677 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.757274 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.757994 19035 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:45.756831 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.759078 20669 raft_consensus.cc:2764] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:45.761682 20442 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.762897 20683 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:45.763372 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1006) took 1058 ms. Trace:
I20260709 13:18:45.763723 19213 rpcz_store.cc:276] 0709 13:18:44.704891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.614361 (+909470us) service_pool.cc:224] Handling call
0709 13:18:45.621100 (+  6739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.702027 (+ 80927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.763141 (+ 61114us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54000753d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:45.763321 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143648512}
I20260709 13:18:45.764740 20583 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.765158 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:51744
W20260709 13:18:45.765614 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2140 after lost signal to thread 19171
I20260709 13:18:45.765763 19144 raft_consensus.cc:606] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:45.766886 19242 debug-util.cc:398] Leaking SignalData structure 0x7b0800366dc0 after lost signal to thread 19245
I20260709 13:18:45.771602 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.772279 19745 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:45.772480 19064 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:45.773224 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 106148us
I20260709 13:18:45.775913 19067 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:45.752979 20625 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.778213 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:45.778374 20625 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.779155 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:45.780490 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:45.781724 20577 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.781936 20710 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:45.782230 19065 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:45.786038 19067 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:45.783272 19072 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
W20260709 13:18:45.788064 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.788252 20583 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.789130 20704 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:45.777314 20566 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.789506 20704 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:45.789893 20704 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.791079 20566 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.788800 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:45.793943 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.794109 20710 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.793953 19745 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.798722 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:45.799817 20701 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:18:45.777333 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08002646a0 after lost signal to thread 19775
I20260709 13:18:45.801776 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.794104 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1249) took 1088 ms. Trace:
I20260709 13:18:45.809724 19221 rpcz_store.cc:276] 0709 13:18:44.705700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.626190 (+920490us) service_pool.cc:224] Handling call
0709 13:18:45.683895 (+ 57705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.693792 (+  9897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.693819 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.693859 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:45.697939 (+  4080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.697983 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.793944 (+ 95961us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5400161050. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:45.794048 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4887936}
W20260709 13:18:45.811882 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.809674 20577 raft_consensus.cc:2764] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:18:45.814553 19216 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.782159 20695 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.818214 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.819478 20695 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.820606 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.821219 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.824034 19068 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:45.825894 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.826275 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.826984 19742 raft_consensus.cc:2410] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:45.826978 19750 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:45.827589 20454 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:45.828677 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:45.828783 20717 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:18:45.828573 20454 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:45.830314 20530 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.830895 20454 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:45.831867 20454 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.829418 19220 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:45.833673 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.835327 20454 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:45.836143 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 82999us
W20260709 13:18:45.838035 20715 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:18:45.839236 20530 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.819492 19747 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
W20260709 13:18:45.841938 20716 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.160s	user 0.005s	sys 0.000s
I20260709 13:18:45.843434 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1246) took 1141 ms. Trace:
I20260709 13:18:45.843768 19215 rpcz_store.cc:276] 0709 13:18:44.701869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.315142 (+613273us) service_pool.cc:224] Handling call
0709 13:18:45.319483 (+  4341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.445039 (+125556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.445079 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.471803 (+ 26724us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.609449 (+137646us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:45.609506 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.609594 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.841441 (+231847us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b24001df018. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003239c4 00007f6100321acb 00007f61004dcdc9 00007f61004dca55 00007f61004dc09d 00007f610310e10e 00007f610312588c 00007f6103124bb6 00007f61031247d8 00007f610312e221
0709 13:18:45.843082 (+  1641us) raft_consensus.cc:1685] finished
0709 13:18:45.843103 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.843320 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55795,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":33813248,"thread_start_us":161548,"threads_started":2,"wal-append.queue_time_us":142372}
I20260709 13:18:45.849243 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.850054 19072 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:45.850229 19745 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:18:45.804642 19242 debug-util.cc:398] Leaking SignalData structure 0x7b0800238f40 after lost signal to thread 19776
I20260709 13:18:45.854280 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:45.856207 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.777151 20469 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.848244 20710 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:45.867806 20625 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:45.845263 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 46612.6us
I20260709 13:18:45.869486 19072 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:45.871006 19068 raft_consensus.cc:2410] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.871232 19070 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.863816 19218 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:45.874658 19069 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:45.857662 19215 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:45.858187 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.859545 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.890246 19072 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:45.896916 19064 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:45.898249 19070 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:45.898458 20583 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.898885 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 61860.2us
I20260709 13:18:45.899713 20466 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:45.901067 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 110603us
I20260709 13:18:45.901762 19144 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:45.888994 20566 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:18:45.905871 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.908581 19072 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:45.904250 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.863337 20718 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:45.914446 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.910140 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.915676 19070 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.907107 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:45.910235 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.920002 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.921089 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.923141 19072 raft_consensus.cc:2410] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.927860 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:45.928995 20625 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:45.898934 20583 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.934132 20670 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.934967 20583 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:45.935731 20466 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.936272 20466 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:45.937301 20466 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:45.912519 20718 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:45.941538 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.942418 19064 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.942214 20718 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.943640 20718 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.945266 19213 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:45.947464 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:45.949609 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.950361 19750 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:45.929081 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1247) took 1223 ms. Trace:
I20260709 13:18:45.951474 19217 rpcz_store.cc:276] 0709 13:18:44.705179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.615307 (+910128us) service_pool.cc:224] Handling call
0709 13:18:45.638255 (+ 22948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.672936 (+ 34681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.672966 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.699458 (+ 26492us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.758672 (+ 59214us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.758704 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.758782 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.928855 (+170073us) raft_consensus.cc:1685] finished
0709 13:18:45.928894 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.929024 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":29377,"threads_started":1,"wal-append.queue_time_us":153997}
I20260709 13:18:45.950686 19749 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.960608 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.962160 19742 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:45.962267 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.963177 19744 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:18:45.965150 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 59713.9us
I20260709 13:18:45.966619 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.967264 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.968257 20721 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:45.968792 20721 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:45.969412 20704 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:45.925021 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:45.962548 19742 pending_rounds.cc:85] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 4
I20260709 13:18:45.968289 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:45.929136 19745 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:45.979246 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:45.980007 20704 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:45.980367 20712 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:18:45.981007 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.981246 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:45.981699 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:45.984444 20583 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:45.977733 19742 pending_rounds.cc:107] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:45.984964 20254 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:45.985483 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:45.985991 20672 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:45.918677 20552 consensus_queue.cc:1059] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:45.924211 20538 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.998037 19070 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:45.989663 19142 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:45.969841 20721 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.002830 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:46.051234 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.055831 19750 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:46.055557 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:45.989567 19065 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.060472 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:45.988816 20717 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.061769 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.061884 20717 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.063090 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.014868 19742 raft_consensus.cc:2889] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.064136 20717 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.005806 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.006251 19139 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:46.064653 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:46.065423 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.065718 19141 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.066552 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.066658 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.066736 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.067536 20712 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.007524 19749 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:46.067732 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.002522 20684 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.069315 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.005314 20583 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:46.069770 20583 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:46.009209 20728 log.cc:927] Time spent T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:18:46.071928 19110 connection.cc:256] RPC call timeout handler was delayed by -2.5411444860001211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:18:46.057590 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:46.072381 19110 connection.cc:256] RPC call timeout handler was delayed by -1.0376840480000737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30720000000000003s for a response
I20260709 13:18:46.010185 20680 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.058264 20536 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.059785 20625 raft_consensus.cc:3055] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.064240 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.068351 19141 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.068898 20684 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.071576 20712 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.099105 19144 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:46.058465 19145 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:46.078353 19142 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.057054 20538 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.073658 20677 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.079522 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 80631.9us
W20260709 13:18:46.097880 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 88357.1us
I20260709 13:18:46.078109 20454 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.078370 20536 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:18:46.111181 20735 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:18:46.067795 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.112572 20684 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.080354 20625 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:46.114928 20712 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.115360 20591 raft_consensus.cc:2764] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:46.116001 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.116281 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.153574 19146 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:46.145334 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:46.079847 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.506s (SENT)
W20260709 13:18:46.119570 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 64124us
W20260709 13:18:46.136909 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.140508 19213 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:46.141098 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.156648 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:46.157238 19070 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.098083 20425 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.146310 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:46.118858 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.159042 19214 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:46.155552 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:46.101819 20683 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:18:46.139209 19065 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:46.172678 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.174403 19145 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:46.165283 20454 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:46.176039 20729 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:18:46.177181 20454 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:46.169862 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.187803 19070 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:46.185899 19142 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:46.163199 20469 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.141583 20583 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.188305 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:46.194603 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 114780us
I20260709 13:18:46.165732 20712 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:46.148223 20677 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.198182 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:46.198397 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:46.197134 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 61443.3us
I20260709 13:18:46.186936 19139 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:46.197608 20626 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.203202 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:46.204816 19144 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:46.213557 19218 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:46.208379 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.207475 20254 raft_consensus.cc:993] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:18:46.191080 20425 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.205080 20712 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:46.281967 20737 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:46.206878 20677 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:46.287242 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.208341 20714 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:46.287690 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:46.317646 19221 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:46.287900 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.200479 20466 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:18:46.205366 20625 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.213224 20536 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:46.294842 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.211632 19064 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:46.301887 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.302354 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:46.302860 20709 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:18:46.225287 20683 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.286161 20538 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.220603 20442 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:18:46.314428 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:46.336959 20736 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:18:46.337086 20683 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.337311 20583 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.337548 20683 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.315591 19147 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.207365 20611 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:18:46.311869 20717 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:46.325716 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 117415us
I20260709 13:18:46.341286 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.329192 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:46.313954 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 98374.6us
I20260709 13:18:46.335004 19142 raft_consensus.cc:2410] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:46.342521 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:46.317239 20714 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:46.328399 20469 raft_consensus.cc:1081] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Signalling peer 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:18:46.346518 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.351501 20611 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.351471 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.351887 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.352515 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.352802 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.353560 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.353483 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.354425 19142 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:46.355118 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.353864 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.362721 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:46.373411 19067 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:46.374708 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.379501 19070 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:46.375572 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:46.344798 19065 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.339077 20566 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:46.385766 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.347401 20536 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.386881 19069 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.392243 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.376014 20721 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:46.394869 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52440.6us
I20260709 13:18:46.395437 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:46.396849 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.400338 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.401146 19142 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:46.403904 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.376209 20717 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:46.384994 20680 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:46.396677 20684 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:46.434104 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 78766us
I20260709 13:18:46.394629 20714 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.439903 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.436591 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.440583 19142 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.441057 19141 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:46.433511 20425 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.435609 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.436508 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.445444 19147 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 1.
I20260709 13:18:46.448210 20714 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.453632 20712 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.453986 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.455502 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.449528 20566 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:46.473680 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.474493 19141 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.496984 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.497864 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:46.506639 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 70338.4us
I20260709 13:18:46.515110 19063 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
W20260709 13:18:46.517134 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.517568 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.503522 20591 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.524704 19142 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:46.500489 20758 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:46.516254 20672 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.506131 20680 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.536614 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.497113 20756 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:46.517153 19749 raft_consensus.cc:2955] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:18:46.573966 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49941.5us
W20260709 13:18:46.574653 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 78601.5us
I20260709 13:18:46.586977 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.588336 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:46.597306 20625 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.519369 19742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6"
dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:42932
W20260709 13:18:46.598519 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.601486 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.548568 20672 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.605330 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:46.613943 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.616770 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:46.605541 19742 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:46.601164 20762 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:46.599723 20566 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:46.611779 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.621943 19184 leader_election.cc:400] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:46.610159 20704 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.621564 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:46.626557 20745 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:46.626694 20683 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.629072 20454 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.629551 20454 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.631554 20454 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.635447 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:46.635669 19221 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.637573 19215 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:46.638362 19219 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:46.638506 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:46.638603 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:46.639293 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:46.639605 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:46.639710 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.640146 20721 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.640538 20721 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.640889 20721 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.645085 20762 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:46.645355 19072 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:46.645694 19072 pending_rounds.cc:85] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 4
I20260709 13:18:46.645911 19072 pending_rounds.cc:107] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:46.646127 19072 raft_consensus.cc:2889] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.646071 20762 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.648494 20538 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:46.636734 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:46.649403 19221 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:46.649718 20714 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.650128 20714 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:46.650484 20714 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.639906 19219 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:46.652027 20683 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.652967 19147 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:46.655438 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:18:46.659101 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.649396 20425 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:18:46.666486 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.666788 19064 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.666891 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:46.667572 19751 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.668051 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.669251 19184 leader_election.cc:400] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:18:46.669564 19184 leader_election.cc:403] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:46.667198 19147 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:46.621737 19742 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.674145 19215 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:46.679397 19141 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:46.680179 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.623278 20758 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:46.685369 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:46.687228 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:46.690582 19142 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:46.671120 20454 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:46.692552 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:46.693058 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.698606 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:46.685421 20752 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:18:46.707175 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.707540 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:46.707777 19142 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:46.706561 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:46.681447 20425 consensus_queue.cc:1243] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:46.709117 19146 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:46.683248 20536 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:46.686715 20704 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:18:46.715696 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:46.700644 20753 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.202s	user 0.000s	sys 0.003s
I20260709 13:18:46.717698 19215 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
W20260709 13:18:46.729811 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44519.8us
I20260709 13:18:46.730878 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:46.694991 20454 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:18:46.735989 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.739154 19142 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 4. Ops: [2.5-2.5]
I20260709 13:18:46.738353 19221 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.738498 20425 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:46.763996 19146 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:46.738296 20759 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.736641 20770 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:46.737882 20454 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.741535 20536 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:46.772472 19221 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:46.786090 20764 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:46.797415 20536 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.804014 19751 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
W20260709 13:18:46.805387 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 97940.6us
I20260709 13:18:46.773135 20759 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:46.778534 20770 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:46.814635 19220 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:46.779963 20425 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:46.737386 20566 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.807694 19744 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:46.818449 20759 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.805539 20762 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:46.771433 20758 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.836460 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:46.861824 19215 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.839656 19069 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:46.839583 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.849879 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:46.863619 19070 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:46.836781 19071 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.835546 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:46.838515 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 107767us
I20260709 13:18:46.862488 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:46.867336 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.869246 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:46.870793 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.871414 19069 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:46.870803 20425 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.872372 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.849509 20591 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.873620 20780 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:46.873777 20765 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.212s	user 0.000s	sys 0.002s
I20260709 13:18:46.874255 20781 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.874711 20781 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:46.875070 20781 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.875411 19139 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:46.846061 20536 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:46.877283 19217 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.877868 19746 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEARNER]: Advancing to term 5
I20260709 13:18:46.881503 19069 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:46.858299 20469 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:18:46.875698 19066 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:46.883543 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.885892 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:46.886096 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:46.887619 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:46.888103 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:46.877074 20766 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:46.858901 20718 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.889850 20718 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:46.859220 19742 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.890635 20718 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.891921 20718 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.892983 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:46.870824 20761 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:18:46.834954 20756 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:46.893128 19745 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:46.894604 20538 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.901166 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:46.902369 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.887262 20536 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.857443 20744 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:18:46.899731 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.907615 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:46.850672 20774 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 13:18:46.908187 19750 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.910424 20536 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.914021 19218 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.906083 20625 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.899348 20530 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.915299 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:46.904819 20538 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.912487 20454 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.856693 20770 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.933840 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:46.941110 20763 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:18:46.942250 20788 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.942884 20788 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.943346 20788 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.945164 20792 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.946201 20536 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.947073 20625 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.947582 20625 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.921648 20538 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.949524 20625 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:46.949810 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:46.950519 19068 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:46.950610 19746 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:46.957666 20536 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.961207 20756 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.972782 19218 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:46.973937 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:46.974627 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 70648.6us
W20260709 13:18:46.975490 20786 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:18:46.976732 20774 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:46.977275 20774 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:46.977617 20759 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.978192 20774 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.979218 20788 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.980194 20759 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:46.981369 20788 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:46.982041 20781 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:46.983975 20781 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:46.972110 20789 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.969190 20739 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:46.857201 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:46.988622 20791 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:46.990181 20714 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:46.992317 20714 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:46.993022 19144 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 4. Ops: [2.5-2.5]
I20260709 13:18:46.998003 19215 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:47.003293 20454 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:46.960433 20721 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.005236 19067 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:46.974444 20425 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.010962 20425 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.011503 20425 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.010039 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.017336 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:47.021670 19748 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:47.027494 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.026018 20759 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.035955 20672 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.046756 20721 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.050138 20680 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:47.050294 20798 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:47.050407 20799 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:47.051056 20680 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.050153 20747 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.051558 20680 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:47.051949 20747 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:47.052389 20747 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.052532 20680 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.053107 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.053727 20680 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.053808 20798 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.056758 20798 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:47.057343 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 188190us
I20260709 13:18:47.057636 20536 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.058064 20536 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:47.058434 20790 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.058880 20790 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:47.059295 20790 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.057916 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.059032 20536 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.060735 20714 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.061169 20714 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:47.061563 20714 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.058030 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:47.048741 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.060544 20536 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.066663 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.077363 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.077565 20780 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:47.078725 20787 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.079111 20787 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:47.079458 20787 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.079484 20781 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.066388 20798 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:18:47.065425 20538 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.082589 20747 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.066016 20701 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:47.075697 20677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.014s	sys 0.031s
I20260709 13:18:47.085834 20799 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.101333 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:47.093231 20677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.014s	sys 0.031s
I20260709 13:18:47.115964 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:47.120330 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.088757 20780 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:47.090314 20701 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.124584 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.125962 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.118475 20704 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.131287 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:47.131474 20538 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.132014 19141 raft_consensus.cc:2368] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
W20260709 13:18:47.133193 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 21c9cfe67c8c483e9edc1da47107fd2f: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:47.135265 20425 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.121124 20591 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.136843 20425 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.137337 20591 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:47.138311 20591 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.139246 20747 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.142978 20787 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.146332 20770 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:47.149406 20755 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.579s	user 0.004s	sys 0.000s
I20260709 13:18:47.144054 20743 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.151985 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:47.122788 20799 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.157353 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:47.160298 19146 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:47.150938 19742 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.162990 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.164475 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:47.193605 20810 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.190407 20789 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:47.195185 20677 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.168336 20790 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.195608 20789 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.199268 20787 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:47.199486 20789 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.204396 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:47.205587 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.205832 20611 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.176162 20799 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.208966 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.207871 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.213327 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.165807 20712 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.220898 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:47.221156 19214 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:47.220079 19110 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.219695 20538 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:18:47.224141 20800 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.224541 20800 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:47.225937 20790 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:47.195694 20780 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:47.195737 20677 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.226583 20466 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.228010 20747 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.225528 20800 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.232292 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.224359 20781 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.275996 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:47.232900 19213 raft_consensus.cc:2410] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:18:47.271471 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 94623us
I20260709 13:18:47.212842 20798 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.277655 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:47.281086 20611 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.281672 20611 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:47.282162 20611 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.218724 20684 raft_consensus.cc:2764] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:47.212842 20704 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:47.270658 20718 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.230443 20583 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:47.287093 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:47.300978 19147 raft_consensus.cc:2376] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3. Re-sending same reply.
I20260709 13:18:47.270176 20799 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.288089 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:47.299187 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:47.286226 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:47.299718 20790 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:47.273072 20747 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:47.303272 19145 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:47.274695 20781 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:47.304687 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:47.305299 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:47.307304 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 75107.2us
I20260709 13:18:47.230175 20743 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:18:47.319550 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:47.319792 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:47.302700 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 368890us
I20260709 13:18:47.319727 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.326186 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:47.326541 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:47.300676 20583 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:47.328365 19072 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:47.330263 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:47.331508 19071 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.332384 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:47.333135 19069 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.285753 20425 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:47.305459 20747 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.336988 19064 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:18:47.338078 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.338711 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.340374 20759 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.341400 20770 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:47.342104 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:47.342409 19142 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:47.342747 19142 pending_rounds.cc:85] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 4
I20260709 13:18:47.342944 19142 pending_rounds.cc:107] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:47.343142 19142 raft_consensus.cc:2889] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.331905 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:47.349519 20583 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.326514 20800 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.350589 20583 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.301952 20787 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:18:47.353081 20704 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.353883 20798 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.354372 20798 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.355041 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:47.272296 20780 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.357760 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:47.359575 19213 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:47.356693 20779 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.516s	user 0.002s	sys 0.001s
I20260709 13:18:47.363211 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:47.366430 19215 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.363847 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:47.366958 19219 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.319073 20790 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:47.365139 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 45477.8us
I20260709 13:18:47.368247 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.364459 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:47.371681 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 52342.1us
I20260709 13:18:47.374804 19213 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:47.379971 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:47.394251 19215 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:47.398810 19072 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:47.398834 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:47.303869 20812 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:18:47.402895 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.365636 20774 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.404706 19035 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.372587 20787 consensus_queue.cc:1243] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:47.370499 20677 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:47.380736 20530 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.380939 20756 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.412611 19072 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:47.420914 18967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 112) took 7848 ms. Trace:
I20260709 13:18:47.375187 20780 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:47.415823 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:47.417450 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.418421 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.418071 19071 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:47.405980 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:47.427306 19215 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:47.428791 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:47.428903 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:47.429965 19213 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:47.431013 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:47.434122 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.427877 19110 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:47.436447 19750 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:47.437493 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:47.437844 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 47050.7us
I20260709 13:18:47.433060 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:18:47.416712 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.446038 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.446746 19069 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:47.430111 20813 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.447867 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:47.412500 20718 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.458451 20769 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:18:47.461951 19218 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:47.463160 19218 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.464288 20788 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:47.464555 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.466452 20442 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.466857 20810 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.467248 20442 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.412181 20701 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:47.451445 19215 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:47.452602 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 150129us
I20260709 13:18:47.470329 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:47.470415 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.421342 18967 rpcz_store.cc:276] 0709 13:18:39.582108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.601907 (+ 19799us) service_pool.cc:224] Handling call
0709 13:18:47.420829 (+7818922us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:45.709604 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:45.710348 (+   744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:45.710403 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:18:45.710422 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:45.711210 (+   788us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:45.711316 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:45.711350 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:45.712051 (+   701us) tablet.cc:701] Row locks acquired
0709 13:18:45.712105 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:18:45.712270 (+   165us) write_op.cc:270] Start()
0709 13:18:45.712449 (+   179us) write_op.cc:276] Timestamp: P: 1783603125712207 usec, L: 0
0709 13:18:45.712491 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:18:45.782530 (+ 70039us) log.cc:844] Serialized 2297 byte log entry
0709 13:18:46.325195 (+542665us) op_driver.cc:464] REPLICATION: finished
0709 13:18:46.445561 (+120366us) write_op.cc:301] APPLY: starting
0709 13:18:46.445683 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:46.445891 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:46.448080 (+  2189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:46.500662 (+ 52582us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:46.547360 (+ 46698us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:18:46.547444 (+    84us) write_op.cc:312] APPLY: finished
0709 13:18:46.547842 (+   398us) log.cc:844] Serialized 47 byte log entry
0709 13:18:46.585134 (+ 37292us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:46.598998 (+ 13864us) write_op.cc:454] Released schema lock
0709 13:18:46.599073 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:46.601102 (+  2029us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:46.601129 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":884202,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":119025,"apply.run_cpu_time_us":4009,"apply.run_wall_time_us":155513,"num_ops":5,"prepare.queue_time_us":105257,"prepare.run_cpu_time_us":24058,"prepare.run_wall_time_us":193805,"raft.queue_time_us":190484,"raft.run_cpu_time_us":39319,"raft.run_wall_time_us":165206,"replication_time_us":598725,"thread_start_us":384232,"threads_started":4,"wal-append.queue_time_us":139317}]]}
I20260709 13:18:47.474414 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.425028 20466 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.478799 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:47.455372 19072 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.437934 20536 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:18:47.469609 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:47.483175 19072 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:47.485285 20762 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:47.440312 20425 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:47.489701 20807 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.323s	user 0.003s	sys 0.000s
I20260709 13:18:47.490285 20712 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.490931 20701 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.490965 20718 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:47.492636 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.493083 20772 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.497952 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:47.467255 20810 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:47.452704 20717 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:47.508154 19219 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:47.527484 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:47.502705 19072 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.434821 20530 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.441665 20714 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.540814 19072 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.492372 20718 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.525869 20538 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:47.551115 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 53255.1us
I20260709 13:18:47.560987 19035 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.561362 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:47.563162 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 129116us
I20260709 13:18:47.564246 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.527865 20712 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:47.526662 20717 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.529313 20819 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.533126 20798 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.525643 20721 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:47.538206 20672 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.528105 20469 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:18:47.559621 20780 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:47.527141 20684 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:18:47.598547 20409 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.531400 20611 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:47.608054 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 46778.8us
I20260709 13:18:47.601715 20812 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:18:47.531889 20813 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:18:47.502648 20790 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.530084 20625 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:18:47.606104 20717 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:47.602135 20538 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:47.605250 20819 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:47.612738 20752 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:47.625231 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 62950.9us
I20260709 13:18:47.630456 19072 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:47.631803 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:47.635088 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 207263us
I20260709 13:18:47.641094 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.627688 20409 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.543902 20810 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.642859 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:47.666570 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:47.628345 20819 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:47.639997 20744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.003s	sys 0.016s
I20260709 13:18:47.670496 19071 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:47.698052 19143 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:47.698851 20783 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:47.699602 20822 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:18:47.713717 20820 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:18:47.640700 20780 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:47.672066 20744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.003s	sys 0.017s
I20260709 13:18:47.720427 20538 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.724503 20536 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:47.692637 20789 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:47.694429 20672 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.715497 20466 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.664964 20826 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.695950 20591 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:47.671897 20409 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:47.755800 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 139289us
I20260709 13:18:47.667454 20712 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.776532 19184 leader_election.cc:400] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:47.776943 19184 leader_election.cc:403] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:47.724747 20714 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.730621 20611 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:47.737782 20744 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.728849 20536 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.734400 20454 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:18:47.756342 20530 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:47.788085 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 156390us
W20260709 13:18:47.733124 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 235699us
I20260709 13:18:47.802800 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.805341 19751 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:47.788434 20813 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:47.786319 20677 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:47.829015 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 334040us
W20260709 13:18:47.831131 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 66570.5us
I20260709 13:18:47.808605 20744 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:47.837141 19110 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:47.837261 19070 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:47.839761 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.818712 20756 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.840225 19070 pending_rounds.cc:85] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 4
I20260709 13:18:47.846693 19070 pending_rounds.cc:107] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:47.847034 19070 raft_consensus.cc:2889] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.841377 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:47.787601 20762 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:47.850665 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:47.852941 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.856657 20783 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.838714 20466 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:18:47.862238 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.861269 19072 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:18:47.888379 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 84267.2us
I20260709 13:18:47.889204 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:47.889935 20704 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.890383 20704 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:47.904129 20625 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:47.915195 20714 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.975466 20714 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.977528 20714 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:47.923374 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.929297 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 82) took 1762 ms. Trace:
I20260709 13:18:47.978966 19144 rpcz_store.cc:276] 0709 13:18:46.166432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.226657 (+ 60225us) service_pool.cc:224] Handling call
0709 13:18:46.890802 (+664145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.993449 (+102647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.376302 (+382853us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000307d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:47.929000 (+552698us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54000307d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:47.929177 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1760863232}
I20260709 13:18:47.931334 20425 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:47.980212 20425 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:47.980978 20425 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.933219 20680 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.983310 20680 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:47.984401 20680 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.985361 20680 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.941622 20810 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.942809 20781 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:47.992949 20781 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.953830 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:18:47.954330 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 3627cae163084c338404a5153ef0efb9: Illegal state: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:47.956187 19750 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:18:47.958763 20803 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.792s	user 0.004s	sys 0.000s
I20260709 13:18:47.968489 19749 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:47.968251 18966 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.002069 18966 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:48.003571 18966 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:48.005470 18966 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.008836 18966 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.011812 18966 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.020978 18966 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:18:48.022369 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.022313 18966 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.023485 19217 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:48.025867 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:48.026661 19217 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:47.854408 20583 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.805873 20780 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:47.853287 20812 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.028513 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:48.032335 19219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:48.051231 19219 raft_consensus.cc:606] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:48.051669 19219 raft_consensus.cc:614] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:48.035518 20854 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.023782 18966 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.036064 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:48.036115 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 147218us
I20260709 13:18:48.037112 19751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 346) took 1195 ms. Trace:
I20260709 13:18:48.038269 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:48.064595 19215 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:18:47.861724 20538 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.873745 20536 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.068053 18966 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 2 to 3, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.057042 20762 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.057850 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:48.059793 20831 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:18:47.873102 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:47.887058 20442 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.063812 19751 rpcz_store.cc:276] 0709 13:18:46.823062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.823803 (+   741us) service_pool.cc:224] Handling call
0709 13:18:46.838775 (+ 14972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.805871 (+967096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.018433 (+212562us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54005e9554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:48.018583 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222276480}
I20260709 13:18:47.874511 20792 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:48.074898 18966 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 2 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.028997 20530 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.859946 20839 consensus_queue.cc:1059] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.231s
I20260709 13:18:48.095108 19067 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:47.859745 20838 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.219s
I20260709 13:18:48.103577 18966 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:48.104928 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 215837us
I20260709 13:18:48.129835 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:48.095923 20758 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:18:48.088449 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:48.109201 20677 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.110136 20721 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.163488 20677 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.163726 20835 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:48.164773 19144 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:48.165175 20838 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:48.165529 20838 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:48.033497 20625 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:48.073792 20538 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.125002 19717 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:18:48.128175 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.134270 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:48.177115 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52215.4us
I20260709 13:18:48.177860 19221 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:48.019755 20813 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:18:48.136149 18966 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.179030 18966 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 2 to 3, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.102931 20792 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:48.145021 20758 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:48.146291 20839 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:48.111801 19064 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:48.146829 20852 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:48.147825 19067 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:48.156368 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:48.085857 20854 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.185313 18966 catalog_manager.cc:5697] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:48.188192 19147 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:48.165581 20677 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:48.166714 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.192759 19146 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:48.013101 20774 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:18:48.172072 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:48.181969 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:48.196261 19142 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.196581 19141 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:48.195211 18966 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.203178 19751 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:48.111480 20442 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.214915 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:48.181210 20538 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.181595 20583 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:48.177623 20409 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.191666 20813 consensus_queue.cc:1243] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:48.186244 20758 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:48.212499 20530 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.190390 20852 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:48.214536 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:48.209065 18966 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1), VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted, no longer has a pending config: VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1), VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2), VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 3 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.176474 20625 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:48.233408 20747 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.002s
I20260709 13:18:48.250265 18966 catalog_manager.cc:5697] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:18:48.253218 20834 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:18:48.176396 20827 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:48.227777 20583 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:48.267393 20851 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 13:18:48.157858 20744 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.243793 20530 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.281138 20843 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.281772 20843 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.284286 20843 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:48.286538 19215 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:48.247561 19212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:48.316268 19743 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:48.285621 20530 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.324944 20852 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.263252 20747 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.313170 19212 raft_consensus.cc:606] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:48.315136 20843 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.341094 20852 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:48.337033 20819 consensus_meta.cc:287] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:18:48.264557 20792 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.329793 20583 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.208056 20838 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.343683 19065 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:48.329649 20721 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.344591 19212 raft_consensus.cc:614] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:48.377063 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.053s	sys 0.159s
W20260709 13:18:48.383173 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.053s	sys 0.159s
W20260709 13:18:48.383579 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 543168us
I20260709 13:18:48.389323 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:48.323551 20758 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.397961 19067 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.386703 20792 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.402840 19212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:48.407867 19212 raft_consensus.cc:606] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:48.408288 19212 raft_consensus.cc:614] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:48.410076 20704 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.419168 19215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:48.419816 19215 raft_consensus.cc:606] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:48.377075 20721 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:48.405609 20800 consensus_meta.cc:287] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.055s	user 0.008s	sys 0.004s
I20260709 13:18:48.398953 20583 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.398617 20854 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:48.422161 20758 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.418659 20442 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.449573 19219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:37748
I20260709 13:18:48.448011 20538 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.376067 20843 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.375895 20819 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.450137 19219 raft_consensus.cc:606] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:48.451830 19065 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:48.450670 20827 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.451459 19067 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.463711 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:48.465063 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:48.465417 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:48.466238 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:48.425400 20409 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:18:48.434365 20625 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:48.476503 20790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.063s
I20260709 13:18:48.482590 19214 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:18:48.482776 20790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.007s	sys 0.063s
I20260709 13:18:48.490185 20845 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.463790 20788 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:48.475888 20814 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:48.499423 19147 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:48.480717 20799 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:48.498881 20845 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:48.500479 20747 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.536036 20838 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:48.536980 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.488493 20714 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:48.540560 20788 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.542574 20788 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.483894 20781 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:18:48.539368 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.553558 20772 consensus_meta.cc:287] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.060s	user 0.013s	sys 0.000s
I20260709 13:18:48.474908 20827 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.553977 20772 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:48.559274 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:48.555708 20827 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.561842 20721 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.562873 19748 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:48.564139 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:48.564940 19142 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:48.544134 20814 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.569280 19067 raft_consensus.cc:2410] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:48.571686 20425 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.571076 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:48.577267 19069 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:48.582360 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:48.582307 20772 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:48.586048 20814 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:48.587880 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:48.592080 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.593432 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:48.594195 19143 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.596992 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:48.598518 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:48.607626 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.618304 20717 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.980s	user 0.012s	sys 0.000s
I20260709 13:18:48.618872 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:48.651057 20852 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.651551 20721 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.650905 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:48.615896 20790 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:48.652130 20721 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.614933 20530 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:48.674727 20810 consensus_meta.cc:287] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.685s	user 0.007s	sys 0.006s
W20260709 13:18:48.685097 19749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.022s	sys 0.017s
W20260709 13:18:48.688562 19749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.022s	sys 0.017s
I20260709 13:18:48.696455 20530 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:48.703526 19068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.015s	sys 0.023s
W20260709 13:18:48.705408 19068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.015s	sys 0.023s
W20260709 13:18:48.706228 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.019s
W20260709 13:18:48.706629 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.019s
W20260709 13:18:48.706928 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 547538us
I20260709 13:18:48.708866 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:48.633349 20717 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.746923 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:48.752393 19219 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:48.759282 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:48.651595 20852 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:48.685346 20712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.009s	sys 0.021s
W20260709 13:18:48.766243 19140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.012s	sys 0.013s
W20260709 13:18:48.741003 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.684993 20680 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.699s	user 0.013s	sys 0.000s
I20260709 13:18:48.682945 20854 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.768299 19140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.014s
W20260709 13:18:48.776165 19063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.012s
W20260709 13:18:48.776794 19063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.004s	sys 0.012s
W20260709 13:18:48.754900 20454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.032s	sys 0.017s
I20260709 13:18:48.746456 20469 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.742717 20538 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.796797 19147 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:48.795241 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.767669 20712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.009s	sys 0.022s
I20260709 13:18:48.804003 20717 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.751912 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:48.761894 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:48.806932 19069 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:18:48.799409 20835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.013s
I20260709 13:18:48.812475 19067 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:18:48.811553 20835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.013s
W20260709 13:18:48.818344 19750 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.009s	sys 0.021s
W20260709 13:18:48.796749 20454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.032s	sys 0.017s
W20260709 13:18:48.815008 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.847268 19750 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.009s	sys 0.021s
I20260709 13:18:48.748862 20827 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:48.775257 20843 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:48.797597 20672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.018s
W20260709 13:18:48.812534 19071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.007s	sys 0.019s
I20260709 13:18:48.749110 20530 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:18:48.792245 20839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.009s
I20260709 13:18:48.793365 20819 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:48.792142 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:48.855050 20787 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.851853 19065 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:48.889997 19064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.010s
I20260709 13:18:48.887310 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:48.869185 20852 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:48.889611 20857 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:48.798022 20854 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.866349 20836 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:48.877009 20841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.008s	sys 0.023s
I20260709 13:18:48.869655 20469 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:18:48.858996 20672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.009s	sys 0.019s
W20260709 13:18:48.890693 19717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.015s	sys 0.016s
W20260709 13:18:48.919158 19717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.015s	sys 0.016s
W20260709 13:18:48.919492 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 741550us
W20260709 13:18:48.891027 19071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.007s	sys 0.021s
W20260709 13:18:48.891372 19144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.014s	sys 0.007s
W20260709 13:18:48.894309 20839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.005s	sys 0.009s
I20260709 13:18:48.818495 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:48.912176 19217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.013s	sys 0.049s
W20260709 13:18:48.928915 19217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.013s	sys 0.049s
I20260709 13:18:48.929181 19221 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:48.921653 19144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.015s	sys 0.007s
W20260709 13:18:48.907344 19064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.008s	sys 0.010s
W20260709 13:18:48.909240 20789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.002s	sys 0.017s
W20260709 13:18:48.914944 20841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.008s	sys 0.024s
W20260709 13:18:48.920549 20846 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.006s	sys 0.028s
W20260709 13:18:48.919986 20825 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.001s	user 0.009s	sys 0.002s
I20260709 13:18:48.905516 20787 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:48.939026 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:48.947117 19221 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
W20260709 13:18:48.920349 20718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.032s	sys 0.051s
I20260709 13:18:48.920323 20469 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.932124 20721 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:48.934018 20789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.002s	sys 0.017s
W20260709 13:18:48.979699 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.917171 20836 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:48.950822 19215 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:48.999199 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:48.942016 19139 raft_consensus.cc:2410] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:18:48.926807 20611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.007s	sys 0.018s
I20260709 13:18:48.915678 20857 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:48.962901 20718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.032s	sys 0.051s
I20260709 13:18:49.002302 19747 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:18:49.127687 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.004711 19112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.275s	user 0.013s	sys 0.030s
W20260709 13:18:49.128675 19112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.013s	sys 0.030s
W20260709 13:18:48.939932 20846 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.006s	sys 0.028s
W20260709 13:18:49.000164 20858 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:18:49.001436 19138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.016s	sys 0.013s
W20260709 13:18:49.046988 20891 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:18:49.085425 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.047369 20774 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:49.118501 19218 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.123754 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 313) took 1166 ms. Trace:
W20260709 13:18:49.124753 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.126144 20611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.008s	sys 0.019s
W20260709 13:18:49.204983 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.009562 20838 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:49.212718 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:49.215911 19748 rpcz_store.cc:276] 0709 13:18:47.958058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.963647 (+  5589us) service_pool.cc:224] Handling call
0709 13:18:47.963992 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.563484 (+599492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.047837 (+484353us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b540059f6d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:49.123603 (+ 75766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364351872}
I20260709 13:18:49.118888 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:49.119638 19717 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:49.117383 20849 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:49.209669 19138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.016s	sys 0.014s
I20260709 13:18:49.224519 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:49.127135 20695 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.126626 20744 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.219002 19069 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:49.233198 19215 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:49.234038 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:49.235677 19746 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:49.190580 20780 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:18:49.244526 19141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.012s	sys 0.029s
W20260709 13:18:49.248705 19141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.013s	sys 0.029s
I20260709 13:18:49.236778 19145 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:49.229066 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 546720us
I20260709 13:18:49.246973 19214 raft_consensus.cc:2393] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:49.260627 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1569) took 1229 ms. Trace:
I20260709 13:18:49.242763 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:49.256590 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:49.325667 19072 rpcz_store.cc:276] 0709 13:18:48.030926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.031150 (+   224us) service_pool.cc:224] Handling call
0709 13:18:48.031520 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.104344 (+ 72824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.104372 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.109727 (+  5355us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.453102 (+343375us) spinlock_profiling.cc:243] Waited 896 us on lock 0x7b180010ea00. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:18:48.705818 (+252716us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:48.705873 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.705968 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.260285 (+554317us) raft_consensus.cc:1685] finished
0709 13:18:49.260313 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.260541 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72421,"raft.queue_time_us":72757,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":25573,"spinlock_wait_cycles":2061696,"thread_start_us":252487,"threads_started":1,"wal-append.queue_time_us":695998}
W20260709 13:18:49.449716 19750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.022s	sys 0.049s
I20260709 13:18:49.213430 20810 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:49.209287 20819 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:49.464192 20819 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.466240 20819 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:49.467516 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:49.228390 20825 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:49.356531 19069 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:49.471603 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1298) took 1033 ms. Trace:
W20260709 13:18:49.261658 20868 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:18:49.471997 19069 rpcz_store.cc:276] 0709 13:18:48.437806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.252600 (+814794us) service_pool.cc:224] Handling call
0709 13:18:49.356146 (+103546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.471295 (+115149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.471538 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:49.461760 19218 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
W20260709 13:18:49.463425 19750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.023s	sys 0.050s
I20260709 13:18:49.236006 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:49.354547 19219 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:18:49.236124 20865 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:18:49.251096 20712 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.577416 19072 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:49.578251 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1299) took 1134 ms. Trace:
I20260709 13:18:49.578634 19072 rpcz_store.cc:276] 0709 13:18:48.443493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.576816 (+1133323us) service_pool.cc:224] Handling call
0709 13:18:49.577192 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.577941 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.578184 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:49.364547 20739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.026s	sys 0.037s
W20260709 13:18:49.262274 20864 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:18:49.340409 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:49.209687 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1041) took 1049 ms. Trace:
I20260709 13:18:49.259354 20855 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.570744 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.257141 20862 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.335438 20536 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.257032 20828 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:49.599435 20739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.034s	sys 0.039s
I20260709 13:18:49.251533 20838 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.353901 20845 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.618487 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1277) took 2289 ms. Trace:
I20260709 13:18:49.244704 20849 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:49.309263 20780 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:49.632278 19219 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:18:49.614768 20701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.016s	sys 0.020s
W20260709 13:18:49.605353 19036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.059s	sys 0.071s
I20260709 13:18:49.252431 20744 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.576961 20454 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:49.647069 20895 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
I20260709 13:18:49.250874 20695 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:49.473340 20810 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:49.646507 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.031s	sys 0.049s
W20260709 13:18:49.618624 20882 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:49.605115 20854 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:49.682989 19036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.060s	sys 0.071s
I20260709 13:18:49.684509 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:49.624200 20409 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.641644 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59836 (request call id 7) took 1627 ms. Trace:
I20260709 13:18:49.642729 19066 rpcz_store.cc:276] 0709 13:18:47.324621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.324793 (+   172us) service_pool.cc:224] Handling call
0709 13:18:47.325091 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.325421 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.325446 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.327839 (+  2393us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.538636 (+210797us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:47.601457 (+ 62821us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.756945 (+155488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.788892 (+ 31947us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.918543 (+129651us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b180011fec0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:18:48.872699 (+954156us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:49.614082 (+741383us) raft_consensus.cc:1685] finished
0709 13:18:49.614113 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.614277 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72232,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2481,"raft.queue_time_us":64496,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":6344,"spinlock_wait_cycles":236025856,"thread_start_us":322222,"threads_started":2,"wal-append.queue_time_us":255163}
I20260709 13:18:49.623562 20787 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:49.687533 20701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.016s	sys 0.020s
I20260709 13:18:49.686473 20739 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.651098 20792 consensus_meta.cc:287] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.245s	user 0.014s	sys 0.000s
W20260709 13:18:49.729293 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.031s	sys 0.052s
I20260709 13:18:49.615928 20862 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:49.712134 20762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.009s	sys 0.027s
W20260709 13:18:49.711941 20469 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.003s
W20260709 13:18:49.740252 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.614764 20712 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.810313 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 356) took 1840 ms. Trace:
I20260709 13:18:49.821818 20739 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:49.829383 20872 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.379s	user 0.000s	sys 0.000s
I20260709 13:18:49.602872 19139 rpcz_store.cc:276] 0709 13:18:48.154901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.176952 (+ 22051us) service_pool.cc:224] Handling call
0709 13:18:48.873530 (+696578us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:49.203977 (+330447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26030336}
I20260709 13:18:49.777499 19145 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:49.619535 20536 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.649890 20845 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.714197 20454 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:49.779754 20876 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.736s	user 0.001s	sys 0.001s
W20260709 13:18:49.781248 19744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.005s
I20260709 13:18:49.781420 19070 rpcz_store.cc:276] 0709 13:18:48.000989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.002505 (+  1516us) service_pool.cc:224] Handling call
0709 13:18:49.622402 (+1619897us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54001b9254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103590735 00007f6108550d29 00007f6101acf1d4 00007f6101acf162 00007f6101acf091 00007f6101acf00c 00007f6101ace2c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:49.627929 (+  5527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832510336}
I20260709 13:18:49.620823 20855 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.827384 19749 rpcz_store.cc:276] 0709 13:18:48.020398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.028520 (+  8122us) service_pool.cc:224] Handling call
0709 13:18:48.028806 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.035143 (+  6337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.035173 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.035597 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.692750 (+657153us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.692803 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.692898 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.733874 (+1040976us) raft_consensus.cc:1685] finished
0709 13:18:49.810083 (+ 76209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.810245 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7024,"raft.queue_time_us":12015,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":25388,"thread_start_us":656732,"threads_started":1,"wal-append.queue_time_us":895805}
I20260709 13:18:49.619798 20828 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:49.826802 20762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.011s	sys 0.030s
I20260709 13:18:49.832813 20409 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.849231 20792 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:49.853211 19142 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:49.861673 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:49.862916 19145 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
W20260709 13:18:49.866844 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.853072 19744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.011s	sys 0.005s
I20260709 13:18:49.854022 20787 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.853749 20591 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:49.860690 20857 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:49.843020 20701 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:49.910990 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:49.847427 20714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.015s	sys 0.009s
W20260709 13:18:49.912276 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.019s	sys 0.006s
I20260709 13:18:49.856748 20819 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.912119 20789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.015s	sys 0.031s
W20260709 13:18:49.930856 19715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.014s
W20260709 13:18:49.931046 19143 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.336s	user 0.013s	sys 0.000s
I20260709 13:18:49.968986 19143 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
W20260709 13:18:49.969769 19143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1037) took 1816 ms (client timeout 1840 ms). Trace:
W20260709 13:18:49.970247 19143 rpcz_store.cc:269] 0709 13:18:48.153806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.176558 (+ 22752us) service_pool.cc:224] Handling call
0709 13:18:48.593253 (+416695us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:49.969661 (+1376408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26080512}
I20260709 13:18:49.971827 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:49.912775 20810 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:49.932482 20714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.016s	sys 0.009s
W20260709 13:18:49.929137 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.019s	sys 0.006s
I20260709 13:18:49.927801 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 357) took 1856 ms. Trace:
I20260709 13:18:49.897068 20792 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:49.935585 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 96) took 1870 ms. Trace:
W20260709 13:18:49.925455 20889 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:18:49.914009 19187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.004s	sys 0.029s
W20260709 13:18:50.106822 19187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.005s	sys 0.030s
W20260709 13:18:49.939563 19717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.008s	sys 0.026s
I20260709 13:18:49.908828 20739 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:49.968603 19715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.015s	sys 0.014s
I20260709 13:18:49.930205 20857 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:49.988512 20783 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:49.994817 20799 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.998473 20536 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.000389 19751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 203) took 1321 ms. Trace:
I20260709 13:18:50.004061 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 113) took 1510 ms. Trace:
I20260709 13:18:50.011354 20704 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.021055 20442 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.022562 20717 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:50.033876 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1570) took 1995 ms. Trace:
I20260709 13:18:50.034859 20684 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:18:50.038095 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 574041us
I20260709 13:18:49.972862 19143 raft_consensus.cc:2368] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4.
W20260709 13:18:49.911947 20846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.009s	sys 0.016s
W20260709 13:18:50.041227 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.831981 20469 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:49.934513 20789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.015s	sys 0.031s
I20260709 13:18:49.927147 20870 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:49.975118 19113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.018s	sys 0.083s
W20260709 13:18:50.135673 19113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.018s	sys 0.083s
W20260709 13:18:50.136286 19072 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.027s	sys 0.030s
W20260709 13:18:50.108428 19717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.009s	sys 0.026s
I20260709 13:18:50.108366 20838 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.062255 19750 rpcz_store.cc:276] 0709 13:18:48.072020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.072249 (+   229us) service_pool.cc:224] Handling call
0709 13:18:48.095537 (+ 23288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.095718 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:48.855539 (+759821us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.927350 (+1071811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.927426 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.927484 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.927585 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.927731 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":936485,"prepare.run_cpu_time_us":5851,"prepare.run_wall_time_us":34195,"raft.queue_time_us":290515,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"thread_start_us":1830576,"threads_started":3,"wal-append.queue_time_us":924345}
I20260709 13:18:50.111377 19220 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:49.934924 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.022603 20850 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:50.038573 20854 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
W20260709 13:18:50.136025 20884 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.339s	user 0.000s	sys 0.000s
I20260709 13:18:49.925359 20787 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:49.924899 20591 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.156123 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:50.142812 20878 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.615s	user 0.001s	sys 0.000s
I20260709 13:18:50.121909 19071 rpcz_store.cc:276] 0709 13:18:48.038802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.039876 (+  1074us) service_pool.cc:224] Handling call
0709 13:18:48.040206 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.040433 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:48.087119 (+ 46686us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.033465 (+1946346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.033536 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:50.033592 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.033677 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.033806 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1111914,"prepare.queue_time_us":46968,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1113018,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":834024,"threads_started":1,"wal-append.queue_time_us":855534}
W20260709 13:18:50.114882 20875 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.326s	user 0.000s	sys 0.000s
I20260709 13:18:49.932686 20701 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:50.136593 19072 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.027s	sys 0.030s
I20260709 13:18:49.945158 20819 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:50.137158 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 1.09737e+06us
I20260709 13:18:50.106333 20845 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.109148 19063 rpcz_store.cc:276] 0709 13:18:48.064955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.066364 (+  1409us) service_pool.cc:224] Handling call
0709 13:18:48.066662 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.229434 (+162772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.229476 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.234305 (+  4829us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.777210 (+542905us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.777264 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.253332 (+476068us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540024b654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:49.253383 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.929120 (+675737us) raft_consensus.cc:1685] finished
0709 13:18:49.929148 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.935501 (+  6353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":908,"raft.queue_time_us":184811,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":371397504,"thread_start_us":531646,"threads_started":1,"wal-append.queue_time_us":694909}
W20260709 13:18:50.116525 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.113097 20810 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:50.114753 20843 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.118268 20857 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.125555 20799 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.117388 20898 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.129853 20887 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:18:50.202432 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:50.203545 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:50.146540 19112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.059s	sys 0.061s
W20260709 13:18:50.146764 19146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.017s	sys 0.042s
W20260709 13:18:50.204890 19146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.017s	sys 0.042s
I20260709 13:18:50.120442 20780 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:50.134891 20846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.010s	sys 0.016s
I20260709 13:18:50.124903 20744 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.117627 19147 rpcz_store.cc:276] 0709 13:18:48.493262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.503494 (+ 10232us) service_pool.cc:224] Handling call
0709 13:18:48.503856 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.802244 (+298388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.003762 (+1201518us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002b7ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:50.003989 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663777024}
I20260709 13:18:50.133663 20684 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.158571 20862 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.159893 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1060) took 1997 ms. Trace:
I20260709 13:18:50.161069 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:50.206845 19147 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:50.206305 19217 rpcz_store.cc:276] 0709 13:18:48.162030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.285921 (+123891us) service_pool.cc:224] Handling call
0709 13:18:48.312391 (+ 26470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.320516 (+  8125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.320559 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.326438 (+  5879us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.929330 (+602892us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:48.929368 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.929427 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.159587 (+1230160us) raft_consensus.cc:1685] finished
0709 13:18:50.159618 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.159799 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7685,"raft.queue_time_us":8265,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13678,"thread_start_us":576090,"threads_started":1,"wal-append.queue_time_us":1564466}
I20260709 13:18:50.208527 19147 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.121734 20783 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.168212 20611 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:50.170866 20913 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:50.171160 20677 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.149914 19143 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:50.177428 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1046) took 2021 ms. Trace:
I20260709 13:18:50.141296 19220 pending_rounds.cc:85] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:18:50.132166 20442 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:50.197835 20890 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 13:18:50.198020 20871 consensus_queue.cc:1059] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:18:50.198935 20883 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
W20260709 13:18:50.197870 20899 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 13:18:50.204707 19113 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:50.117225 19751 rpcz_store.cc:276] 0709 13:18:48.678964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.679139 (+   175us) service_pool.cc:224] Handling call
0709 13:18:49.619506 (+940367us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:49.619692 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.713561 (+ 93869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.713604 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.713658 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.713711 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.000089 (+286378us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b540039b2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:50.000149 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.000318 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243658368}
W20260709 13:18:50.204705 19112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.059s	sys 0.061s
I20260709 13:18:50.211531 20454 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:50.211783 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 50763.2us
I20260709 13:18:50.161301 20409 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.155460 20850 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:50.211244 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 1e32daa1d5e3443eaaf7b1e03100b270: Illegal state: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:50.214742 20897 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.215199 19717 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:50.287303 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:50.287804 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 72699.2us
W20260709 13:18:50.217083 20886 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 13:18:50.152251 19139 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:50.221643 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1048) took 1004 ms. Trace:
I20260709 13:18:50.246465 20855 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.235659 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.245359 20780 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:50.239771 20873 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.194133 20718 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.210110 19147 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.224416 19144 rpcz_store.cc:276] 0709 13:18:48.156265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.165582 (+  9317us) service_pool.cc:224] Handling call
0709 13:18:48.165877 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.166194 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.166223 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.166614 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.930875 (+764261us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:48.944445 (+ 13570us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.944760 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.944850 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.012734 (+1067884us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b1800343900. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d522 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:18:50.177104 (+164370us) raft_consensus.cc:1685] finished
0709 13:18:50.177217 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.177360 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8784,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":1264,"raft.run_cpu_time_us":5107,"raft.run_wall_time_us":66798,"spinlock_wait_cycles":11250048,"thread_start_us":760233,"threads_started":1,"wal-append.queue_time_us":1038701}
I20260709 13:18:50.266724 20828 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.221542 20538 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:50.219347 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1058) took 2051 ms. Trace:
I20260709 13:18:50.175895 20810 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.281502 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.223943 20846 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.290436 20591 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.224519 19220 pending_rounds.cc:107] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:50.298842 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1044) took 2131 ms. Trace:
I20260709 13:18:50.239161 20908 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.291146 19146 rpcz_store.cc:276] 0709 13:18:49.217639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.218474 (+   835us) service_pool.cc:224] Handling call
0709 13:18:49.245832 (+ 27358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.246065 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:49.310752 (+ 64687us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.221211 (+910459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.221281 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:50.221337 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.221438 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.221578 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46018,"prepare.queue_time_us":245032,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":31008,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3964,"thread_start_us":851345,"threads_started":1}
I20260709 13:18:50.305150 20912 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:50.315153 20897 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.329232 20912 raft_consensus.cc:697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:50.327956 19140 rpcz_store.cc:276] 0709 13:18:48.155747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.156733 (+   986us) service_pool.cc:224] Handling call
0709 13:18:48.157045 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.157249 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.157282 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.171142 (+ 13860us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.770977 (+599835us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:48.807851 (+ 36874us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.808181 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.808277 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.465131 (+656854us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b180022ae60. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1
0709 13:18:49.466502 (+  1371us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b180022ae60. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:18:50.286661 (+820159us) raft_consensus.cc:1685] finished
0709 13:18:50.286682 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.286820 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24557,"prepare.queue_time_us":47325,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":95,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":36095,"spinlock_wait_cycles":88305280,"thread_start_us":543727,"threads_started":1,"wal-append.queue_time_us":794938}
I20260709 13:18:50.330358 20912 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.331147 19140 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:50.331538 19140 pending_rounds.cc:85] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 2
I20260709 13:18:50.331349 20897 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.331892 19140 pending_rounds.cc:107] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:18:50.305766 20901 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:18:50.332227 19140 raft_consensus.cc:2889] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.306226 20905 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.333233 19220 raft_consensus.cc:2889] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.333015 20905 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.335752 20905 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.336450 20905 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.309187 20921 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.286831 20739 raft_consensus.cc:993] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:50.312932 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.220533 20800 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:50.313041 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:50.325649 19065 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.417s	user 0.009s	sys 0.004s
I20260709 13:18:50.262367 20838 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:50.213292 20898 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.278153 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1558) took 1028 ms. Trace:
I20260709 13:18:50.318184 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 93) took 2459 ms. Trace:
I20260709 13:18:50.293470 20871 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.320539 20896 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 13:18:50.326056 20909 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.196036 20843 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.307802 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1043) took 2152 ms. Trace:
I20260709 13:18:50.327999 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.321796 20611 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.311353 20583 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.352171 19071 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:50.353372 19146 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:50.337244 20900 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:18:50.314138 20536 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:50.386597 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1301) took 1942 ms. Trace:
I20260709 13:18:50.384670 19144 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:50.350212 20591 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.389003 19065 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:50.393931 20880 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.338433 20781 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.352888 20852 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.391326 20905 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.350960 20701 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:50.401484 20902 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
W20260709 13:18:50.401824 20892 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 13:18:50.404122 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1294) took 1971 ms. Trace:
W20260709 13:18:50.423223 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.433247 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 144) took 2398 ms. Trace:
I20260709 13:18:50.389048 19143 rpcz_store.cc:276] 0709 13:18:49.249423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.128603 (+879180us) service_pool.cc:224] Handling call
0709 13:18:50.134665 (+  6062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.240866 (+106201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.265400 (+ 24534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:50.389288 19068 rpcz_store.cc:276] 0709 13:18:47.858534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.858766 (+   232us) service_pool.cc:224] Handling call
0709 13:18:47.862229 (+  3463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.877520 (+ 15291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.877562 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.878041 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.705833 (+827792us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.769099 (+ 63266us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.018232 (+1249133us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b1800248da0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287 00007f61035a5208
0709 13:18:50.303705 (+285473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.303976 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.304115 (+   139us) raft_consensus.cc:1685] finished
0709 13:18:50.317922 (+ 13807us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.318110 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20164,"prepare.queue_time_us":67395,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1431873,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":217,"spinlock_wait_cycles":40939392,"thread_start_us":923063,"threads_started":2,"wal-append.queue_time_us":772172,"wal-append.run_cpu_time_us":2068,"wal-append.run_wall_time_us":1065737}
W20260709 13:18:50.535311 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.337486 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 99) took 2259 ms. Trace:
I20260709 13:18:50.440081 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:50.444996 20910 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:18:50.362813 20409 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.449728 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:50.451362 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.553375 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 117) took 1947 ms. Trace:
I20260709 13:18:50.316766 20780 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.327864 20873 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.389864 20800 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.382387 20792 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.325124 20538 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.383131 20799 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.322132 19216 rpcz_store.cc:276] 0709 13:18:48.161470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.238405 (+ 76935us) service_pool.cc:224] Handling call
0709 13:18:48.293247 (+ 54842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.337428 (+ 44181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.343004 (+  5576us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.394599 (+ 51595us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.921244 (+526645us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:48.928632 (+  7388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.933750 (+  5118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.172036 (+1238286us) raft_consensus.cc:1685] finished
0709 13:18:50.176225 (+  4189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.212997 (+ 36772us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7227,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4695,"thread_start_us":477258,"threads_started":1,"wal-append.queue_time_us":1281845}
W20260709 13:18:50.466879 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.514046 20921 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:50.552963 20904 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:18:50.467741 20854 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.469959 20843 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:50.470355 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.470993 20918 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.471580 20828 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.469992 20897 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.387882 20835 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.460058 20914 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:50.321122 20718 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.499125 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1566) took 1032 ms. Trace:
I20260709 13:18:50.383335 20874 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.509181 19072 rpcz_store.cc:276] 0709 13:18:48.444041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.601331 (+1157290us) service_pool.cc:224] Handling call
0709 13:18:49.601693 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.601938 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:50.163429 (+561491us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.386267 (+222838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.386317 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:50.386360 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.386430 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.386541 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63620,"prepare.queue_time_us":663835,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":36871,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":15828,"thread_start_us":746758,"threads_started":2}
I20260709 13:18:50.510484 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.445583 20744 raft_consensus.cc:1081] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Signalling peer 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:18:50.436935 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.512642 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.436209 20846 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.447391 20787 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.466895 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 359) took 1529 ms. Trace:
I20260709 13:18:50.577207 20933 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.589052 20918 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.524235 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.511838 20672 raft_consensus.cc:3055] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:50.405187 20838 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.534261 19067 rpcz_store.cc:276] 0709 13:18:48.432667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.914224 (+481557us) service_pool.cc:224] Handling call
0709 13:18:48.928098 (+ 13874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.035774 (+1107676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.035816 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.036332 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.283846 (+247514us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:50.283900 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.283991 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.403842 (+119851us) raft_consensus.cc:1685] finished
0709 13:18:50.403867 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.404043 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1107097,"raft.queue_time_us":1108370,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":247074,"threads_started":1,"wal-append.queue_time_us":314093}
I20260709 13:18:50.519225 20469 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.540421 19147 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:50.534413 19220 rpcz_store.cc:276] 0709 13:18:48.035170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.036666 (+  1496us) service_pool.cc:224] Handling call
0709 13:18:48.036943 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.064227 (+2027284us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b540037ba20. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103501dc0 00007f610358cd87 00007f610358d470 00007f6103589d8f 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c
0709 13:18:50.334095 (+269868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.433034 (+ 98939us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b540035c5d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:50.433193 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635714688}
I20260709 13:18:50.584364 20843 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:50.515524 20536 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.528944 20852 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.509562 20611 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.535171 20880 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.325390 20850 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.540933 20701 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.542198 20932 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.550478 20810 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.542685 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.555756 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:50.530007 20783 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.450649 19138 rpcz_store.cc:276] 0709 13:18:48.155459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.170943 (+ 15484us) service_pool.cc:224] Handling call
0709 13:18:48.238007 (+ 67064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.313561 (+ 75554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.318836 (+  5275us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.341853 (+ 23017us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.329291 (+987438us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:49.642336 (+313045us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.702043 (+ 59707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.726656 (+ 24613us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.307544 (+580888us) raft_consensus.cc:1685] finished
0709 13:18:50.307569 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.307735 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122682,"prepare.queue_time_us":179810,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3881,"raft.queue_time_us":390713,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":253,"thread_start_us":904345,"threads_started":1,"wal-append.queue_time_us":1304465}
W20260709 13:18:50.531407 19065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1304) took 1882 ms (client timeout 1914 ms). Trace:
I20260709 13:18:50.525909 20781 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.540171 19064 rpcz_store.cc:276] 0709 13:18:48.067813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.234283 (+166470us) service_pool.cc:224] Handling call
0709 13:18:48.268309 (+ 34026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.320162 (+ 51853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.324547 (+  4385us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.351799 (+ 27252us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.939686 (+587887us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.989455 (+ 49769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.999051 (+  9596us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.315016 (+1315965us) raft_consensus.cc:1685] finished
0709 13:18:50.315043 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.326928 (+ 11885us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102171,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":581194,"threads_started":1,"wal-append.queue_time_us":1252814}
I20260709 13:18:50.659826 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.562050 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1574) took 2003 ms. Trace:
I20260709 13:18:50.563797 20905 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.566089 19141 rpcz_store.cc:276] 0709 13:18:48.606445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.606564 (+   119us) service_pool.cc:224] Handling call
0709 13:18:48.610044 (+  3480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.611445 (+  1401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.611473 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.611837 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.249108 (+637271us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.468238 (+219130us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.861809 (+393571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.861910 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.553182 (+691272us) raft_consensus.cc:1685] finished
0709 13:18:50.553200 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.553322 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109393,"prepare.queue_time_us":327050,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":7809,"raft.queue_time_us":360243,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":13891,"spinlock_wait_cycles":33920,"thread_start_us":1024402,"threads_started":2,"wal-append.queue_time_us":1224922}
I20260709 13:18:50.661207 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.661940 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.662294 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:50.663316 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.663484 19141 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.437346 20871 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.664973 20442 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.666617 20871 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.667318 20780 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.667788 20684 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.668828 20611 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.465936 20845 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:50.586896 20897 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.577946 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1300) took 2134 ms. Trace:
I20260709 13:18:50.661020 19066 rpcz_store.cc:276] 0709 13:18:48.558560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.782913 (+1224353us) service_pool.cc:224] Handling call
0709 13:18:49.810422 (+ 27509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.041720 (+231298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.041763 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.116139 (+ 74376us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.340052 (+223913us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:50.340108 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.340216 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.561858 (+221642us) raft_consensus.cc:1685] finished
0709 13:18:50.561881 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.561997 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255165,"raft.queue_time_us":319447,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12748,"thread_start_us":183967,"threads_started":1,"wal-append.queue_time_us":381925}
I20260709 13:18:50.467375 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:50.517390 20591 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:50.565181 20836 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.583374 19146 rpcz_store.cc:276] 0709 13:18:49.466303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.328583 (+862280us) service_pool.cc:224] Handling call
0709 13:18:50.341568 (+ 12985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.498846 (+157278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.499068 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:50.580044 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.572017 20800 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.669611 19143 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:50.586431 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.687608 19072 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:50.586783 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:50.572690 20466 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:50.595829 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.698855 19144 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:50.632977 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 95267.7us
I20260709 13:18:50.655246 20898 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:50.523906 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 319250us
I20260709 13:18:50.636641 19747 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:50.570391 20409 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.585557 20828 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.585860 20792 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.521808 20819 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.630607 20787 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:50.597415 19139 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:50.582439 20854 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.645958 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.700188 20611 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.634604 20933 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.638713 20672 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:50.597239 20846 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.593335 20914 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:50.657521 19065 rpcz_store.cc:269] 0709 13:18:48.639454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.671868 (+ 32414us) service_pool.cc:224] Handling call
0709 13:18:50.521304 (+1849436us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:50.569012 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 129635us
I20260709 13:18:50.669611 20845 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.587690 20835 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.671247 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:50.553953 20919 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:18:50.763458 19066 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:50.664793 19141 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:50.671890 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.765866 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.707508 20931 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:50.654567 20810 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.665745 19064 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:50.596912 19745 rpcz_store.cc:276] 0709 13:18:48.937292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.938256 (+   964us) service_pool.cc:224] Handling call
0709 13:18:49.981576 (+1043320us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465eee 0000000000375939 00007f61084d91e0 00007f61085a20c4 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:49.981798 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.982331 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.982374 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.983043 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.304642 (+321599us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:50.310380 (+  5738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.317496 (+  7116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.466584 (+149088us) raft_consensus.cc:1685] finished
0709 13:18:50.466616 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.466836 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3728,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"spinlock_wait_cycles":13478656,"thread_start_us":300746,"threads_started":1,"wal-append.queue_time_us":481746}
I20260709 13:18:50.586122 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:50.714681 20739 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 13:18:50.688728 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 101998us
I20260709 13:18:50.727195 20819 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.695391 20591 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.677305 20783 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:50.577441 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 358) took 1647 ms. Trace:
I20260709 13:18:50.702950 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.644860 20843 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.652627 20932 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.683221 20918 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.706959 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:50.713171 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.655434 20701 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.649773 20852 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.717908 19067 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
W20260709 13:18:50.706617 20704 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.002s
I20260709 13:18:50.678278 20938 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.650938 19147 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:18:50.808965 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.768096 20718 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.725795 20873 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.754004 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:50.766337 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.670624 19069 rpcz_store.cc:276] 0709 13:18:48.443781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.579663 (+1135882us) service_pool.cc:224] Handling call
0709 13:18:49.612309 (+ 32646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.612503 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:50.130992 (+518489us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.399419 (+268427us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b180033dde0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:18:50.577595 (+178176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.577643 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:50.577681 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.577756 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.577883 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68774,"prepare.queue_time_us":686292,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":71076,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":2295552,"thread_start_us":769185,"threads_started":3,"wal-append.queue_time_us":245515}
W20260709 13:18:50.813683 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 59795.6us
I20260709 13:18:50.814491 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:50.815521 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:50.811570 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.684540 20536 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.645577 20937 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:50.772285 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 186216us
I20260709 13:18:50.822997 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:50.715366 20792 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.780038 19070 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.797130 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.778730 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:50.774662 20917 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.220s	user 0.003s	sys 0.001s
I20260709 13:18:50.803663 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:50.806335 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 99458.8us
I20260709 13:18:50.722766 20787 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.809747 19747 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:50.724090 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1049) took 1506 ms. Trace:
I20260709 13:18:50.809993 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.829859 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:50.810657 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.830683 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.811465 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.831485 19147 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:50.831791 19141 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:50.767221 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:50.817464 19184 leader_election.cc:400] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4.
I20260709 13:18:50.778458 20680 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:50.832249 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.832271 19184 leader_election.cc:403] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:50.832544 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65377.2us
I20260709 13:18:50.833309 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:50.803453 20799 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:50.834421 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.834580 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:50.837152 20933 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.839133 20932 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.796650 20944 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:50.825490 20943 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:50.840159 20939 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:50.840586 20680 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:50.840901 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:50.841605 20845 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.842396 20897 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.842573 20787 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.842763 20704 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.829901 19142 rpcz_store.cc:276] 0709 13:18:49.217928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.991061 (+773133us) service_pool.cc:224] Handling call
0709 13:18:49.991482 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.124021 (+132539us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:50.140124 (+ 16103us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.447452 (+307328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.447505 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:50.447544 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.723948 (+276404us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400221854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:50.723977 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.724053 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58741,"prepare.queue_time_us":18117,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":73230,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":304216448,"thread_start_us":248162,"threads_started":1,"wal-append.queue_time_us":404036}
I20260709 13:18:50.842526 20905 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4.
W20260709 13:18:50.828824 19110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.914s (SENT) [suppressed 13 similar messages]
I20260709 13:18:50.867350 20873 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:50.804286 20783 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.859577 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.810344 20790 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.809208 20945 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.812258 20744 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.775961 20810 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.796808 20819 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.802748 20871 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:18:50.826942 20780 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:50.821657 20591 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:50.875259 19070 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:50.878015 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:50.878800 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:18:50.879590 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 68755.6us
W20260709 13:18:50.880048 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 118531us
I20260709 13:18:50.763105 20935 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:18:50.884379 20898 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:50.845520 20799 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:50.849610 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:50.861917 20739 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:50.879904 20536 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.865391 20442 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:50.892429 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.875092 20718 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.852432 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:50.873522 20680 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.777966 19744 rpcz_store.cc:276] 0709 13:18:48.930354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.932889 (+  2535us) service_pool.cc:224] Handling call
0709 13:18:48.970047 (+ 37158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.202898 (+232851us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:49.209286 (+  6388us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.261099 (+ 51813us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.908803 (+647704us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.910408 (+  1605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.926890 (+ 16482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.565032 (+638142us) raft_consensus.cc:1685] finished
0709 13:18:50.566986 (+  1954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.571862 (+  4876us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":370036,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":127025,"thread_start_us":609469,"threads_started":1,"wal-append.queue_time_us":706617}
I20260709 13:18:50.899199 20948 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:50.806418 20672 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:50.900908 19072 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:50.885437 20908 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.880084 20936 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.887049 20611 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:50.902567 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 60459.5us
I20260709 13:18:50.914616 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:50.865111 20852 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:50.916810 20914 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.891335 20921 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.868050 20933 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:50.895049 20846 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:50.825541 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.022532 20701 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:50.896317 20870 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:18:50.933924 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 55993.9us
I20260709 13:18:50.915417 20873 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:50.959307 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:50.923439 20897 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:18:50.966522 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 137758us
I20260709 13:18:50.966220 19141 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
W20260709 13:18:50.968559 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 116229us
I20260709 13:18:50.925308 20780 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:50.927111 20591 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.923904 20880 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:50.930653 20874 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:50.924177 20839 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:50.935467 20739 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:51.028290 20942 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:18:50.848803 20937 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.009955 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.047544 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:50.816718 20938 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:50.936292 20442 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:50.960036 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 198) took 2767 ms. Trace:
I20260709 13:18:50.968268 20909 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:51.016052 19072 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:50.919503 20945 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.017045 19142 raft_consensus.cc:2410] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:51.017828 20843 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:50.927452 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 48771.9us
I20260709 13:18:50.976064 20717 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:51.028646 20799 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.024555 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:51.027850 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 101398us
I20260709 13:18:51.028736 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.009464 20611 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.023895 19745 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:50.919342 20790 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.041527 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:51.042840 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.026425 20870 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.031004 20780 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:51.010569 20684 consensus_queue.cc:1175] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "508ee2e0531b43d7a1c05f950644ae66" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:18:51.013020 20948 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:51.114631 20955 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:18:51.102918 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.008595 20836 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:51.036253 20874 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:51.031872 20897 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:51.170233 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 142485us
I20260709 13:18:51.271521 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.339335 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.352823 19072 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:51.270768 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.029860 20591 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.116617 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:51.350181 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 321446us
I20260709 13:18:51.045173 20739 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.377851 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.375411 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 106) took 1011 ms. Trace:
W20260709 13:18:51.118374 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 93894.2us
W20260709 13:18:51.148952 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.393630 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:51.394348 19072 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:51.406848 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.395960 19068 rpcz_store.cc:276] 0709 13:18:50.363919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.535395 (+171476us) service_pool.cc:224] Handling call
0709 13:18:50.535697 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:50.536034 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.536061 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:50.544567 (+  8506us) log.cc:844] Serialized 52 byte log entry
0709 13:18:50.634335 (+ 89768us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:50.634377 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.634450 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.330972 (+696522us) raft_consensus.cc:1685] finished
0709 13:18:51.375138 (+ 44166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.375342 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":78997,"threads_started":1,"wal-append.queue_time_us":162436}
I20260709 13:18:51.407795 19141 raft_consensus.cc:2410] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:51.408610 19219 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:51.408689 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.409792 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.077346 19065 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:51.413435 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.415375 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.167052 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.172091 20712 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.414337 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.414119 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:51.077361 20909 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:51.061067 20935 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:51.406337 20800 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.002s
I20260709 13:18:51.417814 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.117719 20828 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.418459 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:51.412961 19714 connection.cc:256] RPC call timeout handler was delayed by -1.2014543930001764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
I20260709 13:18:51.413884 19213 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:51.430503 19213 pending_rounds.cc:85] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:18:51.076642 20442 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.420600 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.421250 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:51.421970 20929 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.872s	user 0.000s	sys 0.011s
I20260709 13:18:51.422343 20862 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.423192 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:51.416549 20952 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.155s	user 0.000s	sys 0.006s
I20260709 13:18:51.393293 20799 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.161803 20846 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:51.391963 20454 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:51.367549 20611 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.294109 20961 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.418653 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.417529 19220 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:51.439793 20843 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:51.274943 20873 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.061216 20921 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:51.363407 20819 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.293511 20717 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:51.395696 20836 consensus_queue.cc:1243] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:51.117849 20938 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.120846 20792 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:51.419387 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.430953 19213 pending_rounds.cc:107] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:51.477804 19213 raft_consensus.cc:2889] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.429373 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.391646 20874 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.477025 19072 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:51.105784 20704 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.347s
I20260709 13:18:51.406824 20880 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:51.060647 20933 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.367s
I20260709 13:18:51.063141 20701 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.364s
I20260709 13:18:51.441195 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.444332 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 107) took 1005 ms. Trace:
I20260709 13:18:51.445169 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.446617 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:51.431962 20958 log.cc:927] Time spent T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.312s	user 0.006s	sys 0.000s
I20260709 13:18:51.447520 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.425150 20695 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.429870 20914 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.427364 20935 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:51.064399 20839 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.453269 20712 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:18:51.464557 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 46048.3us
I20260709 13:18:51.481724 20962 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.465292 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.306784 20838 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.455312 20454 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.489179 20789 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:51.429906 20800 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:51.454716 20956 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:18:51.469489 19214 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:51.446480 19212 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:51.433394 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:51.479460 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.455433 20783 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.493040 19217 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:51.504833 20935 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.507872 20772 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.494511 19219 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:51.471428 20908 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:51.540220 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.541972 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.496786 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.498000 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.544198 19068 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:51.505620 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.543007 19219 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:51.545532 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.545746 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.546175 19219 raft_consensus.cc:2393] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:51.464864 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:51.505683 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 97216us
I20260709 13:18:51.546671 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.509852 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.547801 19220 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:51.548187 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.548676 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.549526 19220 raft_consensus.cc:2410] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:51.076867 19742 rpcz_store.cc:276] 0709 13:18:48.163014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.171224 (+  8210us) service_pool.cc:224] Handling call
0709 13:18:49.047014 (+875790us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465eee 0000000000375939 00007f61084d91e0 00007f61085a20c4 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:49.203004 (+155990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.246564 (+ 43560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.250780 (+  4216us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.614453 (+363673us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.264282 (+649829us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:50.280571 (+ 16289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.280734 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.660800 (+380066us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:50.923614 (+262814us) raft_consensus.cc:1685] finished
0709 13:18:50.923634 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.930835 (+  7201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":368979,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":11262,"spinlock_wait_cycles":32164992,"thread_start_us":440863,"threads_started":1,"wal-append.queue_time_us":830366}
W20260709 13:18:51.550504 20941 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.743s	user 0.006s	sys 0.000s
I20260709 13:18:51.551746 20783 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:51.554137 20905 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:51.554510 20905 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:51.557566 20905 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.558588 20905 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.560415 20828 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:51.560842 20828 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.561203 20828 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.539482 20945 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.563410 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 102) took 1238 ms. Trace:
I20260709 13:18:51.564471 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 142) took 3545 ms. Trace:
I20260709 13:18:51.492848 19069 rpcz_store.cc:276] 0709 13:18:50.439079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.813824 (+374745us) service_pool.cc:224] Handling call
0709 13:18:50.814206 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.814565 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.814602 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.825741 (+ 11139us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.916249 (+ 90508us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:50.916289 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.916351 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.444055 (+527704us) raft_consensus.cc:1685] finished
0709 13:18:51.444085 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.444257 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6275,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":23167,"thread_start_us":32186,"threads_started":1,"wal-append.queue_time_us":73946}
I20260709 13:18:51.491153 20843 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.496021 20880 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:51.500569 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 53151.7us
I20260709 13:18:51.548801 19217 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:51.565254 20792 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.480950 20717 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:51.565744 20684 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.565894 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.539661 20948 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.543005 20921 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.471300 20961 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.541460 20908 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.567523 20800 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.489087 20909 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.497052 20937 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.569921 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.602667 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.602919 19221 raft_consensus.cc:2410] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:51.543772 19072 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:51.571177 19067 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:51.572366 19213 rpcz_store.cc:276] 0709 13:18:48.018544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.018659 (+   115us) service_pool.cc:224] Handling call
0709 13:18:48.018955 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.478374 (+3459419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.564202 (+ 85828us) spinlock_profiling.cc:243] Waited 3.39 s on lock 0x7b54001d5954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:51.564403 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7801247488}
I20260709 13:18:51.603259 19751 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:51.454093 20810 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.510517 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.577232 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.578812 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.580005 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.514637 20454 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.563807 19063 rpcz_store.cc:276] 0709 13:18:50.325310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.326888 (+  1578us) service_pool.cc:224] Handling call
0709 13:18:50.327352 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:50.363320 (+ 35968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.363353 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:50.403962 (+ 40609us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b180035cc20. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:18:50.723274 (+319312us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b2c00028df8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:18:50.763816 (+ 40542us) log.cc:844] Serialized 52 byte log entry
0709 13:18:50.923153 (+159337us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:50.924073 (+   920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.924265 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.563193 (+638928us) raft_consensus.cc:1685] finished
0709 13:18:51.563215 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.563353 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93158,"raft.queue_time_us":35886,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":170,"spinlock_wait_cycles":53433088,"thread_start_us":119498,"threads_started":1,"wal-append.queue_time_us":195266}
I20260709 13:18:51.595901 20921 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.587764 19215 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
W20260709 13:18:51.664389 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 87240.1us
I20260709 13:18:51.514006 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.508643 20914 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.669569 20849 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.670728 20781 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:51.671526 19213 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:51.672076 20949 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.681s	user 0.000s	sys 0.001s
W20260709 13:18:51.673658 20680 consensus_meta.cc:287] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.681s	user 0.005s	sys 0.004s
I20260709 13:18:51.674062 20680 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.674180 20611 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.675019 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1063) took 1202 ms. Trace:
I20260709 13:18:51.675379 19140 rpcz_store.cc:276] 0709 13:18:50.472620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.715217 (+242597us) service_pool.cc:224] Handling call
0709 13:18:50.715515 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.718598 (+  3083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.718624 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.718931 (+   307us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.811391 (+ 92460us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:50.811438 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.811502 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.671553 (+860051us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:51.674755 (+  3202us) raft_consensus.cc:1685] finished
0709 13:18:51.674775 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.674966 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5376,"raft.queue_time_us":2825,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3586,"spinlock_wait_cycles":6909568,"thread_start_us":46297,"threads_started":1,"wal-append.queue_time_us":158299}
I20260709 13:18:51.677225 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:51.677616 20781 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:18:51.679224 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1059) took 1207 ms. Trace:
I20260709 13:18:51.680349 19146 rpcz_store.cc:276] 0709 13:18:50.471399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.684616 (+213217us) service_pool.cc:224] Handling call
0709 13:18:50.717497 (+ 32881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.717684 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.717720 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.717761 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:50.717794 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.717847 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.679062 (+961215us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b54000febd0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:51.679167 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74786176}
I20260709 13:18:51.681555 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:51.592617 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.682758 19069 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:18:51.568241 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1061) took 1096 ms. Trace:
W20260709 13:18:51.677659 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 43550.4us
I20260709 13:18:51.576722 20846 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:51.603807 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.513458 20962 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.594762 20591 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.611572 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.518388 20789 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.612043 20897 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.582541 20933 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:18:51.588089 20836 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:51.598289 20965 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.597214 20908 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.663458 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.725549 19063 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:51.588994 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.726032 19218 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:51.674436 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 105) took 1348 ms. Trace:
I20260709 13:18:51.683584 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.688787 19068 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:51.726917 19070 rpcz_store.cc:276] 0709 13:18:50.326453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.467129 (+140676us) service_pool.cc:224] Handling call
0709 13:18:51.674291 (+1207162us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540020a654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:51.674385 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249548160}
W20260709 13:18:51.727468 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.678380 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:51.600414 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.691712 20466 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.701906 19220 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:51.682687 20937 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:51.678576 20538 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.702653 20772 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.678117 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1064) took 1205 ms. Trace:
I20260709 13:18:51.677251 20857 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:51.733155 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.743806 19069 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
W20260709 13:18:51.730321 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 46839.6us
I20260709 13:18:51.596503 20684 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.745138 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.747328 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.748469 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.700017 20780 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:51.752903 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 145274us
I20260709 13:18:51.677947 20951 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:51.753765 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.758383 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:51.701174 20442 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.759788 19071 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:51.763019 20909 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.764108 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:51.764775 19069 raft_consensus.cc:2376] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4. Re-sending same reply.
I20260709 13:18:51.734275 20838 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:51.732445 20680 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:51.775315 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.777906 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:51.779182 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:51.781975 20873 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.782625 20873 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.734359 20466 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.751132 20962 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.786684 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.754172 20937 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:51.787985 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.757954 20701 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:51.763762 20857 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.768007 20838 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.798000 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.772994 20933 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.785573 20873 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.732573 20965 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.789435 20819 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.763623 20909 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.819909 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.825137 19069 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:51.792322 20701 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:51.791888 20937 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:51.835049 20466 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.835914 20717 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.836655 20937 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.797192 20857 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:51.800395 20838 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:51.846966 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 71766.6us
I20260709 13:18:51.854954 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:51.870008 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.870860 19069 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:51.799782 20933 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:51.805630 20819 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:51.843137 20701 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.827310 20810 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.881161 19213 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:51.846063 20857 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.883984 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:51.885243 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:51.886421 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 60734.9us
I20260709 13:18:51.888603 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:51.879597 20933 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:51.904353 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.872202 19065 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:51.890120 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.916244 19213 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:51.847275 20739 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.883296 20819 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:51.918365 20959 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.008s	sys 0.021s
I20260709 13:18:51.929059 20442 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.885778 20810 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:51.684352 19143 rpcz_store.cc:276] 0709 13:18:50.472012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.696438 (+224426us) service_pool.cc:224] Handling call
0709 13:18:50.696772 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:50.697166 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.697203 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:50.697776 (+   573us) log.cc:844] Serialized 52 byte log entry
0709 13:18:50.915915 (+218139us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:50.915980 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.916093 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.567974 (+651881us) raft_consensus.cc:1685] finished
0709 13:18:51.568002 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.568178 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4457,"spinlock_wait_cycles":10289024,"thread_start_us":217717,"threads_started":1,"wal-append.queue_time_us":362872}
I20260709 13:18:51.933661 20909 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.933722 20780 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:51.934490 20739 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:51.913384 20981 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.883141 20591 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.873283 20935 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.941720 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.922526 20680 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:51.944636 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:51.952776 19213 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:51.953716 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:51.921546 20961 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:51.938786 20959 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.009s	sys 0.021s
I20260709 13:18:51.956859 20935 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:51.945453 20849 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:18:51.958844 20409 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:51.954695 20905 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.959630 20981 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:51.743206 19139 rpcz_store.cc:276] 0709 13:18:50.500389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.768394 (+268005us) service_pool.cc:224] Handling call
0709 13:18:50.826817 (+ 58423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.886642 (+ 59825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.889266 (+  2624us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.942333 (+ 53067us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.292755 (+350422us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:51.592104 (+299349us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.609395 (+ 17291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.639344 (+ 29949us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.662888 (+ 23544us) raft_consensus.cc:1685] finished
0709 13:18:51.663524 (+   636us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.678063 (+ 14539us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":332645,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":8736,"raft.queue_time_us":69846,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":5164,"thread_start_us":325539,"threads_started":2,"wal-append.queue_time_us":470363}
I20260709 13:18:51.960841 20680 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.986194 20680 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.969784 20780 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:51.960335 20828 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.942572 20810 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.968812 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:51.975106 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.977113 19212 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:51.982276 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:51.939612 20921 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.964135 20704 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:51.952339 20454 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:51.946772 20951 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:51.987949 20409 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.983817 20880 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:51.999185 19142 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:51.995437 20704 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:52.005968 20984 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:52.007382 20947 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.167s	user 0.004s	sys 0.000s
I20260709 13:18:51.999991 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:51.996758 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:51.999866 20409 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.033595 20965 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.034709 20454 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.036027 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:52.042025 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.041906 20704 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.042659 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1062) took 1570 ms. Trace:
I20260709 13:18:52.042688 20772 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:52.043658 20937 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.047431 19143 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:52.052032 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.057078 19145 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.053314 19144 rpcz_store.cc:276] 0709 13:18:50.472311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.699463 (+227152us) service_pool.cc:224] Handling call
0709 13:18:50.699729 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.701676 (+  1947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.701703 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.709225 (+  7522us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.777080 (+ 67855us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:50.777124 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.777190 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.006896 (+1229706us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:52.042387 (+ 35491us) raft_consensus.cc:1685] finished
0709 13:18:52.042407 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.042609 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1626,"raft.queue_time_us":1946,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7394,"spinlock_wait_cycles":18191616,"thread_start_us":16419,"threads_started":1,"wal-append.queue_time_us":119518}
I20260709 13:18:52.058236 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.058810 19144 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:52.060355 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.062186 20409 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.062683 20772 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.065529 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1058) took 1594 ms. Trace:
I20260709 13:18:52.065894 19138 rpcz_store.cc:276] 0709 13:18:50.471079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.666114 (+195035us) service_pool.cc:224] Handling call
0709 13:18:50.666440 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.777143 (+110703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.777184 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.777245 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:50.777291 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.065305 (+1288014us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400327154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:52.065350 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.065474 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254114048}
I20260709 13:18:52.066522 20908 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:52.067212 20870 consensus_meta.cc:287] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.673s	user 0.005s	sys 0.005s
I20260709 13:18:52.055006 20828 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.069072 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:52.073418 20789 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:52.073525 19750 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.067320 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.075980 20933 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.077178 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.077466 20704 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:52.064738 20772 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.067598 20870 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.077894 20981 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.053052 20935 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:52.078963 20937 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.079339 20931 raft_consensus.cc:1064] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:52.079294 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.079607 19216 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:52.080253 20454 raft_consensus.cc:1064] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:18:52.080447 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:52.081202 20857 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.081799 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:18:52.081960 20983 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:18:52.082158 19139 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:52.082511 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:52.085268 19221 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:52.075598 20819 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:52.128719 19144 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
W20260709 13:18:52.175575 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 93147.9us
I20260709 13:18:52.175904 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.088063 20908 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.140985 19146 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:52.176126 19751 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:52.100741 19145 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
W20260709 13:18:52.105294 20874 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.004s
I20260709 13:18:52.177223 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.088220 20936 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.183333 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1577) took 1610 ms. Trace:
I20260709 13:18:52.184154 19067 rpcz_store.cc:276] 0709 13:18:50.573181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.860093 (+286912us) service_pool.cc:224] Handling call
0709 13:18:50.860481 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.605358 (+744877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.183151 (+577793us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b540025e254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:52.183290 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623092992}
I20260709 13:18:52.102471 20854 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.068061 20810 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.189967 20810 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:52.190205 20857 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:52.192005 20819 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:52.194231 19145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1557) took 2930 ms (client timeout 2158 ms). Trace:
I20260709 13:18:52.195055 20981 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.196046 20981 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.103183 20701 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:52.194532 19145 rpcz_store.cc:269] 0709 13:18:49.249102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.931972 (+682870us) service_pool.cc:224] Handling call
0709 13:18:52.051824 (+2119852us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:52.179358 (+127534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9988864}
I20260709 13:18:52.173662 19138 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:52.199376 19221 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.198474 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.200489 19067 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:52.200706 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.180547 20937 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:52.201272 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.201440 19145 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:52.086165 20680 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.203732 19067 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:52.211269 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.214174 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.213723 19140 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.214847 19147 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:52.215062 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.215565 19067 raft_consensus.cc:2376] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4. Re-sending same reply.
I20260709 13:18:52.215595 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.215727 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.216547 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.217870 19067 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:52.218626 19219 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:52.218313 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1589) took 1164 ms. Trace:
I20260709 13:18:52.218968 19067 rpcz_store.cc:276] 0709 13:18:51.054195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.216351 (+1162156us) service_pool.cc:224] Handling call
0709 13:18:52.218266 (+  1915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.184862 20936 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:52.220923 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.216583 19147 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:52.220928 20772 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.222311 20772 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:52.222388 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.222853 20772 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.223640 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.220319 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.225931 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.227222 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.227568 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.227809 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.224696 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.228853 19147 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:52.203961 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.226148 20583 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:52.229897 20583 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:52.230006 19066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1325) took 1404 ms (client timeout 1677 ms). Trace:
I20260709 13:18:52.230175 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:52.230432 19066 rpcz_store.cc:269] 0709 13:18:50.825192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.827362 (+  2170us) service_pool.cc:224] Handling call
0709 13:18:52.227431 (+1400069us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:52.229953 (+  2522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52107136}
I20260709 13:18:52.231191 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.231494 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:52.231683 19064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1582) took 1657 ms (client timeout 2003 ms). Trace:
I20260709 13:18:52.232086 19066 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
W20260709 13:18:52.232189 19064 rpcz_store.cc:269] 0709 13:18:50.574633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.663118 (+ 88485us) service_pool.cc:224] Handling call
0709 13:18:52.231482 (+1568364us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b540025ce54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:52.231621 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3627392}
I20260709 13:18:52.206382 20835 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.234612 20870 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.231700 19145 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:52.236056 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.237061 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.237061 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.238271 19145 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:52.240101 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.240721 19147 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:52.241070 19140 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:52.203562 20937 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:52.244535 19066 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:52.244824 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.246881 19147 raft_consensus.cc:2368] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:52.248840 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.246780 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.251788 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.253163 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.253839 19145 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:52.254751 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.262290 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:52.262950 19217 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.263430 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.230347 20583 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.264971 20937 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.267488 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.269773 20838 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.245303 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1306) took 1670 ms. Trace:
I20260709 13:18:52.281173 19066 rpcz_store.cc:276] 0709 13:18:50.575194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.242655 (+1667461us) service_pool.cc:224] Handling call
0709 13:18:52.242867 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.245029 (+  2162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.245249 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.287048 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.286311 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.289474 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.292368 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1307) took 1715 ms. Trace:
I20260709 13:18:52.292867 19066 rpcz_store.cc:276] 0709 13:18:50.577465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.291505 (+1714040us) service_pool.cc:224] Handling call
0709 13:18:52.291810 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.291972 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.291997 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.292049 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:52.292084 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.292168 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.292303 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.322207 20836 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.323148 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.326195 20684 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.195477 20874 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.357259 20839 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.282785 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:52.363822 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 73458.7us
W20260709 13:18:52.372980 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.373445 19035 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.389636 20684 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:52.390246 20684 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:52.390709 20684 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.329185 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:52.472002 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.407161 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1309) took 1828 ms. Trace:
I20260709 13:18:52.480587 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.400381 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.322860 20469 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:52.404668 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.498378 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.497685 19063 rpcz_store.cc:276] 0709 13:18:50.579162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.406496 (+1827334us) service_pool.cc:224] Handling call
0709 13:18:52.406743 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.406904 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.406927 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.406963 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:52.406989 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.407036 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.407116 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.501240 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:52.498893 19145 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:52.503000 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:52.501823 19749 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.504158 19714 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:52.453250 19069 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:52.495580 19217 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:52.505153 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:52.503006 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.498819 19140 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:52.508330 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.339449 20965 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.500613 19142 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:52.511946 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.513088 19063 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:52.514341 19217 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.515192 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.516297 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.517001 19063 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 1.
I20260709 13:18:52.394461 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:52.405162 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:52.513772 20944 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.522115 20938 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.522470 20944 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.522531 20938 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:52.522969 20944 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.523420 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.523411 20938 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.496347 20717 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:52.525228 20717 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.526098 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1078) took 1318 ms. Trace:
I20260709 13:18:52.526446 19141 rpcz_store.cc:276] 0709 13:18:51.207658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.431370 (+223712us) service_pool.cc:224] Handling call
0709 13:18:51.449797 (+ 18427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.470105 (+ 20308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.470150 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.470211 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:51.470254 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.525924 (+1055670us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b540017b1d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:52.525964 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.526054 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46196992}
I20260709 13:18:52.527266 20739 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.528144 19141 pending_rounds.cc:85] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 4
I20260709 13:18:52.527943 20739 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.518666 20469 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:52.529496 20469 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.526640 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:52.510345 20850 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.528432 19141 pending_rounds.cc:107] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:18:52.535310 19141 raft_consensus.cc:2889] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.464203 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.587165 20717 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.587294 19138 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:52.513859 20718 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.580924 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:52.593689 19215 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:52.517498 20965 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.510259 20981 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:52.582742 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.598358 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:52.383363 20854 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:52.435195 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:52.514175 20870 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.515022 20945 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.494747 20772 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.517663 19143 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.226943 20936 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.516369 20672 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.602557 19749 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:52.519268 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.491099 20583 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.603037 20717 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:52.544384 20938 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:52.656714 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58408.4us
W20260709 13:18:52.635718 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.600188 20965 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.588824 19138 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:52.591259 20914 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.658669 20772 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:52.660329 20583 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:52.611238 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 105793us
I20260709 13:18:52.670053 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1305) took 2095 ms. Trace:
I20260709 13:18:52.660869 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.674420 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.663666 19747 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:52.600837 20999 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:52.665835 19139 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.665834 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.656032 20870 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:52.598893 20718 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:52.684497 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.609167 20854 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.672766 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.675279 19070 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:52.675941 20717 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:52.665555 20898 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:52.682233 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:52.663055 20442 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:52.682574 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:52.699193 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.681803 20870 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.682070 20583 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.693789 20898 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:52.687425 20718 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.670462 19064 rpcz_store.cc:276] 0709 13:18:50.574929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.233294 (+1658365us) service_pool.cc:224] Handling call
0709 13:18:52.233642 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.265519 (+ 31877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.265553 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:52.266057 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.602956 (+336899us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:52.602998 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.603088 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.669812 (+ 66724us) raft_consensus.cc:1685] finished
0709 13:18:52.669843 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.669991 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31457,"raft.queue_time_us":32656,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":326466,"threads_started":1,"wal-append.queue_time_us":402209}
I20260709 13:18:52.700350 19070 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:52.728579 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:52.726683 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.691478 20854 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.708058 20583 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.807279 20721 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.725131 20874 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.717996 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.725839 20852 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.708317 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.708832 20898 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.823534 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.708164 20991 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:52.819024 20583 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.701985 20937 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.834149 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.842387 20684 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.827823 19064 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.850260 19221 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:52.718421 20717 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.844372 20718 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.820016 20721 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.854282 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:52.855113 19065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1593) took 1794 ms (client timeout 1931 ms). Trace:
I20260709 13:18:52.857357 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:52.858623 20945 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:52.858764 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 124) took 1271 ms. Trace:
I20260709 13:18:52.866634 19141 rpcz_store.cc:276] 0709 13:18:51.587773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.527646 (+939873us) service_pool.cc:224] Handling call
0709 13:18:52.527967 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:52.538683 (+ 10716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.538727 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:52.539389 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 13:18:52.826185 (+286796us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:52.826238 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.826304 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.858512 (+ 32208us) raft_consensus.cc:1685] finished
0709 13:18:52.858533 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.858680 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2414,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8711,"thread_start_us":215481,"threads_started":1,"wal-append.queue_time_us":268017}
I20260709 13:18:52.858491 20583 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.844607 20684 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.859647 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1576) took 2286 ms. Trace:
I20260709 13:18:52.859714 20937 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.860630 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1087) took 1354 ms. Trace:
I20260709 13:18:52.828524 20852 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.863404 19138 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:52.877774 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.879262 19138 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:18:52.879159 20965 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:52.879987 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1592) took 1117 ms. Trace:
I20260709 13:18:52.873871 19071 rpcz_store.cc:276] 0709 13:18:50.572888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.825854 (+252966us) service_pool.cc:224] Handling call
0709 13:18:51.560277 (+734423us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465e9c 00007f6100465a5b 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:51.560501 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.760189 (+199688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.859438 (+1099249us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54001b9254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:52.859582 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513136896}
I20260709 13:18:52.881383 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.881883 19071 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.882385 20721 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:52.864578 19065 rpcz_store.cc:269] 0709 13:18:51.060367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.473828 (+413461us) service_pool.cc:224] Handling call
0709 13:18:52.854949 (+1381121us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:52.855053 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415684480}
I20260709 13:18:52.883360 20870 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.884150 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.869083 20961 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.880342 19063 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:52.874610 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.891021 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:52.896978 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.891386 19220 rpcz_store.cc:276] 0709 13:18:51.506401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.550041 (+ 43640us) service_pool.cc:224] Handling call
0709 13:18:51.550349 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.728741 (+178392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.860397 (+1131656us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540034c954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:52.860578 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348028800}
I20260709 13:18:52.880331 19138 rpcz_store.cc:276] 0709 13:18:51.762253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.878623 (+1116370us) service_pool.cc:224] Handling call
0709 13:18:52.878998 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:52.879722 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.879937 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.905392 19071 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:52.910627 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.913244 19071 raft_consensus.cc:2410] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:52.913736 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.914336 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.915359 19067 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:52.916985 19070 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.917423 19071 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.918696 20906 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.910820 20721 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.919288 19065 raft_consensus.cc:2368] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4.
I20260709 13:18:52.929378 19141 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:52.930944 19035 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:52.919878 20944 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.918884 20839 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.924104 20906 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:52.924063 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:52.936043 19071 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:52.937041 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.937873 19071 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:52.938656 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.939244 19071 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:52.940024 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.941051 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.942215 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.941975 20906 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:52.943099 19071 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:52.943408 20906 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.944006 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:52.944643 19071 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.953759 19141 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:52.954504 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1600) took 1170 ms. Trace:
I20260709 13:18:52.954815 19141 rpcz_store.cc:276] 0709 13:18:51.784202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.932249 (+1148047us) service_pool.cc:224] Handling call
0709 13:18:52.953549 (+ 21300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.954235 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.954455 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:52.961858 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57796.2us
I20260709 13:18:52.966639 19070 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:18:52.936342 20469 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:52.967707 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.936435 20870 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:52.969592 19070 raft_consensus.cc:2410] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:52.971743 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:52.973598 19141 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.980818 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.945683 19139 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:52.981434 19070 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:52.986385 20836 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:52.986886 20836 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.989607 19071 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:52.989843 20944 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:52.990535 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:52.991117 19071 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:52.991585 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:52.991806 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:18:52.992163 19220 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.992285 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 108) took 1384 ms. Trace:
I20260709 13:18:52.992578 19071 raft_consensus.cc:606] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:52.992777 19067 rpcz_store.cc:276] 0709 13:18:51.607876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.227537 (+619661us) service_pool.cc:224] Handling call
0709 13:18:52.992124 (+764587us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540040fbd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:52.992226 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579429120}
I20260709 13:18:52.996258 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 172) took 1082 ms. Trace:
I20260709 13:18:52.996625 19219 rpcz_store.cc:276] 0709 13:18:51.914058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.914607 (+   549us) service_pool.cc:224] Handling call
0709 13:18:51.914923 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.221139 (+306216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.996029 (+774890us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54001fb154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:52.996200 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698032896}
I20260709 13:18:52.997192 20843 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:52.972754 19742 raft_consensus.cc:2368] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4.
I20260709 13:18:52.998728 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 167) took 1153 ms. Trace:
I20260709 13:18:53.000113 19216 rpcz_store.cc:276] 0709 13:18:51.844979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.847337 (+  2358us) service_pool.cc:224] Handling call
0709 13:18:51.868339 (+ 21002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.174497 (+306158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.998497 (+824000us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400390dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:52.998677 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485273984}
I20260709 13:18:53.000777 20965 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.001353 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 121) took 1419 ms. Trace:
I20260709 13:18:53.001466 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:53.002655 20944 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:53.003057 20944 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:53.003446 20944 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.961933 19143 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:53.003784 20792 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.004065 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1603) took 1003 ms. Trace:
I20260709 13:18:53.004271 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.004495 19143 rpcz_store.cc:276] 0709 13:18:52.000443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.204150 (+203707us) service_pool.cc:224] Handling call
0709 13:18:53.004003 (+799853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.004956 19146 raft_consensus.cc:2376] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4. Re-sending same reply.
I20260709 13:18:53.005537 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1601) took 1221 ms. Trace:
I20260709 13:18:53.005833 19146 rpcz_store.cc:276] 0709 13:18:51.784549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.237775 (+453226us) service_pool.cc:224] Handling call
0709 13:18:53.004124 (+766349us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:53.005480 (+  1356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35550976}
I20260709 13:18:53.006556 20854 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.007637 19072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:36478
W20260709 13:18:53.009213 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.025375 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.028510 19146 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.946081 20839 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.029983 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:53.030745 19220 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:53.031869 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:53.001735 19142 rpcz_store.cc:276] 0709 13:18:51.581459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.521579 (+940120us) service_pool.cc:224] Handling call
0709 13:18:52.522135 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.522295 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:52.522673 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.830734 (+308061us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.000899 (+170165us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b18003943c0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287 00007f61035a5208
0709 13:18:53.001037 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.001083 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:53.001122 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.001192 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.001298 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161516,"prepare.queue_time_us":4044,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":172475,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":2556,"spinlock_wait_cycles":18898816,"thread_start_us":307292,"threads_started":1,"wal-append.queue_time_us":348485}
I20260709 13:18:53.034667 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:53.033965 20538 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:52.972342 20718 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:52.971653 20469 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.042708 19141 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:53.045912 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.054765 19144 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.001529 20991 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:53.008801 20854 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.009104 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1084) took 1031 ms. Trace:
I20260709 13:18:53.031682 20965 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:53.003469 19138 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.065248 19144 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.068849 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:53.070318 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.070866 19142 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.053390 20985 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:53.004298 20792 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.076841 19140 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.077698 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 118) took 1501 ms. Trace:
I20260709 13:18:53.078094 19140 rpcz_store.cc:276] 0709 13:18:51.576028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.518057 (+942029us) service_pool.cc:224] Handling call
0709 13:18:53.076338 (+558281us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:53.076591 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.077381 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.077615 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2460416}
I20260709 13:18:53.092350 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1081) took 1113 ms. Trace:
I20260709 13:18:53.073351 20854 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.063165 19139 rpcz_store.cc:276] 0709 13:18:51.977233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.407947 (+430714us) service_pool.cc:224] Handling call
0709 13:18:53.009042 (+601095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.093392 20972 raft_consensus.cc:2764] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:18:53.102902 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 73023.8us
I20260709 13:18:53.070961 20965 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.102269 19144 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:53.106227 19142 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:53.106743 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:53.096336 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:53.106860 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:53.101235 20846 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:53.076087 20985 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.109297 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:53.120078 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.167639 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.174379 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.102443 20854 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:18:53.217373 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 76472.9us
I20260709 13:18:53.222288 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:53.226033 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:53.226822 19147 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:53.223454 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:53.217115 20924 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:53.109822 20850 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.229411 19748 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:53.094873 19138 rpcz_store.cc:276] 0709 13:18:51.976397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.002926 (+1026529us) service_pool.cc:224] Handling call
0709 13:18:53.003286 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.072374 (+ 69088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.089769 (+ 17395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.230377 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1580) took 1481 ms. Trace:
I20260709 13:18:53.233569 19147 rpcz_store.cc:276] 0709 13:18:51.749159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.291290 (+542131us) service_pool.cc:224] Handling call
0709 13:18:53.225885 (+934595us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:53.230312 (+  4427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73022208}
I20260709 13:18:53.215266 20991 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.232343 19751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 325) took 1150 ms. Trace:
I20260709 13:18:53.101682 20898 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.242594 19751 rpcz_store.cc:276] 0709 13:18:52.078873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.080142 (+  1269us) service_pool.cc:224] Handling call
0709 13:18:53.229079 (+1148937us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b54005fcdd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:53.229229 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6336768}
I20260709 13:18:53.232112 20924 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.246152 20924 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.108754 20469 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.217166 20721 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:53.250424 20965 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.251133 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1320) took 2555 ms. Trace:
I20260709 13:18:53.251677 19067 rpcz_store.cc:276] 0709 13:18:50.695966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.993686 (+2297720us) service_pool.cc:224] Handling call
0709 13:18:52.994008 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:52.998385 (+  4377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.998422 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:52.999604 (+  1182us) log.cc:844] Serialized 52 byte log entry
0709 13:18:53.098567 (+ 98963us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:53.101319 (+  2752us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.102687 (+  1368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.102755 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.250849 (+148094us) raft_consensus.cc:1685] finished
0709 13:18:53.250880 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.251059 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1066,"prepare.queue_time_us":3932,"raft.queue_time_us":5010,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":12844544,"thread_start_us":98575,"threads_started":1,"wal-append.queue_time_us":248476}
I20260709 13:18:53.253816 20792 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.254150 19067 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.254442 20792 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.255010 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1324) took 2430 ms. Trace:
I20260709 13:18:53.255486 19067 rpcz_store.cc:276] 0709 13:18:50.824864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.253569 (+2428705us) service_pool.cc:224] Handling call
0709 13:18:53.253881 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.254716 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.254948 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.255927 20792 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.257300 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:53.259038 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:53.261034 20944 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.261914 20985 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.215760 20846 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:53.263890 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.241334 19744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 368) took 1655 ms (client timeout 1791 ms). Trace:
I20260709 13:18:53.272146 20721 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.273092 20721 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.256696 20792 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:53.225345 20874 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:53.284735 20792 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:53.263319 20944 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:53.265132 19744 rpcz_store.cc:269] 0709 13:18:51.585889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.587674 (+  1785us) service_pool.cc:224] Handling call
0709 13:18:53.089784 (+1502110us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:18:53.232867 (+143083us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23294720}
I20260709 13:18:53.289315 19746 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.266072 20850 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.290570 20933 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:53.303686 20850 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.304548 20965 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:53.305692 20965 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.306054 20965 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.307230 19064 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:18:53.307060 20965 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.312227 20701 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.313427 20792 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.287473 20874 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.317242 20790 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.318315 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1092) took 1241 ms. Trace:
I20260709 13:18:53.351069 19144 rpcz_store.cc:276] 0709 13:18:52.077128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.068004 (+990876us) service_pool.cc:224] Handling call
0709 13:18:53.068375 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.106351 (+ 37976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.318074 (+211723us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b54002d8054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:53.318252 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74355968}
I20260709 13:18:53.352476 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:53.321801 19146 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.329619 19141 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.340935 19072 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.346024 20965 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.353729 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.356858 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:53.353940 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.354848 19072 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:53.361188 19144 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.310470 20846 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.363301 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:53.374619 19144 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:53.375236 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:53.376484 19144 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.283185 20854 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.382897 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:53.385336 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 161950us
I20260709 13:18:53.377460 20442 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.392390 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:53.374431 20924 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.398180 19068 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:53.401072 19220 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:18:53.403927 20924 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.404101 20442 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:53.404531 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.405133 19213 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 1.
I20260709 13:18:53.405407 20924 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.410645 20871 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.411031 20871 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.414184 20583 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.417358 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 372) took 1008 ms. Trace:
I20260709 13:18:53.417747 19742 rpcz_store.cc:276] 0709 13:18:52.409330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.434860 (+ 25530us) service_pool.cc:224] Handling call
0709 13:18:53.416785 (+981925us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400646ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:53.417297 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812745472}
I20260709 13:18:53.425307 20931 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.432168 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:18:53.445008 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.412014 20871 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.378144 20718 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:53.457297 19717 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:53.459820 20945 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:53.461743 20870 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:53.462976 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.463598 19213 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:53.464962 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.465651 19218 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:53.463186 20874 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:53.454782 20906 consensus_meta.cc:287] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.008s
I20260709 13:18:53.462985 19064 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:53.469345 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1331) took 1893 ms. Trace:
I20260709 13:18:53.469702 19064 rpcz_store.cc:276] 0709 13:18:51.575956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.387807 (+1811851us) service_pool.cc:224] Handling call
0709 13:18:53.454490 (+ 66683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.469074 (+ 14584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.469288 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.463244 20951 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:53.473304 20951 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:53.474184 19072 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:53.474462 20951 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.424443 20836 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.482554 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1329) took 1907 ms. Trace:
I20260709 13:18:53.482649 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.484828 19220 raft_consensus.cc:2368] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4.
I20260709 13:18:53.484134 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.485747 19221 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:53.467057 20961 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:53.508814 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.509207 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.510190 19220 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:53.511682 19221 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:18:53.513115 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54138us
I20260709 13:18:53.486766 20961 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:53.517329 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.521860 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:53.524910 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 141471us
I20260709 13:18:53.525899 19221 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.526497 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:53.540652 20906 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.565846 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.567283 19221 raft_consensus.cc:2410] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:53.515862 20961 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.578167 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:53.579861 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 53844.9us
I20260709 13:18:53.591166 19221 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.591159 19220 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:53.581627 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53895.8us
I20260709 13:18:53.545984 20944 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.573534 19143 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 5. Ops: []
I20260709 13:18:53.569350 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 114) took 1594 ms. Trace:
I20260709 13:18:53.545800 20960 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:18:53.593894 20945 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:53.598986 20936 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.598917 20945 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.568897 21033 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:18:53.610158 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.610929 19219 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:53.614387 20836 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.616264 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.608611 20906 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:53.631735 20906 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:53.633770 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.637530 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:53.638370 21021 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:53.645358 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.646803 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.647740 19214 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.644546 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.650224 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.651175 19218 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.652185 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.652841 19214 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:53.655469 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.658247 19214 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.656313 19216 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.656396 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.667608 19218 raft_consensus.cc:2410] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:53.656740 20944 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:53.597842 19064 rpcz_store.cc:276] 0709 13:18:51.975185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.470517 (+1495332us) service_pool.cc:224] Handling call
0709 13:18:53.470833 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.471033 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:53.471327 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.506116 (+ 34789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.506242 (+   126us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.514322 (+  8080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.525658 (+ 11336us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.564763 (+ 39105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45897,"prepare.queue_time_us":534,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":5196,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2162,"thread_start_us":34373,"threads_started":1,"wal-append.queue_time_us":77523}
I20260709 13:18:53.674048 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.675467 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.675680 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:53.676095 19215 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:53.674778 19218 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:53.686444 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 113) took 2001 ms. Trace:
I20260709 13:18:53.686645 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:53.686844 19071 rpcz_store.cc:276] 0709 13:18:51.684838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.420806 (+1735968us) service_pool.cc:224] Handling call
0709 13:18:53.628071 (+207265us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:53.628273 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.628490 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:53.628747 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.686150 (+ 57403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.686201 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:53.686240 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.686301 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.686394 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":530,"prepare.queue_time_us":503,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":55370496,"thread_start_us":53640,"threads_started":1}
I20260709 13:18:53.687769 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:53.688330 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:18:53.688841 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.690250 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.691823 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.692792 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:53.693845 19218 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:53.693487 20854 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:53.695591 19213 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:53.696632 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.691452 19064 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:53.684154 20701 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.697325 19214 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:53.697093 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:53.697763 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.695243 20672 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.694782 20790 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.691313 20924 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:53.693660 20721 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.693769 20469 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:53.703986 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.704186 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.696543 20965 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.707141 19213 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:53.708334 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.709233 19212 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:53.710188 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.711720 20739 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.696084 20854 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:53.713924 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.715201 19068 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:53.715718 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.718453 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.702365 21028 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:18:53.705513 20790 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.724098 21028 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.724457 21028 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.726115 19213 raft_consensus.cc:2410] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:53.704596 20924 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:18:53.733806 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.696280 20944 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.714027 20965 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.746600 19221 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
W20260709 13:18:53.747287 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.749413 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.716795 20854 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.750613 19221 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
W20260709 13:18:53.750754 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.751122 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.702953 20701 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.755431 19213 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:53.756807 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.757790 19221 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.725255 21028 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.758694 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.753311 20965 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.738426 20924 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.762327 19221 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.762493 19070 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.760658 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.761760 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:53.760417 20717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.043s
I20260709 13:18:53.764945 19213 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.763468 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.772164 19221 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.789832 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.790798 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:53.772557 20717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.011s	sys 0.043s
I20260709 13:18:53.793815 19218 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.793987 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.795233 19070 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:53.797001 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.799695 19213 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.801245 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.801945 19218 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.802757 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.805492 19071 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.807008 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:18:53.807693 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.784121 21028 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.762219 20961 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.788973 21030 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:53.812516 19221 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.818146 19218 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.808531 20469 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:53.806227 20583 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.819301 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.795528 19212 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.820830 19218 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 1.
I20260709 13:18:53.816499 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.806634 21029 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:18:53.817348 20717 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:53.841140 20717 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:53.841300 21029 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:53.841580 20717 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.841804 21029 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:53.842820 21029 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.844085 21029 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.829068 20936 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:53.829607 21046 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:18:53.846645 19069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 112) took 2182 ms (client timeout 2168 ms). Trace:
W20260709 13:18:53.847116 19069 rpcz_store.cc:269] 0709 13:18:51.663762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.871653 (+207891us) service_pool.cc:224] Handling call
0709 13:18:53.846428 (+1974775us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54001a9d54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:53.846583 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302249216}
I20260709 13:18:53.848747 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1603) took 1338 ms. Trace:
I20260709 13:18:53.828956 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.836469 20701 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:53.850059 20469 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.850502 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:53.850994 20961 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.851090 20836 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:53.851552 20836 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:53.846736 19066 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.853771 20717 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.855856 20717 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.851233 20469 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.858649 20951 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.815459 21056 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:53.860411 21049 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:53.861802 20611 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:53.864305 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.870352 20854 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.870662 20924 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.873270 20854 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.873715 20965 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.875411 20898 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.818389 21030 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.876602 20680 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.878185 21030 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.828672 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.879218 19218 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:53.879253 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1083) took 1902 ms. Trace:
I20260709 13:18:53.880211 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.880934 19218 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:53.881706 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:53.881428 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 115) took 1906 ms. Trace:
I20260709 13:18:53.882284 19064 rpcz_store.cc:276] 0709 13:18:51.975507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.725985 (+1750478us) service_pool.cc:224] Handling call
0709 13:18:53.762286 (+ 36301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.784634 (+ 22348us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:53.814178 (+ 29544us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.880753 (+ 66575us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.880978 (+   225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.881037 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:53.881100 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.881214 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.881368 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17567,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":1974,"thread_start_us":6602,"threads_started":1}
I20260709 13:18:53.884240 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:53.886976 21038 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:53.887370 21038 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:53.889127 20965 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.890136 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.890681 19214 raft_consensus.cc:2376] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4. Re-sending same reply.
I20260709 13:18:53.891443 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.892071 19214 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.816372 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.872828 20924 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.849288 20838 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:53.892833 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.893277 19218 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.893939 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:53.899478 19214 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.899870 19221 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:18:53.900494 19184 connection.cc:256] RPC call timeout handler was delayed by -1.4432838760001232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:18:53.900987 19184 connection.cc:256] RPC call timeout handler was delayed by -1.224583875999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
I20260709 13:18:53.894343 19141 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:53.901152 19214 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:53.901273 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1885838760001661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 13:18:53.901521 19214 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:53.901638 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1768838760001472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:18:53.902024 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1255838760000643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:18:53.902238 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0832838759999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:18:53.902500 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0832838759999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:18:53.902737 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0607838760001869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 13:18:53.902935 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0454838760001621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 13:18:53.903148 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0184838760001185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 13:18:53.903358 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0139838760001112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 13:18:53.903566 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0121838760001083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:18:53.879686 20469 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.905287 19146 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:53.902235 19214 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.907887 19214 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.908593 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.909255 19146 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:53.895722 19064 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:53.910332 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:53.911191 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:53.911453 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:53.911744 20852 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:53.912166 19746 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:53.913405 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:53.913556 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:53.914381 19064 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:53.915392 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:53.484534 19067 rpcz_store.cc:276] 0709 13:18:51.574812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.256504 (+1681692us) service_pool.cc:224] Handling call
0709 13:18:53.256845 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.271667 (+ 14822us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:53.361075 (+ 89408us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.482142 (+121067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.482209 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:53.482261 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.482347 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.482488 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193048,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1098,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3389,"thread_start_us":180426,"threads_started":2}
I20260709 13:18:53.917757 19221 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:53.917805 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:53.918236 19221 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:53.911768 19146 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:53.921516 19218 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:53.923252 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.888283 21038 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.849148 19065 rpcz_store.cc:276] 0709 13:18:52.510068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.883807 (+373739us) service_pool.cc:224] Handling call
0709 13:18:53.848523 (+964716us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b5400036454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:53.848689 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17653120}
I20260709 13:18:53.852478 20836 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.879755 19143 rpcz_store.cc:276] 0709 13:18:51.976963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.005307 (+1028344us) service_pool.cc:224] Handling call
0709 13:18:53.005608 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.597506 (+591898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.879000 (+281494us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400221d54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:53.879191 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241929984}
I20260709 13:18:53.931795 20469 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:18:53.932849 19063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1336) took 1438 ms (client timeout 1871 ms). Trace:
W20260709 13:18:53.933248 19063 rpcz_store.cc:269] 0709 13:18:52.494086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.519559 (+ 25473us) service_pool.cc:224] Handling call
0709 13:18:53.932688 (+1413129us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54002cbd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:53.932798 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818626944}
I20260709 13:18:53.933986 20871 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.935823 20839 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.907264 20838 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:53.927726 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.939572 19214 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:18:53.939710 19141 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.940053 19214 pending_rounds.cc:85] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 2
I20260709 13:18:53.940277 19214 pending_rounds.cc:107] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:18:53.938474 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:53.940625 19214 raft_consensus.cc:2889] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:53.923547 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:53.942615 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:53.926095 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.918933 19221 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.952731 19221 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.953913 19141 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:53.942691 20836 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.942823 20838 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:53.954208 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:53.944705 20701 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:53.967437 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:53.957430 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:53.966538 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:53.941042 19064 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:53.942505 21038 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.937274 21028 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:18:53.968768 19141 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.970989 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:53.971545 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:53.972368 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 111) took 2322 ms. Trace:
I20260709 13:18:53.974112 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1308) took 3396 ms. Trace:
I20260709 13:18:53.947042 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:53.977391 19066 rpcz_store.cc:276] 0709 13:18:50.577681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.294028 (+1716347us) service_pool.cc:224] Handling call
0709 13:18:53.846555 (+1552527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.853091 (+  6536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.973947 (+120856us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001a9d50. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:53.974063 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3107669888}
I20260709 13:18:53.976999 19068 rpcz_store.cc:276] 0709 13:18:51.650530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.399563 (+1749033us) service_pool.cc:224] Handling call
0709 13:18:53.709825 (+310262us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:53.710003 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.716368 (+  6365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.972158 (+255790us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b540020a654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:53.972304 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128930048}
I20260709 13:18:53.978353 19146 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:53.967753 20701 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:53.969458 21061 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.947855 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:53.984431 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.985862 19069 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:18:53.988428 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 117) took 2005 ms. Trace:
I20260709 13:18:53.988914 19069 rpcz_store.cc:276] 0709 13:18:51.982722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.981230 (+1998508us) service_pool.cc:224] Handling call
0709 13:18:53.985577 (+  4347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.988110 (+  2533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.988362 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.990301 19065 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:53.991664 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1334) took 1498 ms. Trace:
I20260709 13:18:53.992012 19065 rpcz_store.cc:276] 0709 13:18:52.493460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.990899 (+1497439us) service_pool.cc:224] Handling call
0709 13:18:53.991184 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.991342 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.991374 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.991415 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:53.991448 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.991517 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.991614 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.993273 20790 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:53.993428 19065 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.993857 20790 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.994131 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1335) took 1500 ms. Trace:
I20260709 13:18:53.994539 19065 rpcz_store.cc:276] 0709 13:18:52.493778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.992964 (+1499186us) service_pool.cc:224] Handling call
0709 13:18:53.993248 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.993885 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.994079 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.984122 20921 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:53.997869 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:53.998867 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 121) took 1770 ms. Trace:
I20260709 13:18:53.999115 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:53.981158 20469 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.000726 20838 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:53.982029 20701 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.004844 19066 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:54.005457 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.983681 21061 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:54.009117 21061 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.014092 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:54.015591 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:54.018215 21061 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.019299 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:54.023236 20701 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:53.995786 19065 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:54.028450 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1608) took 1444 ms. Trace:
I20260709 13:18:54.028805 19065 rpcz_store.cc:276] 0709 13:18:52.584110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.995325 (+1411215us) service_pool.cc:224] Handling call
0709 13:18:53.995611 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.028196 (+ 32585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.028393 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.030221 19065 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:54.030889 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1609) took 1431 ms. Trace:
I20260709 13:18:54.031239 19065 rpcz_store.cc:276] 0709 13:18:52.599340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.029681 (+1430341us) service_pool.cc:224] Handling call
0709 13:18:54.030028 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.030634 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.030828 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.025292 19069 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.033245 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 122) took 1597 ms. Trace:
I20260709 13:18:54.033552 19069 rpcz_store.cc:276] 0709 13:18:52.435684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.989867 (+1554183us) service_pool.cc:224] Handling call
0709 13:18:54.025127 (+ 35260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.033039 (+  7912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.033199 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.034741 19069 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.035295 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1343) took 1376 ms. Trace:
I20260709 13:18:54.035614 19069 rpcz_store.cc:276] 0709 13:18:52.658611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.034195 (+1375584us) service_pool.cc:224] Handling call
0709 13:18:54.034453 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.035050 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.035247 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:54.037364 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.041234 19072 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:54.041802 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36478 (request call id 1322) took 3217 ms. Trace:
I20260709 13:18:54.042126 19072 rpcz_store.cc:276] 0709 13:18:50.824090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.007482 (+2183392us) service_pool.cc:224] Handling call
0709 13:18:54.040004 (+1032522us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400123ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103581a3d 00007f6108551cd0 00007f6101ad6254 00007f6101ad61e2 00007f6101ad6111 00007f6101ad608c 00007f6101ad5342 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:54.041700 (+  1696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765195520}
I20260709 13:18:54.036731 19069 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 7. Ops: []
I20260709 13:18:54.047832 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1344) took 1375 ms. Trace:
I20260709 13:18:54.032640 19065 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:54.048348 19069 rpcz_store.cc:276] 0709 13:18:52.672931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.036295 (+1363364us) service_pool.cc:224] Handling call
0709 13:18:54.036560 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.044252 (+  7692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.047775 (+  3523us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:54.050089 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 82724.7us
I20260709 13:18:54.052295 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:54.053541 20838 raft_consensus.cc:2764] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:54.053789 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:54.054724 19184 leader_election.cc:400] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:54.054977 19184 leader_election.cc:403] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:54.055181 19146 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:54.055459 21064 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:54.055904 21064 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:54.056244 21064 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.056463 19146 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:54.002724 19064 rpcz_store.cc:276] 0709 13:18:52.228861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.985207 (+1756346us) service_pool.cc:224] Handling call
0709 13:18:53.997186 (+ 11979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.998538 (+  1352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.998569 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.998620 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.998651 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.998713 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.998803 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.057600 20838 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 2. Current term is 3.
I20260709 13:18:54.061287 19138 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.061920 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1611) took 1441 ms. Trace:
I20260709 13:18:54.063164 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.063769 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.064229 19218 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.065778 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.067023 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.067291 20951 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.067762 19220 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:54.073454 19214 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:54.073837 19214 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:54.074486 19214 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.075269 19214 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:54.062733 20454 raft_consensus.cc:1068] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Unable to promote non-voter 508ee2e0531b43d7a1c05f950644ae66: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }.
  Pending config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.068449 19065 rpcz_store.cc:276] 0709 13:18:52.620258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.032040 (+1411782us) service_pool.cc:224] Handling call
0709 13:18:54.032373 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.052381 (+ 20008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.061869 (+  9488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.082360 19218 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:54.083439 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.083947 19218 raft_consensus.cc:2376] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4. Re-sending same reply.
I20260709 13:18:54.085996 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.073845 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.088157 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:54.090077 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.099743 19214 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:54.099565 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:54.100337 20961 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.096786 20838 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.104498 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:54.106062 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.110131 19214 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:54.112008 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.113620 19214 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.113716 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.114710 19218 raft_consensus.cc:2376] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5. Re-sending same reply.
I20260709 13:18:54.114019 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.117954 19220 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:54.103113 20921 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.121245 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1337) took 1626 ms. Trace:
I20260709 13:18:54.121601 19070 rpcz_store.cc:276] 0709 13:18:52.494388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.982062 (+487674us) service_pool.cc:224] Handling call
0709 13:18:54.121094 (+1139032us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540025d854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:54.121192 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672446336}
I20260709 13:18:54.109079 20790 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.127818 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.127938 19214 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:54.103401 20951 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:18:54.103885 21038 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:54.129971 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.127625 20838 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.132579 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.118932 21062 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.131381 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.103669 21064 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.152915 19220 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.153092 19215 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:54.153795 20838 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.157073 20838 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.133978 21038 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.158779 21038 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:54.159581 21038 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.160770 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1099) took 1662 ms. Trace:
I20260709 13:18:54.161155 19147 rpcz_store.cc:276] 0709 13:18:52.498041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.234667 (+736626us) service_pool.cc:224] Handling call
0709 13:18:53.235116 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.235378 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:53.278485 (+ 43107us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.339540 (+ 61055us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.135092 (+795552us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b180002d820. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:18:54.160325 (+ 25233us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b180002d820. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287 00007f61035a5208
0709 13:18:54.160469 (+   144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.160514 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:54.160552 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.160612 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.160718 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":826894,"prepare.queue_time_us":46161,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":820931,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":207,"spinlock_wait_cycles":14871680,"thread_start_us":60390,"threads_started":1,"wal-append.queue_time_us":107806}
I20260709 13:18:54.133603 20701 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:54.172935 19145 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:54.132732 21061 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:54.144079 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:54.165035 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 60617us
I20260709 13:18:54.173575 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 119) took 2597 ms. Trace:
I20260709 13:18:54.173995 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.166987 19215 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:18:54.174512 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.173933 19145 rpcz_store.cc:276] 0709 13:18:51.580812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.514360 (+933548us) service_pool.cc:224] Handling call
0709 13:18:54.159013 (+1644653us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:54.162839 (+  3826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.173361 (+ 10522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.173526 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10562304}
I20260709 13:18:54.175145 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.175472 19214 raft_consensus.cc:2410] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:54.175956 19215 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 3: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:54.176268 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.178737 19220 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
W20260709 13:18:54.180915 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 788474us
I20260709 13:18:54.181756 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:54.181898 19215 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:54.183578 19215 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:54.186115 19215 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.187462 19215 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.131579 20921 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:54.188728 19214 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:54.201025 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.201144 21019 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:54.200737 18969 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 3, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.201810 19217 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:54.201762 21019 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:54.203380 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 118) took 2219 ms. Trace:
I20260709 13:18:54.203078 21019 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.203207 18969 catalog_manager.cc:5697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.203699 19066 rpcz_store.cc:276] 0709 13:18:51.984460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.981199 (+1996739us) service_pool.cc:224] Handling call
0709 13:18:53.981488 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.005258 (+ 23770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.203163 (+197905us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b540017f2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:54.203329 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53351680}
I20260709 13:18:54.200668 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.206161 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:54.206841 19063 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:54.206705 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:18:54.207532 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.207742 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:54.209411 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.208853 18969 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 2, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.210317 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.210853 19219 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.210466 18969 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.211958 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.213339 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:54.213984 19214 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.218288 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1093) took 1832 ms. Trace:
I20260709 13:18:54.218770 19140 rpcz_store.cc:276] 0709 13:18:52.386086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.079232 (+693146us) service_pool.cc:224] Handling call
0709 13:18:53.079576 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.079833 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:53.101983 (+ 22150us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.713221 (+611238us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18002b8e80. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:18:54.217890 (+504669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.217963 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:54.218017 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.218098 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.218227 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474816,"prepare.queue_time_us":21910,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":1688,"spinlock_wait_cycles":3933952,"thread_start_us":43042,"threads_started":1,"wal-append.queue_time_us":698408}
W20260709 13:18:54.225029 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.230585 19215 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.234751 19215 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:18:54.240180 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 333581us
I20260709 13:18:54.240342 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.241083 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.244140 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.249778 19219 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:54.190974 21038 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.255880 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.256807 19213 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:54.263356 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.265837 19145 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.266865 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:54.275614 19217 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:54.285338 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:54.287919 20874 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.288295 19214 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:54.288326 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:54.262591 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:54.294886 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:54.281167 18969 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 3, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.296900 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:54.275668 21024 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:54.261081 20792 raft_consensus.cc:1027] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: attempt to promote peer 508ee2e0531b43d7a1c05f950644ae66: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:18:54.307888 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1095) took 1921 ms. Trace:
I20260709 13:18:54.208388 21020 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:54.306804 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 116657us
I20260709 13:18:54.257647 20672 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.297508 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:54.315940 20985 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.308070 19145 raft_consensus.cc:3055] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:54.317013 19145 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:54.275331 20790 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:54.275251 20850 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:54.290283 20701 raft_consensus.cc:2764] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:54.306232 20871 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.311302 21020 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.311383 20442 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:54.300995 20846 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:54.311787 20538 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:54.308806 20924 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:54.312548 20672 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:54.312621 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1094) took 1926 ms. Trace:
W20260709 13:18:54.313544 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 72538us
I20260709 13:18:54.292232 20684 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.350612 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.299897 21061 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.309466 19142 rpcz_store.cc:276] 0709 13:18:52.386726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.107389 (+720663us) service_pool.cc:224] Handling call
0709 13:18:53.115796 (+  8407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.116033 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:53.351132 (+235099us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.306550 (+955418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.306619 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:54.306680 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.307571 (+   891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.307793 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":705372,"prepare.queue_time_us":114242,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":693932,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":385023,"threads_started":3,"wal-append.queue_time_us":245041}
I20260709 13:18:54.290537 21074 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:54.304553 20874 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.304324 20852 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.317787 19145 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.334946 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 120) took 2301 ms. Trace:
I20260709 13:18:54.306656 21029 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:18:54.340679 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:54.342340 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:54.382004 19147 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:54.342545 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.341655 18969 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 3, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:54.332566 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.332252 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 120354us
I20260709 13:18:54.386139 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.309870 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:54.348673 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:54.294080 20921 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.391836 19066 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:54.300216 20936 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.320282 20850 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:54.352769 20684 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.359746 21061 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.304500 20944 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:54.362752 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:54.332616 20871 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.377159 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:54.321457 21069 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.346522 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:18:54.388729 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48133.9us
I20260709 13:18:54.331033 21020 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.320006 20965 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:18:54.304392 21052 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:54.304790 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:54.340345 20951 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:54.396634 20684 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.335055 20792 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:18:54.392568 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.359946 21074 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:54.366189 20836 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:54.399991 19110 connection.cc:256] RPC call timeout handler was delayed by -1.1609553670000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:18:54.352075 20972 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:18:54.414901 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:54.451614 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.453150 19110 leader_election.cc:400] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4.
I20260709 13:18:54.453498 19110 leader_election.cc:403] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:54.425742 19147 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
W20260709 13:18:54.435578 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.397897 21061 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.351233 21016 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:18:54.393208 20936 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:54.360101 20874 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.377012 20583 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:18:54.394973 20701 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:54.396018 20850 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:54.392750 21070 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.360390 21056 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:54.391757 20721 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:54.458292 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.389869 20914 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:18:54.413002 20871 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.481998 20874 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.458735 21074 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.436362 19064 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:54.408180 21062 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:54.397907 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:54.477286 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 142537us
I20260709 13:18:54.397403 20790 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:54.494683 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 104155us
I20260709 13:18:54.471596 20936 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:54.497193 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 104682us
I20260709 13:18:54.537333 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.538318 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:54.539462 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.416357 21075 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.499429 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:54.498025 20538 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.487309 21069 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:54.457682 20672 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.487421 20846 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:54.485826 21064 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:54.439692 21055 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.495909 21067 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:18:54.492146 21070 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.486586 19746 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:18:54.534452 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.488695 20454 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:18:54.540673 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.502705 20717 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:54.547753 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48404.4us
W20260709 13:18:54.547562 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 77589.7us
I20260709 13:18:54.548564 21017 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.547006 21076 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:54.542320 21075 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:54.576009 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.540428 20924 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.593835 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:54.540251 21079 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4.
I20260709 13:18:54.552584 20721 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:54.549652 20701 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.549572 21069 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:54.571213 19143 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:54.601230 20961 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.549532 21077 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:54.661072 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 67315.2us
W20260709 13:18:54.658617 21071 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 13:18:54.697659 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 163283us
W20260709 13:18:54.705778 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 129852us
I20260709 13:18:54.595834 21017 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:18:54.673002 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.709688 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.709864 21077 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:54.714692 21077 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.715358 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.709218 20721 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:54.595903 21064 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:54.573485 21070 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:54.722353 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 423338us
I20260709 13:18:54.692642 20583 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.604908 20717 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:54.730319 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:54.732883 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.719609 20931 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.693570 21069 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:54.572904 21080 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 13:18:54.735267 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:54.721671 21086 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.569468 21055 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.725220 20965 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:54.728039 20701 raft_consensus.cc:2764] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:54.734187 21076 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.739491 21086 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:54.749473 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.754716 20684 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.732316 21029 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:54.734741 21028 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:54.739562 20583 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:54.350503 19139 rpcz_store.cc:276] 0709 13:18:52.386427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.108292 (+721865us) service_pool.cc:224] Handling call
0709 13:18:53.226019 (+117727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.269779 (+ 43760us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:53.289262 (+ 19483us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.161177 (+871915us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.161427 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.161486 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:54.161547 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.309115 (+147568us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b5400121454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:54.312449 (+  3334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.312567 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1004836,"prepare.queue_time_us":22205,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":80,"raft.queue_time_us":812005,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":3321,"spinlock_wait_cycles":29928576,"thread_start_us":91067,"threads_started":1,"wal-append.queue_time_us":178429}
I20260709 13:18:54.746833 20442 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:54.791172 20442 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.791601 20442 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.729893 21081 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 13:18:54.783000 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.741778 20854 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.735644 20718 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:18:54.749461 21078 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:18:54.782045 19113 leader_election.cc:400] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4.
W20260709 13:18:54.806481 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48701.2us
I20260709 13:18:54.807360 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.755419 21055 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:54.781556 21076 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:54.802075 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 256281us
I20260709 13:18:54.782663 21083 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.360702 19068 rpcz_store.cc:276] 0709 13:18:52.033728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.982204 (+1948476us) service_pool.cc:224] Handling call
0709 13:18:53.982472 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.982634 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:53.987622 (+  4988us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.158699 (+171077us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b1800435dc0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:18:54.334628 (+175929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.334680 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:54.334727 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.334794 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.334895 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27433,"prepare.queue_time_us":4909,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":44805,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":3502,"spinlock_wait_cycles":21056384,"thread_start_us":148268,"threads_started":1,"wal-append.queue_time_us":368633}
I20260709 13:18:54.729046 21017 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.810707 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.663982 21062 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.784402 21079 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:54.786002 20583 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:18:54.832259 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.783444 21080 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:18:54.848232 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 105793us
I20260709 13:18:54.824120 19113 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.817420 21083 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:18:54.830811 21038 consensus_meta.cc:287] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.003s
I20260709 13:18:54.855440 19214 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.814131 20846 raft_consensus.cc:2764] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:18:54.877636 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53596.9us
I20260709 13:18:54.878288 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:54.747759 20721 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:18:54.819949 20701 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:54.832576 21055 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.831562 20538 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.859602 21081 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.906635 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1116) took 1012 ms. Trace:
I20260709 13:18:54.906832 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.849650 20583 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.832355 21079 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:54.815567 20836 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:54.899114 21094 log.cc:927] Time spent T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:54.794888 20717 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.902107 20854 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:54.903486 20871 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.904019 20931 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:54.904698 21076 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.756119 21075 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:54.907459 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 177192us
I20260709 13:18:54.906996 19144 rpcz_store.cc:276] 0709 13:18:53.894177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.896146 (+  1969us) service_pool.cc:224] Handling call
0709 13:18:53.896481 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.240155 (+343674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.240185 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.240593 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.400475 (+159882us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:54.400510 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.400572 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.906442 (+505870us) raft_consensus.cc:1685] finished
0709 13:18:54.906462 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.906580 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354917,"raft.queue_time_us":395634,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6522,"thread_start_us":102829,"threads_started":1,"wal-append.queue_time_us":227962}
I20260709 13:18:54.882328 21019 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:54.884159 21017 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.913775 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:54.922708 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:54.926278 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:54.926455 19215 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.928277 19213 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:54.909257 21081 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:54.908013 20965 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:54.933161 20914 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.917166 21055 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:54.915498 20846 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:54.906533 20701 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.921929 20538 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.910938 21079 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:54.945115 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:54.921643 20680 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:54.910928 21061 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.919591 20854 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:54.918033 19744 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:54.940322 20442 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:54.944716 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1128) took 1010 ms. Trace:
I20260709 13:18:54.970156 19748 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:54.945144 20684 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:54.945580 21019 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:54.973201 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 258004us
I20260709 13:18:54.966655 21096 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.967640 20538 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.832296 21086 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:54.964254 20852 consensus_meta.cc:287] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.000s
I20260709 13:18:54.962862 20871 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.013288 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:54.935739 21089 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:18:54.957016 21038 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:18:55.026034 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:55.014031 21092 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:18:54.963061 20874 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.964926 20850 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.021486 19746 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:54.963181 21103 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:18:55.021661 20538 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.023774 20852 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.972702 20680 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.027298 21096 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.059830 21077 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:54.920971 21083 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.033730 21113 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.029035 21122 raft_consensus.cc:2764] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:55.063114 21052 raft_consensus.cc:3055] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:55.040005 21086 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.040614 21055 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.033329 20965 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:55.140939 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.147243 19065 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.150341 19064 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.151546 19068 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:55.161175 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 238372us
I20260709 13:18:55.221395 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.224407 20985 raft_consensus.cc:2764] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:55.161897 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:55.162770 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.060266 20583 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:55.227098 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 65744us
I20260709 13:18:55.228107 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:55.164017 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1130) took 1100 ms. Trace:
I20260709 13:18:55.224444 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:55.012645 20836 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.231127 20583 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.231427 20790 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:55.232071 20790 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:55.166826 20611 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.233525 20611 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.193553 20874 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.194442 20854 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.208895 20944 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:55.237388 20944 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:55.239256 20944 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.197549 20850 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.229027 19220 rpcz_store.cc:276] 0709 13:18:54.063620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.179554 (+115934us) service_pool.cc:224] Handling call
0709 13:18:54.179912 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.180180 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:54.193347 (+ 13167us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.873411 (+680064us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.873997 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.874123 (+   126us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:54.895528 (+ 21405us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.895761 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.895927 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.163351 (+267424us) raft_consensus.cc:1685] finished
0709 13:18:55.163391 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.163726 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100418,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":4752,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":11698,"thread_start_us":700601,"threads_started":3,"wal-append.queue_time_us":590576}
I20260709 13:18:55.244987 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.245858 20972 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:55.246333 20972 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:55.246711 20972 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:55.247957 19742 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
W20260709 13:18:55.242519 21020 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.792s	user 0.010s	sys 0.006s
I20260709 13:18:55.249181 21020 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.225463 20985 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:55.255162 20985 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:55.257368 20790 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.259753 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1119) took 1545 ms. Trace:
I20260709 13:18:55.236729 20611 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.261831 21015 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:55.262367 21015 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:55.263813 21015 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.265767 21015 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.266172 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:55.260018 20792 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:55.074146 21052 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:55.104391 21077 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.111824 21079 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.298604 21079 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.083479 21083 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:55.109622 21085 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.381s	user 0.000s	sys 0.003s
I20260709 13:18:55.105986 21096 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.286209 19113 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:55.260560 19221 rpcz_store.cc:276] 0709 13:18:53.713972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.901268 (+187296us) service_pool.cc:224] Handling call
0709 13:18:53.917642 (+ 16374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.049995 (+132353us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:54.088916 (+ 38921us) log.cc:844] Serialized 14 byte log entry
0709 13:18:55.258513 (+1169597us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b1800209440. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287
0709 13:18:55.258709 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.258806 (+    97us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:55.258909 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.259410 (+   501us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.259573 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23684,"prepare.queue_time_us":38710,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":67242,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":24435,"spinlock_wait_cycles":42347392,"thread_start_us":257778,"threads_started":3,"wal-append.queue_time_us":99478}
I20260709 13:18:55.348037 20944 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.291467 20792 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:55.294814 21061 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.011437 21081 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.291843 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:55.307350 21074 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.764s	user 0.009s	sys 0.000s
I20260709 13:18:55.308228 21064 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.309826 21122 raft_consensus.cc:2764] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:18:55.283207 19068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:18:54.973239 19138 rpcz_store.cc:276] 0709 13:18:53.933851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.062077 (+128226us) service_pool.cc:224] Handling call
0709 13:18:54.062409 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:54.464758 (+402349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.480548 (+ 15790us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:54.572048 (+ 91500us) log.cc:844] Serialized 52 byte log entry
0709 13:18:54.786913 (+214865us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:54.881504 (+ 94591us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.916459 (+ 34955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.919852 (+  3393us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.944499 (+ 24647us) raft_consensus.cc:1685] finished
0709 13:18:54.944516 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.944661 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246079,"prepare.queue_time_us":63593,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2141,"raft.queue_time_us":276846,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":19578,"spinlock_wait_cycles":8867584,"thread_start_us":221220,"threads_started":2,"wal-append.queue_time_us":168553}
I20260709 13:18:55.280530 20972 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.385921 19144 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:55.380847 20838 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.192s	user 0.008s	sys 0.011s
W20260709 13:18:55.421773 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 164901us
I20260709 13:18:55.386885 21017 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.430351 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1347) took 1085 ms. Trace:
I20260709 13:18:55.434130 21100 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.436959 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.437124 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 123912us
I20260709 13:18:55.437486 21030 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:55.468461 20972 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.384985 21086 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:55.381603 21104 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.381903 21088 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.454036 21062 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:55.454212 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 164610us
I20260709 13:18:55.454527 19063 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:55.461282 21020 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.462021 21074 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.466743 21075 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.466984 20717 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.438330 21064 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:55.472944 19068 raft_consensus.cc:606] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:55.477758 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1349) took 1130 ms. Trace:
I20260709 13:18:55.471709 20985 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:55.481880 19063 rpcz_store.cc:276] 0709 13:18:54.347725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.347859 (+   134us) service_pool.cc:224] Handling call
0709 13:18:55.453825 (+1105966us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:55.454228 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.476736 (+ 22508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.477671 (+   935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32258432}
I20260709 13:18:55.446642 19071 rpcz_store.cc:276] 0709 13:18:54.344978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.345132 (+   154us) service_pool.cc:224] Handling call
0709 13:18:54.350467 (+  5335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.350839 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.350867 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.356907 (+  6040us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.530920 (+174013us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:54.530976 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.531050 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.107790 (+576740us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:55.386429 (+278639us) raft_consensus.cc:1685] finished
0709 13:18:55.386486 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.425901 (+ 39415us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b48002dc6d8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61084b3aa1 00007f61084aab37 00007f61084aa9ca 00007f61085a226f 00007f61085a1f37 00007f61085b655c 00007f61085b6508 00007f61085b6488 00007f61085b6443 00007f61085b56ec 00007f61074dfa96
0709 13:18:55.430163 (+  4262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39204,"raft.queue_time_us":2255,"raft.run_cpu_time_us":24700,"raft.run_wall_time_us":1085341,"spinlock_wait_cycles":8686208,"thread_start_us":124645,"threads_started":1,"wal-append.queue_time_us":211777}
I20260709 13:18:55.483402 21052 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.485397 21064 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.484660 21100 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.487471 19068 raft_consensus.cc:614] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:55.490289 19184 leader_election.cc:400] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4.
I20260709 13:18:55.497565 21074 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:55.498647 20936 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.951s	user 0.008s	sys 0.008s
I20260709 13:18:55.469544 20792 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.474417 20838 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.488857 21017 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.506999 21052 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.505949 20538 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.507099 20985 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:55.515208 21016 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:55.515647 21016 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:55.520433 20701 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.515669 20985 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.522526 21100 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.509426 20717 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.525279 20717 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.493544 21104 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.503278 20936 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.516765 21016 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.535305 19066 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.503412 21086 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.547443 19068 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:55.536161 21016 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.513459 21088 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.578261 19744 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:55.572455 21083 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:55.579830 21083 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.586808 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:55.587539 21070 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.012s
I20260709 13:18:55.587801 21074 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:55.588028 21070 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.589037 21062 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.590298 21070 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.598397 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.601523 20838 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.602620 20538 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.612373 21088 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:55.612771 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1139) took 1546 ms (client timeout 1786 ms). Trace:
I20260709 13:18:55.613379 21070 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.613471 21104 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.613806 21086 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.604494 21017 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:55.602483 20936 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.614272 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:55.624509 21132 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:18:55.630954 21083 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:55.631630 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.633831 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1352) took 1284 ms. Trace:
I20260709 13:18:55.634297 19065 rpcz_store.cc:276] 0709 13:18:54.349567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.351451 (+  1884us) service_pool.cc:224] Handling call
0709 13:18:54.397637 (+ 46186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.219068 (+821431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.633498 (+414430us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b5400035f54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:55.633764 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701408512}
I20260709 13:18:55.636137 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1354) took 1280 ms. Trace:
I20260709 13:18:55.636497 19069 rpcz_store.cc:276] 0709 13:18:54.355773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.355910 (+   137us) service_pool.cc:224] Handling call
0709 13:18:54.788158 (+432248us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:18:54.788314 (+   156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.815094 (+ 26780us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:54.872472 (+ 57378us) log.cc:844] Serialized 14 byte log entry
0709 13:18:55.147020 (+274548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.147131 (+   111us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:55.147263 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.635775 (+488512us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b5400057b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:55.635823 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.635983 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57441,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":88909,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":265,"spinlock_wait_cycles":72086656,"thread_start_us":331064,"threads_started":2,"wal-append.queue_time_us":162510}
I20260709 13:18:55.645362 19145 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:18:55.617595 19218 rpcz_store.cc:269] 0709 13:18:54.065776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.115288 (+ 49512us) service_pool.cc:224] Handling call
0709 13:18:55.612336 (+1497048us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54001ea0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:55.612546 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1944299264}
W20260709 13:18:55.657155 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 66351us
I20260709 13:18:55.658130 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:55.659174 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:55.659446 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50824.1us
I20260709 13:18:55.661067 21016 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:55.661593 21016 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:55.662227 21074 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.662761 21074 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.663759 21064 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.669189 20854 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.669818 20854 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:55.670236 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 212712us
I20260709 13:18:55.672115 20854 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:55.673117 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 195409us
I20260709 13:18:55.679883 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.682051 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.682817 19143 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:55.684477 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.688758 20838 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:55.685253 20924 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.691594 20924 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.693343 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:55.694270 19744 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:55.685547 19139 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:55.686007 19067 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:55.686726 20701 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.698681 20701 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.688968 19065 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:55.683715 21127 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.179s	user 0.004s	sys 0.000s
I20260709 13:18:55.689620 21074 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.690306 20790 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:55.690761 21122 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:55.664825 21016 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.705201 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.726366 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.706328 18969 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 4, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 4 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.708623 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.709292 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:55.709491 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:18:55.702416 21133 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:18:55.723464 21062 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:55.723570 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.724218 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:55.724535 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.724648 21056 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:18:55.726080 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.700806 20701 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.732149 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.727891 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.732707 21062 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:55.739435 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 79134.9us
W20260709 13:18:55.741338 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 73683.4us
I20260709 13:18:55.742818 20790 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.744457 19221 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.745370 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.745620 20790 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.746186 19142 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:55.735476 21122 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.752508 21081 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.753551 18969 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.756160 18969 catalog_manager.cc:5697] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.761583 19221 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.732445 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:55.730816 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.771083 19140 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.771965 19217 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:55.777339 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.778204 19144 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:55.729691 20838 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.781984 19144 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.779466 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.752789 21122 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.767197 21074 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:55.757974 20924 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:55.782500 20921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.028s	sys 0.031s
I20260709 13:18:55.796674 19218 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:55.788017 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:55.799266 19216 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:55.800524 21064 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:55.787271 19139 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.822077 20838 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:55.823081 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 56275.8us
W20260709 13:18:55.797381 20921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.029s	sys 0.031s
I20260709 13:18:55.824842 20921 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:55.825035 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.825474 20921 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:55.826676 20921 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.827751 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.828490 19069 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 2.
I20260709 13:18:55.828758 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.829208 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.830195 19067 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:55.831092 21089 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:55.833209 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.833492 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.834033 19065 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:55.834180 19142 raft_consensus.cc:2368] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:18:55.834895 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.836006 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.837258 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.837441 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.838287 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.836786 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.838615 19068 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:55.840221 21122 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.840590 19146 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.839897 18969 catalog_manager.cc:5697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.840819 19064 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:55.841917 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.842512 19069 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.843688 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.838672 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.846367 21122 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.847707 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:55.850052 21122 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.851441 19069 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:18:55.851832 19184 leader_election.cc:400] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:18:55.852203 19184 leader_election.cc:403] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.841944 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.815044 19145 raft_consensus.cc:2410] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:18:55.908478 19144 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.908806 19216 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:55.909858 19145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1133) took 1643 ms (client timeout 1979 ms). Trace:
I20260709 13:18:55.910257 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:55.910229 19145 rpcz_store.cc:269] 0709 13:18:54.266545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.266657 (+   112us) service_pool.cc:224] Handling call
0709 13:18:55.645187 (+1378530us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b240043f610. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103568462 00007f6103580fe7 00007f61035827de 00007f610358e27c 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2
0709 13:18:55.909626 (+264439us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b540018a454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:55.909757 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536917120}
I20260709 13:18:55.911072 19216 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:55.911577 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.869370 21091 consensus_queue.cc:1059] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:55.912143 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.912786 21020 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.913415 21020 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.915723 19140 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:55.860080 19146 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:18:55.870085 21104 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:55.917807 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.916694 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.919131 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.919236 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.860796 19218 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:55.920431 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.865311 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.921136 19221 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.921223 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.921837 19144 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:55.922163 19218 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:55.922634 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.922885 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.923467 19218 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:55.923705 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.924224 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.862166 18966 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60506 (request call id 204) took 10944 ms. Trace:
I20260709 13:18:55.862751 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.926129 19219 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:55.871147 19139 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
W20260709 13:18:55.872645 21069 consensus_meta.cc:287] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.924s	user 0.005s	sys 0.013s
I20260709 13:18:55.862177 19215 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.854959 21122 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.929348 21069 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.924710 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.931082 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.871608 20680 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:55.852406 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.932348 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.857748 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.765261 21062 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.866344 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.936031 19215 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:55.855736 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.936951 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.853930 20538 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:55.912107 19145 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.937583 20538 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:55.938231 21122 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:18:55.939419 21062 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.939653 20538 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.862908 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.857354 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.859544 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.885318 18969 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.925034 18966 rpcz_store.cc:276] 0709 13:18:44.918011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.918339 (+   328us) service_pool.cc:224] Handling call
0709 13:18:55.861935 (+10943596us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:49.458691 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:49.812225 (+353534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:49.816591 (+  4366us) write_op.cc:435] Acquired schema lock
0709 13:18:49.819445 (+  2854us) tablet.cc:662] Decoding operations
0709 13:18:50.571827 (+752382us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:50.577370 (+  5543us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:50.578953 (+  1583us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:18:50.669891 (+ 90938us) tablet.cc:701] Row locks acquired
0709 13:18:50.669910 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:50.670061 (+   151us) write_op.cc:270] Start()
0709 13:18:50.670186 (+   125us) write_op.cc:276] Timestamp: P: 1783603130670017 usec, L: 0
0709 13:18:50.670207 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:50.670904 (+   697us) log.cc:844] Serialized 7050 byte log entry
0709 13:18:51.026126 (+355222us) op_driver.cc:464] REPLICATION: finished
0709 13:18:51.841473 (+815347us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f61004800ac 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f6106fc0ef0
0709 13:18:51.986008 (+144535us) write_op.cc:301] APPLY: starting
0709 13:18:51.986095 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:51.986448 (+   353us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:51.986471 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:51.995017 (+  8546us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:51.997708 (+  2691us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:18:51.997762 (+    54us) write_op.cc:312] APPLY: finished
0709 13:18:52.054224 (+ 56462us) log.cc:844] Serialized 125 byte log entry
0709 13:18:52.173470 (+119246us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.180472 (+  7002us) write_op.cc:454] Released schema lock
0709 13:18:52.185665 (+  5193us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:52.186025 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.186065 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16697,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":957938,"apply.run_cpu_time_us":10573,"apply.run_wall_time_us":200008,"num_ops":18,"prepare.queue_time_us":822609,"prepare.run_cpu_time_us":10031,"prepare.run_wall_time_us":1367519,"raft.queue_time_us":100644,"raft.run_cpu_time_us":31579,"raft.run_wall_time_us":996933,"replication_time_us":341611,"spinlock_wait_cycles":26394496,"thread_start_us":1569454,"threads_started":5,"wal-append.queue_time_us":225405,"wal-append.run_cpu_time_us":5708,"wal-append.run_wall_time_us":2178510}]]}
I20260709 13:18:55.942575 18969 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.916548 21020 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:55.873323 21074 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:55.888231 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.946542 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.881587 19220 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:55.874657 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 108084us
I20260709 13:18:55.888301 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.889729 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:55.893602 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52023.8us
I20260709 13:18:55.894383 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:55.897794 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:55.906594 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.908027 19067 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:55.948010 19145 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:18:55.917852 21104 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:55.855562 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:55.920017 21016 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:55.931766 21069 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:55.869386 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.762594 19138 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:55.958248 19139 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:55.931730 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.933308 19217 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:55.934322 19142 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.912847 20961 raft_consensus.cc:3055] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:55.886257 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 3846ceb53ab145bfa0ae536aa51f05d0: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:55.936048 19214 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:55.937588 19215 raft_consensus.cc:2368] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5.
I20260709 13:18:55.919989 19146 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:18:55.944376 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.883837 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:55.951536 19221 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:55.947888 19141 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
W20260709 13:18:55.966305 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 76658.7us
I20260709 13:18:55.953980 19140 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:55.967182 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.952312 21104 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:55.974213 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.974634 19145 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:55.977697 19220 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:55.980808 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:55.963001 20961 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:55.977876 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 122404us
I20260709 13:18:55.982666 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:55.990388 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.991076 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:55.991276 19220 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:55.990388 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.981815 19212 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:55.996222 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:55.997839 19219 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:56.001085 19069 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:55.988588 21052 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.004251 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:56.005707 21020 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:56.006053 20951 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.006592 21020 consensus_queue.cc:1243] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:55.991595 21069 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:56.012279 19068 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:55.993490 20583 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.017179 19215 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:56.016677 19214 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 2.
I20260709 13:18:56.018671 19219 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:56.018880 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:55.998813 21081 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.026065 20961 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.026948 21052 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.011983 20538 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:56.040555 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:56.016273 20583 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.012760 21069 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:56.021032 20790 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.054322 19214 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:56.054833 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:18:56.057359 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.057544 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.060632 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.061493 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.063241 19215 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:56.027025 20836 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.067250 19214 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:56.067648 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:56.068547 19214 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:56.070359 21081 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.073350 21052 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.038305 20838 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:56.069128 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:56.074568 19066 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.074954 21081 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.075212 20961 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.076970 20924 consensus_queue.cc:1059] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:56.006623 20951 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.020780 21112 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:18:56.079099 20951 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:56.070349 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.046594 20583 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.012501 21089 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:56.079875 19065 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:56.071097 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.080366 21089 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.080780 21089 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.081844 21089 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.083240 21089 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.044919 20538 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.028074 21104 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.085176 20538 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.086011 21104 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.086151 20701 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.086475 20538 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.086813 20701 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:56.087772 20701 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.089654 20944 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:56.072256 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.069743 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.091486 19063 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:56.011737 20921 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:18:56.022399 21083 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:18:56.094180 19215 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:56.095124 20836 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.096311 19068 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 2: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:56.065387 21074 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.096887 19072 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:56.097877 21016 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.103407 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.089478 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.105466 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:56.052860 21069 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.121039 19066 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
W20260709 13:18:56.108135 19038 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.3:39345 timed out after 1.786s (SENT) [suppressed 33 similar messages]
W20260709 13:18:56.132580 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.132409 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.137629 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:56.138271 19216 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:56.143419 21091 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:56.146436 20836 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:56.146610 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:56.146937 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 41fc665fafb64d08b393d9c8a77d2608: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:18:56.144656 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 55297us
I20260709 13:18:56.124150 21081 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.140733 19216 pending_rounds.cc:85] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 2
I20260709 13:18:56.130185 21016 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:56.137629 21055 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.226922 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 53782.8us
I20260709 13:18:56.233177 21122 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.167327 21081 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.168648 20921 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:56.259893 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 206581us
I20260709 13:18:56.172844 19216 pending_rounds.cc:107] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:56.262303 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:56.170567 21075 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:18:56.225613 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:56.234316 21070 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:56.172206 20680 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:18:56.245774 21081 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.236136 20838 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:18:56.289552 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 157306us
I20260709 13:18:56.266002 19216 raft_consensus.cc:2889] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:56.283581 19140 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:56.280068 19219 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:56.321652 20921 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.298681 21102 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.175s
I20260709 13:18:56.322317 20921 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.323200 21102 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.323608 21102 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:56.323926 20839 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:56.324534 20839 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.299106 21083 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.294466 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:56.299350 20454 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.275365 21016 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:18:56.301939 21144 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:18:56.302750 21148 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:18:56.303575 21147 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:18:56.305198 21145 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:18:56.306219 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.309278 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:56.309445 20936 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.309537 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:56.309998 20965 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.311076 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 73211.3us
I20260709 13:18:56.311606 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:56.350173 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 716382b8056843a8ac2701a2242b5834 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40740
I20260709 13:18:56.350601 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:56.260923 21055 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.311812 21030 raft_consensus.cc:3055] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:56.353049 21030 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:56.353137 21055 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.354051 21030 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:56.312708 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 144518us
I20260709 13:18:56.355221 20839 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.355458 19146 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:56.356551 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:56.356674 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:56.356963 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:56.357203 19146 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:56.358152 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:56.359068 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:56.359763 19139 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:56.360062 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:56.317516 21112 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:56.318022 19749 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:56.319067 21074 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.324599 21102 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.309296 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:56.344887 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.324664 20921 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:56.339799 20454 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.350041 21164 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.361691 19072 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:56.347342 19142 raft_consensus.cc:2376] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4. Re-sending same reply.
I20260709 13:18:56.348639 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:56.376489 19140 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:56.360170 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:56.355108 21030 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.382651 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:56.359798 19145 raft_consensus.cc:2368] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5.
I20260709 13:18:56.385510 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:56.343401 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 240773us
I20260709 13:18:56.359068 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:56.386862 19217 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:18:56.365309 19147 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:56.280582 21070 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.327922 21083 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.378198 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.354259 20583 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.343791 21104 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.300551 20838 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.382210 19212 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:56.382128 20680 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:56.393182 21102 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.393277 19068 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:56.393923 19063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7347527d150466586ce647078eff8bb"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:18:56.394380 21088 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.368507 21112 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.372898 21064 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.407544 19214 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:56.364830 19742 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
W20260709 13:18:56.410197 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.412040 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.357350 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:56.436085 19743 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:56.415448 21165 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.415582 19751 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:56.415865 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:56.437037 21074 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:56.437748 19212 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:56.439517 21056 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.407539 21164 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:56.440052 21056 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.415956 21083 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.440532 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:56.441187 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.441375 21083 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.441522 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:56.441761 19070 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:56.442171 21056 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:56.442704 21056 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:56.442730 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:56.443174 21056 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.443287 20944 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.443629 21056 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.444015 19038 leader_election.cc:400] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5.
I20260709 13:18:56.443807 20944 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.444315 19038 leader_election.cc:403] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.415462 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.384477 21086 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.445231 21086 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:56.445621 21086 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:56.447154 21062 consensus_meta.cc:287] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.003s
I20260709 13:18:56.418174 19063 raft_consensus.cc:606] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:56.449079 20839 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.449704 20839 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:56.450738 20839 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.380590 21075 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:18:56.427574 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:56.407758 21104 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.432025 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.432214 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.436515 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.449179 19063 raft_consensus.cc:614] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:56.382421 20921 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.372273 20936 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.375468 21020 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:56.446128 20944 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.458069 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.384213 21017 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:18:56.460381 21104 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.457614 19072 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:56.373049 20790 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:56.463017 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.405573 21081 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.425614 21088 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:56.417135 20454 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.472313 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.455097 20538 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.396163 20965 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.476081 21162 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.481474 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:56.443183 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.481201 19068 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:56.467654 21016 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.488965 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.478722 21088 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.466467 21164 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:56.530565 19714 leader_election.cc:336] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.521s (SENT)
I20260709 13:18:56.469705 21074 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:18:56.534855 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.528385 19140 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:56.466253 20921 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.494320 21016 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.493095 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:56.505012 20454 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.473593 21165 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:18:56.552897 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49124.9us
I20260709 13:18:56.552654 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.556223 19717 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:56.531879 19065 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:56.488169 20538 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.539682 19064 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:18:56.573665 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.550820 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:56.553159 21016 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.559703 21075 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:56.637291 19066 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:56.576850 20454 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.580598 20944 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:56.660784 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.540988 21112 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.630671 19743 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:56.640503 20871 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.659988 20944 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.666867 20924 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:56.670217 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.674664 20583 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:56.691736 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 343146us
I20260709 13:18:56.717751 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:56.680032 20944 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:56.589516 20790 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.727610 19063 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.686154 21112 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.731843 19072 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:56.667099 21158 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.220s
I20260709 13:18:56.685135 20924 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5.
I20260709 13:18:56.722102 20936 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:56.741205 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 252344us
I20260709 13:18:56.725261 21081 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:56.743096 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:56.735845 21169 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:56.749476 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 268074us
I20260709 13:18:56.749894 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:56.737605 21055 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.755846 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.744302 20583 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.753944 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:56.725714 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:56.736518 21086 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.769141 19221 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:56.769084 21075 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.756165 20924 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.796001 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:56.748994 21170 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:56.753829 21182 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:56.808202 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 422752us
I20260709 13:18:56.810950 21075 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.757853 21169 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:56.799330 19214 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
W20260709 13:18:56.795607 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 243001us
W20260709 13:18:56.809333 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 59509.4us
I20260709 13:18:56.765898 20921 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:56.817982 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 64156.7us
I20260709 13:18:56.771957 20538 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:56.820415 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 95620.5us
I20260709 13:18:56.825863 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.783927 21180 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.827802 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 61432.2us
I20260709 13:18:56.751163 20454 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.760751 21055 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:56.820995 21122 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.001s
W20260709 13:18:56.830473 21156 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:18:56.822382 20924 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:56.846410 20921 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:56.846925 21188 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:56.847774 21176 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:18:56.849697 21184 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:18:56.849907 21086 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:56.853317 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:56.839661 21122 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.859993 20839 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:56.854544 21170 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:18:56.833331 21183 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:56.862766 21181 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:56.869318 19744 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 13:18:56.888619 19744 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:18:56.863562 21194 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:56.864027 21171 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:18:56.857513 19063 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:56.872169 20839 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.873771 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:56.873720 21182 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:56.890005 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:56.905303 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:56.863245 21177 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:56.874811 21188 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.874717 21195 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.875990 21183 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:56.840843 21180 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.879914 19743 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:56.881247 21198 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:56.885483 21056 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:56.887303 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.901609 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:56.900604 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:56.854310 21055 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:56.874675 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 716382b8056843a8ac2701a2242b5834 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:18:56.917243 21188 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:18:56.924134 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 103105us
I20260709 13:18:56.903702 20839 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.934336 21182 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:56.934964 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:56.935943 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:56.936632 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:56.937366 21195 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.917271 19143 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:56.953431 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:56.953691 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:56.960721 19063 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:18:56.954494 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 100203us
I20260709 13:18:56.906252 21064 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:18:56.958920 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.922737 20951 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.908423 20836 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:56.955102 19147 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:56.970239 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:56.965867 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.946486 21062 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:56.908223 21086 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:18:56.971939 19110 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:56.921271 21183 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:56.974828 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 127632us
I20260709 13:18:56.977998 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:56.979826 21207 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.981457 21207 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.981981 21207 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:56.953354 18957 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 78845.7us
I20260709 13:18:56.960646 21182 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:56.920658 21189 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:18:56.986210 21208 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:56.987035 21203 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:56.987646 21190 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:57.021937 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 121409us
I20260709 13:18:56.969630 20951 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.973163 21081 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.890941 21169 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.991501 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:56.991948 21204 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.993160 21198 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:56.994910 20836 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.995472 19143 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.996165 21016 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:56.974025 21062 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.941107 21191 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:18:57.057631 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet ef2bd04462cb41488ea5d3a18b899972: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:18:56.963871 20790 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.939940 21104 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.012053 19214 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:56.976962 20936 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:57.051440 20836 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.064150 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.064636 20836 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.064960 20790 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.065510 21160 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.066028 21160 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:56.962678 21202 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:18:57.066998 20790 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.064082 19214 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:57.025092 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.035411 19714 leader_election.cc:400] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5.
I20260709 13:18:56.972084 21030 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:18:57.049156 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.049611 21198 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.058254 19139 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:57.061564 21217 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.062434 19213 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:57.046749 21190 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.057245 21062 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.046437 21203 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.011622 21194 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:18:57.045351 20951 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.087371 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.087419 19749 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:56.974082 20924 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.050110 20538 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.071179 19751 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:57.050081 21207 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:57.078794 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.046375 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.082839 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.069317 19216 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:57.001552 21195 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.090992 21190 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.091262 21104 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.092712 21016 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.083613 21217 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:57.093698 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69156.8us
I20260709 13:18:57.094592 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:57.079310 21198 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.098662 21203 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.099172 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.099843 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:57.100203 20790 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:18:57.107966 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:57.110581 20961 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:57.026423 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:57.093710 21069 consensus_meta.cc:287] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.002s
I20260709 13:18:57.118853 19146 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:57.125804 19142 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.126531 21070 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.108333 21192 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:18:57.105821 19743 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEARNER]: Advancing to term 7
I20260709 13:18:57.022215 21089 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:57.123260 21102 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.002s
W20260709 13:18:57.132366 21216 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:57.132906 19744 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:57.147164 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 73849us
I20260709 13:18:57.143275 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:57.174238 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 190189us
I20260709 13:18:57.117347 21207 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:18:57.106405 20538 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.127663 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.125905 21190 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:57.141645 21056 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.025206 20944 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.186307 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.173530 21203 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.190797 19140 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:57.183612 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:57.173036 21170 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:57.176414 21089 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:57.180807 21070 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.192307 21102 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.201442 21219 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:57.201346 21102 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.215368 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:57.216384 20790 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:57.216812 20790 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.217329 20790 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.206859 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:57.172590 21069 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.208321 21210 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.210717 20944 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.211560 19750 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:18:57.190585 21088 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:18:57.213665 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.214406 20839 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.215306 20583 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.213119 21170 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.191053 21104 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:57.222643 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 305736us
W20260709 13:18:57.223690 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 80502.9us
I20260709 13:18:57.232926 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:18:57.234361 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.235126 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.235543 20701 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.236085 20701 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:57.235198 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.239883 21102 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.246387 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:57.246521 19219 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:57.247145 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:57.248767 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:57.221131 21207 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.198385 21217 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.189954 19143 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:57.257934 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.257651 19070 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:57.261354 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:57.264148 20583 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.264839 20583 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:57.265210 20583 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.265558 20583 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.266165 19748 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:57.268642 19746 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:57.270054 20965 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.270584 20965 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:57.271044 21221 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.271165 20965 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.271574 21221 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.266738 21190 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.272832 21190 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:57.274164 21211 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:18:57.274997 21190 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.275489 20454 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:57.276031 20454 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:57.276230 21069 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.277029 21232 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.276952 20454 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.277511 21083 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:57.277599 21232 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.278215 21089 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.279428 21089 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.279893 21232 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.282691 19145 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:57.279928 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.277983 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.196748 21203 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.226296 21194 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:57.292675 19063 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:57.300025 21069 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:57.301129 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.302521 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.303117 19746 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:57.303953 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.304531 19746 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:57.305737 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:57.305812 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:57.306814 21189 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.308475 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:57.309816 21189 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:57.310269 21189 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.310714 21189 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.318104 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:18:57.230170 21104 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:57.270466 19745 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:57.255386 21075 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.323045 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.327572 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.327867 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.328864 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.329439 19216 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.329610 21203 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.267159 21207 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:57.330211 21170 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.330295 21207 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.331714 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.332456 19214 raft_consensus.cc:2410] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:57.327380 21194 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.224853 21088 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.335700 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:57.278014 21083 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:57.270628 21016 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.224263 21070 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.339346 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:57.341205 20951 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.342861 20839 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.345470 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.345562 19142 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:57.347751 19145 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:57.326668 21104 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.324827 21112 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:57.366351 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.366789 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.319875 19744 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:57.369102 19141 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:57.289335 21190 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:18:57.320670 21052 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:57.344375 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.375799 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.376592 19217 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:57.230638 21210 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.356084 21075 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.381532 19216 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:57.385742 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.386396 19216 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:57.389272 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.390110 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.348009 21062 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.347855 21188 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:57.419354 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.371829 19143 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:18:57.368774 21016 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.469111 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.469767 19066 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:57.454830 19742 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:57.476365 20951 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.477263 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:57.471655 21219 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:57.480337 21219 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:57.480541 21167 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.839s	user 0.000s	sys 0.005s
I20260709 13:18:57.481596 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.387751 21165 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:18:57.461571 21223 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.470521 21112 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.550908 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:57.551620 19066 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.527935 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1151) took 1664 ms. Trace:
I20260709 13:18:57.528414 19216 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:57.398203 20836 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:57.476799 21235 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:18:57.571352 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 114217us
W20260709 13:18:57.549767 21237 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:57.571890 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.553457 19218 rpcz_store.cc:276] 0709 13:18:55.863502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.009097 (+145595us) service_pool.cc:224] Handling call
0709 13:18:56.024261 (+ 15164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.053675 (+ 29414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.053720 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.123562 (+ 69842us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.372655 (+249093us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:56.372699 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.372763 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.458001 (+1085238us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:18:57.524914 (+ 66913us) raft_consensus.cc:1685] finished
0709 13:18:57.524942 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.527852 (+  2910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28739,"raft.queue_time_us":21193,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"spinlock_wait_cycles":6014720,"thread_start_us":217381,"threads_started":1,"wal-append.queue_time_us":411769}
I20260709 13:18:57.572748 19216 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.574231 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:57.575600 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:57.527444 20538 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.527752 21239 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:57.459107 21083 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.550091 21221 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:57.577881 21213 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:57.566143 21112 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.587239 21231 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.524032 21183 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.584144 20951 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:57.602960 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.605531 19218 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:57.615742 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.616261 19218 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.625713 19216 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:57.627276 19066 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:18:57.632478 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:57.615078 21217 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:57.634346 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.603698 20965 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.605298 20951 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.570926 21223 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.570286 21198 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:57.661034 21233 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
W20260709 13:18:57.661480 21241 log.cc:927] Time spent T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:57.662182 21223 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.662778 21198 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.663075 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.663486 19144 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:57.627655 21165 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.664209 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.664143 21165 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.665643 21229 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:57.666350 21165 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.666278 21229 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.626627 21189 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.668713 21189 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.671201 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.673095 21062 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:18:57.673352 21240 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:18:57.569248 21219 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.674374 21219 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.668797 19138 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:57.649796 20583 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.675697 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:57.676616 19138 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:57.668632 21229 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.677883 19138 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:57.679908 21223 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:57.665827 21245 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:57.681049 19067 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:57.626001 21070 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.602258 21239 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.654703 21231 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:57.684355 21165 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.657445 21104 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.685772 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:57.686571 21169 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.687186 20836 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.692009 20790 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.693507 21207 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.694855 21229 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:57.677881 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.698141 21183 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.699214 21016 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.683921 21194 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.651541 20951 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.710126 19064 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.714985 19066 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:57.718739 19218 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:57.720084 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:57.722049 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.711858 21231 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:57.720453 20965 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:57.724689 19217 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:57.725095 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:57.725014 20965 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.712654 21169 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.725207 21231 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.726033 20836 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:57.726423 20836 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.726773 20836 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.727381 21169 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.732748 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.735806 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.736056 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:57.713449 21165 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.728613 20583 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.727442 20965 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.728120 21219 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.739897 19066 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.757694 21239 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.735486 21169 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.762535 21169 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.770960 19066 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:57.751945 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.718043 21229 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.779806 21229 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.781769 21089 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:57.753691 19743 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 13:18:57.782316 21089 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.774582 21207 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.776571 21219 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:57.777873 19070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:18:57.781558 21255 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:57.776105 21192 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:57.790490 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:57.764638 21169 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.827795 19747 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:57.804931 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:57.806957 19070 raft_consensus.cc:606] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:18:57.809159 21089 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.807703 21192 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:57.823603 21160 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.827678 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.833771 21223 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.842001 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.843026 21223 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:57.843442 19139 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:57.830624 19070 raft_consensus.cc:614] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:57.847160 19070 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:57.832020 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.848994 21219 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.849961 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:57.849815 21182 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.851462 21182 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.852626 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:57.831532 19066 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:57.856652 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.839094 19141 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:57.833729 21030 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.844318 21104 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.844072 21192 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.783042 19743 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:57.804111 19218 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:18:57.869536 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.872820 21223 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.873622 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.874351 19220 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:57.875058 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.870759 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 148) took 1515 ms. Trace:
I20260709 13:18:57.870352 21030 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.876070 19070 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:57.876127 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:57.877296 19220 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:18:57.877952 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.878469 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:57.875607 19146 rpcz_store.cc:276] 0709 13:18:56.355511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.357901 (+  2390us) service_pool.cc:224] Handling call
0709 13:18:56.358231 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.142461 (+784230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.870442 (+727981us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54003101d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:57.870644 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744836480}
I20260709 13:18:57.880342 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.881129 19066 raft_consensus.cc:2410] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:57.885324 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.885535 19064 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:57.891553 19141 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:57.820348 21112 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.897440 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.898531 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.899441 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.899600 21030 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:57.899951 19066 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:57.900938 21089 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:57.901583 21089 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.904294 21089 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:57.904668 20790 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.905551 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.906471 19220 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:18:57.906824 20951 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:57.907368 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.900825 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.908701 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:57.913365 19220 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:57.889392 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:57.917742 19064 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:18:57.918584 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.887403 21165 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.901609 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:57.894716 20924 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:57.949718 21261 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.950392 21261 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.925220 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:57.954456 21064 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:57.955128 21064 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.958216 21064 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:57.959978 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.938577 19743 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.970116 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:57.976678 19066 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.939494 20924 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.985872 21162 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:57.986275 21162 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:18:57.987131 21162 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:57.988087 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:57.988647 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:57.990056 19139 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:18:57.963608 21261 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.990248 19140 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:57.968640 20951 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:57.954471 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:57.988121 21162 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.997340 20924 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.031232 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1173) took 2001 ms. Trace:
I20260709 13:18:58.031672 19221 rpcz_store.cc:276] 0709 13:18:56.036998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.126727 (+ 89729us) service_pool.cc:224] Handling call
0709 13:18:56.155454 (+ 28727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.773321 (+617867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.031011 (+1257690us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54000749d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:58.031172 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410848640}
I20260709 13:18:58.035658 21088 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.028811 19212 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:18:58.039183 21180 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.032809 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:58.042066 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:58.044742 19212 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:58.045243 21081 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:58.045720 21081 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.054065 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:58.055830 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 204) took 1914 ms. Trace:
W20260709 13:18:58.060267 21244 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.455s	user 0.001s	sys 0.000s
I20260709 13:18:58.055763 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:58.064725 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:58.065227 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:58.065356 19140 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:18:58.056259 19219 rpcz_store.cc:276] 0709 13:18:56.141097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.322105 (+181008us) service_pool.cc:224] Handling call
0709 13:18:56.322455 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.247055 (+924600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.055622 (+808567us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b540026a2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:58.055772 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124719872}
I20260709 13:18:58.066113 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:58.068290 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:58.068723 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.066356 21017 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.538s	user 0.039s	sys 0.053s
I20260709 13:18:58.067114 20951 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.067459 21180 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:58.083222 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:58.075333 19066 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:18:58.081943 21088 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.091256 20951 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:58.083294 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:58.095912 19219 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
W20260709 13:18:58.079530 21017 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.586s	user 0.039s	sys 0.053s
I20260709 13:18:58.097569 19747 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:18:58.099836 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:58.104612 19219 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:58.098637 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:58.076036 20924 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:58.107523 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:58.108649 19748 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:18:58.132949 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1168) took 1127 ms. Trace:
I20260709 13:18:58.133358 19748 pending_rounds.cc:85] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 5
I20260709 13:18:58.133639 19748 pending_rounds.cc:107] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:18:58.134020 19748 raft_consensus.cc:2889] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.099606 21212 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:58.097100 21089 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.092427 21151 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:58.133574 19145 rpcz_store.cc:276] 0709 13:18:57.005720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.682912 (+677192us) service_pool.cc:224] Handling call
0709 13:18:57.683246 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.683479 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:57.708054 (+ 24575us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.132523 (+424469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.132590 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.132656 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.132743 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.132886 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13486,"prepare.queue_time_us":26775,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"thread_start_us":410505,"threads_started":1}
I20260709 13:18:58.098879 21180 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:18:58.138626 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:58.098299 21088 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.139957 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:58.783936 19066 raft_consensus.cc:2368] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
W20260709 13:18:58.594616 21173 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.846s	user 0.005s	sys 0.009s
I20260709 13:18:58.222505 21221 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.801167 21223 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:58.826905 21223 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:18:58.827986 21223 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:58.829887 21223 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:58.197736 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.140245 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.557844 21219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.005s	sys 0.019s
I20260709 13:18:58.835479 21221 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.838330 21221 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.133294 21030 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.839771 21030 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.842119 21030 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:18:58.793440 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 575204us
I20260709 13:18:58.133505 21182 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:58.843387 21182 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.177526 21089 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.846577 21089 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.809921 21088 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.795401 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1189) took 1340 ms. Trace:
W20260709 13:18:58.213876 21154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.005s	sys 0.020s
I20260709 13:18:58.815747 20921 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:58.853499 21154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.772s	user 0.024s	sys 0.046s
I20260709 13:18:58.853716 20921 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.856069 20921 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:58.853333 19219 rpcz_store.cc:276] 0709 13:18:57.454849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.136485 (+681636us) service_pool.cc:224] Handling call
0709 13:18:58.794780 (+658295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.795011 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.795047 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.795099 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.795143 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.795208 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.795336 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.869100 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1190) took 1412 ms. Trace:
I20260709 13:18:58.803494 20951 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:58.880342 19219 rpcz_store.cc:276] 0709 13:18:57.456297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.868131 (+1411834us) service_pool.cc:224] Handling call
0709 13:18:58.868495 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.868697 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.868728 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.868780 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.868826 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.868920 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.869040 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.882753 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1191) took 1426 ms. Trace:
I20260709 13:18:58.883215 19219 rpcz_store.cc:276] 0709 13:18:57.456582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.881791 (+1425209us) service_pool.cc:224] Handling call
0709 13:18:58.882172 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.882374 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.882408 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.882459 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.882506 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.882569 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.882693 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.852687 21182 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.926259 21030 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.927081 21030 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.929580 21030 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:58.112896 19743 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:58.949223 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 349) took 1060 ms. Trace:
I20260709 13:18:58.949743 19743 rpcz_store.cc:276] 0709 13:18:57.889183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.891114 (+  1931us) service_pool.cc:224] Handling call
0709 13:18:58.949119 (+1058005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.951241 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:58.198369 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:58.958937 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:58.960665 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:58.245576 19220 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:18:58.999852 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1400) took 1315 ms. Trace:
I20260709 13:18:59.000125 19221 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:59.000371 19220 rpcz_store.cc:276] 0709 13:18:57.684794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.908440 (+223646us) service_pool.cc:224] Handling call
0709 13:18:58.999780 (+1091340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.208076 20836 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:58.962112 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 119019us
I20260709 13:18:59.003472 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:58.140419 21204 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.964597 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:58.974135 19747 raft_consensus.cc:2368] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:18:58.979804 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:58.980949 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1167) took 1975 ms. Trace:
W20260709 13:18:59.028846 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.007s	sys 0.070s
W20260709 13:18:59.029265 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.007s	sys 0.070s
W20260709 13:18:59.029613 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.981051 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1654) took 1080 ms. Trace:
W20260709 13:18:58.985970 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.595038 21226 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:18:58.962618 21089 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:58.198025 20583 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.051462 20583 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:58.198457 21075 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.010020 21221 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.004736 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:18:59.011833 21263 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.806s	user 0.000s	sys 0.000s
I20260709 13:18:59.026494 19142 rpcz_store.cc:276] 0709 13:18:57.005485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.371278 (+365793us) service_pool.cc:224] Handling call
0709 13:18:57.371582 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.597305 (+225723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.597486 (+   181us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.604665 (+  7179us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.134385 (+529720us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:58.134904 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.134998 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.980645 (+845647us) raft_consensus.cc:1685] finished
0709 13:18:58.980675 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.980855 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86725,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10633,"thread_start_us":698522,"threads_started":2,"wal-append.queue_time_us":1048144}
W20260709 13:18:58.577118 21262 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.536s	user 0.000s	sys 0.001s
I20260709 13:18:58.593830 21239 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.037562 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:59.030154 19147 rpcz_store.cc:276] 0709 13:18:57.900368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.945904 (+1045536us) service_pool.cc:224] Handling call
0709 13:18:58.946366 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.946656 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:58.947156 (+   500us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.980389 (+ 33233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.980478 (+    89us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.980581 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.980704 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.980923 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32694,"prepare.queue_time_us":270,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":34663,"spinlock_wait_cycles":34565504,"wal-append.queue_time_us":34722}
I20260709 13:18:58.988763 20454 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:18:59.063035 19140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.006s	sys 0.008s
I20260709 13:18:59.065454 19745 raft_consensus.cc:2368] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6.
I20260709 13:18:59.067766 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1401) took 1335 ms. Trace:
W20260709 13:18:59.080682 19140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.006s	sys 0.008s
I20260709 13:18:59.080852 19218 rpcz_store.cc:276] 0709 13:18:57.732633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.751653 (+ 19020us) service_pool.cc:224] Handling call
0709 13:18:59.067607 (+1315954us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400269dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:59.067711 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73380224}
I20260709 13:18:59.083356 20583 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.083678 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1662) took 1197 ms. Trace:
W20260709 13:18:59.084664 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 80007.6us
I20260709 13:18:59.086830 19110 leader_election.cc:400] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:18:59.087217 19110 leader_election.cc:403] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:59.089530 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.089488 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.090122 19147 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.084012 19066 rpcz_store.cc:276] 0709 13:18:57.886157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.037319 (+1151162us) service_pool.cc:224] Handling call
0709 13:18:59.083619 (+ 46300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.093216 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.093919 19218 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:59.099134 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:59.099839 19747 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEARNER]: Advancing to term 8
I20260709 13:18:59.105978 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:18:59.076154 21081 consensus_meta.cc:287] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.030s	user 0.010s	sys 0.002s
I20260709 13:18:59.106745 19218 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:59.079622 21182 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.038293 21204 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.149071 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.117640 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:59.118062 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1184) took 1830 ms. Trace:
I20260709 13:18:59.082238 21221 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.081409 21190 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:59.165338 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:18:59.166270 19066 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:18:59.168466 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.105464 21089 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:59.069885 21075 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:59.118049 21268 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:18:59.175868 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:18:59.177702 19145 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:59.110327 21210 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.152192 19216 rpcz_store.cc:276] 0709 13:18:57.287587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.633317 (+345730us) service_pool.cc:224] Handling call
0709 13:18:57.633735 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.634116 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.634155 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.654653 (+ 20498us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.029367 (+374714us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.029416 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.029483 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.117785 (+1088302us) raft_consensus.cc:1685] finished
0709 13:18:59.117813 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.117989 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":696,"raft.queue_time_us":50092,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":309754,"threads_started":1,"wal-append.queue_time_us":425472}
I20260709 13:18:59.187355 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.188387 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.184594 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:59.189874 21270 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:18:59.185025 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1395) took 1090 ms. Trace:
I20260709 13:18:59.191205 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 346) took 1361 ms. Trace:
I20260709 13:18:59.191375 19069 rpcz_store.cc:276] 0709 13:18:58.094196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.102394 (+1008198us) service_pool.cc:224] Handling call
0709 13:18:59.184954 (+ 82560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.191624 19744 rpcz_store.cc:276] 0709 13:18:57.829720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.830145 (+   425us) service_pool.cc:224] Handling call
0709 13:18:57.831936 (+  1791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.832324 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.832356 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.832904 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.097987 (+265083us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:58.098773 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.110967 (+ 12194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.190944 (+1079977us) raft_consensus.cc:1685] finished
0709 13:18:59.190978 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.191118 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1174,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":244295,"threads_started":1,"wal-append.queue_time_us":1217017}
I20260709 13:18:59.193567 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 155) took 1923 ms. Trace:
I20260709 13:18:59.193857 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:59.194465 19744 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.184382 21089 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.197173 21089 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.194077 19141 rpcz_store.cc:276] 0709 13:18:57.270417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.894700 (+624283us) service_pool.cc:224] Handling call
0709 13:18:57.910407 (+ 15707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.910741 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.910769 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.911228 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.231408 (+320180us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:58.303049 (+ 71641us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.311169 (+  8120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.311267 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.193332 (+882065us) raft_consensus.cc:1685] finished
0709 13:18:59.193360 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.193502 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":464149,"prepare.queue_time_us":71670,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":38385,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":224733,"thread_start_us":319772,"threads_started":1,"wal-append.queue_time_us":1279775}
I20260709 13:18:59.198596 21075 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.199018 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.083223 21239 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.162871 21182 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.133994 21081 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.202116 21239 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.202540 21081 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.162757 21190 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:59.180915 19218 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:59.215495 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.203763 19216 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:18:59.100684 20454 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.178612 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:59.219535 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.183933 21208 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.209450 19747 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:18:59.237331 19218 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:59.237615 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 399) took 1142 ms. Trace:
I20260709 13:18:59.222558 19147 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:59.238133 19747 rpcz_store.cc:276] 0709 13:18:58.095138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.075283 (+980145us) service_pool.cc:224] Handling call
0709 13:18:59.237540 (+162257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.242786 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:59.243680 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 245) took 1063 ms. Trace:
I20260709 13:18:59.244050 19747 rpcz_store.cc:276] 0709 13:18:58.180378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.242492 (+1062114us) service_pool.cc:224] Handling call
0709 13:18:59.243616 (+  1124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.244915 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1195) took 1671 ms. Trace:
I20260709 13:18:59.245338 19218 rpcz_store.cc:276] 0709 13:18:57.573358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.244011 (+1670653us) service_pool.cc:224] Handling call
0709 13:18:59.244340 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.244549 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.244585 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.244638 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.244685 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.244742 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.244850 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.247519 19747 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:59.248446 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 398) took 1160 ms. Trace:
I20260709 13:18:59.248932 19747 rpcz_store.cc:276] 0709 13:18:58.087790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.244829 (+1157039us) service_pool.cc:224] Handling call
0709 13:18:59.247215 (+  2386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.248104 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.248386 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.202849 21182 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.173087 21221 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.247095 19218 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:59.225198 19746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.023s	sys 0.066s
I20260709 13:18:59.121234 21180 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.282967 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1397) took 1627 ms. Trace:
I20260709 13:18:59.225912 20836 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.289196 19747 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.290570 19216 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:18:59.293198 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.293833 20951 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.237370 21210 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.296312 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1396) took 1724 ms. Trace:
I20260709 13:18:59.281840 19743 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:18:59.396256 19071 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:59.385219 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 343) took 1558 ms. Trace:
I20260709 13:18:59.301018 19216 rpcz_store.cc:276] 0709 13:18:57.571708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.241554 (+1669846us) service_pool.cc:224] Handling call
0709 13:18:59.290371 (+ 48817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.295929 (+  5558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.296238 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.396706 19064 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:59.406807 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1396) took 1311 ms. Trace:
I20260709 13:18:59.379863 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1647) took 1553 ms. Trace:
I20260709 13:18:59.407265 19064 rpcz_store.cc:276] 0709 13:18:58.095454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.396127 (+1300673us) service_pool.cc:224] Handling call
0709 13:18:59.396486 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.406525 (+ 10039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.406740 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.433406 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1393) took 1346 ms. Trace:
W20260709 13:18:59.286450 19138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.001s	sys 0.018s
I20260709 13:18:59.434897 19071 rpcz_store.cc:276] 0709 13:18:58.087117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.395589 (+1308472us) service_pool.cc:224] Handling call
0709 13:18:59.395918 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.406034 (+ 10116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.433338 (+ 27304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.433354 19140 rpcz_store.cc:276] 0709 13:18:57.826605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.066068 (+239463us) service_pool.cc:224] Handling call
0709 13:18:58.077564 (+ 11496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.083232 (+  5668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.083264 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.083682 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.091977 (+1008295us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:59.092037 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.092116 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.379629 (+287513us) raft_consensus.cc:1685] finished
0709 13:18:59.379646 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.379799 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9072,"raft.queue_time_us":4267,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8609,"thread_start_us":974308,"threads_started":1,"wal-append.queue_time_us":1278173}
I20260709 13:18:59.377383 21266 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.436806 19138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.001s	sys 0.018s
I20260709 13:18:59.387681 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 348) took 1525 ms. Trace:
I20260709 13:18:59.398926 21261 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:59.384859 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 244) took 1265 ms. Trace:
I20260709 13:18:59.381561 20454 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.384491 21081 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:59.349897 20951 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.289655 19218 rpcz_store.cc:276] 0709 13:18:57.655175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.246425 (+1591250us) service_pool.cc:224] Handling call
0709 13:18:59.246725 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.282541 (+ 35816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.282887 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.352386 21210 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.444605 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1198) took 1758 ms. Trace:
I20260709 13:18:59.461710 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 336) took 2978 ms. Trace:
I20260709 13:18:59.462919 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1183) took 2176 ms. Trace:
I20260709 13:18:59.466794 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 213) took 2233 ms. Trace:
W20260709 13:18:59.436971 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 345148us
I20260709 13:18:59.501106 19217 rpcz_store.cc:276] 0709 13:18:57.287328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.463366 (+176038us) service_pool.cc:224] Handling call
0709 13:18:57.481322 (+ 17956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.725118 (+243796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.462624 (+1737506us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400100254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:59.462847 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553858432}
I20260709 13:18:59.502096 19213 rpcz_store.cc:276] 0709 13:18:57.233248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.236490 (+  3242us) service_pool.cc:224] Handling call
0709 13:18:57.236853 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.283946 (+ 47093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.283973 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.284010 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:57.284046 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.466506 (+2182460us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b5400160154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:59.466562 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.466699 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107847040}
I20260709 13:18:59.480893 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 154) took 2210 ms. Trace:
I20260709 13:18:59.500192 19749 rpcz_store.cc:276] 0709 13:18:56.482949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.483095 (+   146us) service_pool.cc:224] Handling call
0709 13:18:56.493557 (+ 10462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.102042 (+608485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.461374 (+2359332us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54006801d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:59.461605 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351254912}
I20260709 13:18:59.482949 19071 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.499122 19216 rpcz_store.cc:276] 0709 13:18:57.686299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.436249 (+1749950us) service_pool.cc:224] Handling call
0709 13:18:59.444087 (+  7838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.444270 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.444293 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.444333 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.444365 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.444413 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.444542 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.460529 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:59.468708 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1642) took 2397 ms. Trace:
I20260709 13:18:59.444444 19064 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:59.507690 19064 pending_rounds.cc:85] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 2
I20260709 13:18:59.507069 19214 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.508127 19064 pending_rounds.cc:107] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:59.509661 19064 raft_consensus.cc:2889] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.490068 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1199) took 1780 ms. Trace:
I20260709 13:18:59.510295 19218 rpcz_store.cc:276] 0709 13:18:57.710108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.489370 (+1779262us) service_pool.cc:224] Handling call
0709 13:18:59.489628 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.489780 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.489803 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.489853 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.489885 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.489934 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.490021 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.512007 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1204) took 1586 ms. Trace:
W20260709 13:18:59.480405 19187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.012s	sys 0.012s
I20260709 13:18:59.507093 19139 rpcz_store.cc:276] 0709 13:18:57.071265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.875557 (+804292us) service_pool.cc:224] Handling call
0709 13:18:57.989824 (+114267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.990415 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.468487 (+1478072us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002b7fd0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:59.468646 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260343552}
W20260709 13:18:59.516721 19187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.013s	sys 0.012s
I20260709 13:18:59.505389 19146 rpcz_store.cc:276] 0709 13:18:57.270184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.879711 (+609527us) service_pool.cc:224] Handling call
0709 13:18:57.894414 (+ 14703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.912311 (+ 17897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.912354 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.925215 (+ 12861us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.312111 (+386896us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:58.446914 (+134803us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.805249 (+358335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.805340 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.480643 (+675303us) raft_consensus.cc:1685] finished
0709 13:18:59.480671 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.480823 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17485,"prepare.queue_time_us":134891,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":532694,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":11159,"thread_start_us":375074,"threads_started":1,"wal-append.queue_time_us":1440403}
I20260709 13:18:59.406402 19750 rpcz_store.cc:276] 0709 13:18:57.826852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.831941 (+  5089us) service_pool.cc:224] Handling call
0709 13:18:57.832256 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.832601 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.832629 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.833031 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.205640 (+372609us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.205697 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.205801 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.384990 (+1179189us) raft_consensus.cc:1685] finished
0709 13:18:59.385011 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.385155 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2534,"raft.queue_time_us":1429,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8766,"thread_start_us":372231,"threads_started":1,"wal-append.queue_time_us":1538560}
I20260709 13:18:59.370666 21190 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.530987 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1399) took 1430 ms. Trace:
I20260709 13:18:59.531569 19064 rpcz_store.cc:276] 0709 13:18:58.100783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.437169 (+1336386us) service_pool.cc:224] Handling call
0709 13:18:59.437488 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.530678 (+ 93190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.530919 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.525712 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:59.439002 21266 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.536181 21266 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.512410 19218 rpcz_store.cc:276] 0709 13:18:57.925677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.511156 (+1585479us) service_pool.cc:224] Handling call
0709 13:18:59.511484 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.511692 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.511712 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.511745 (+    33us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.511775 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.511831 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.511943 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.542073 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.542798 19139 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:59.545889 19147 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:59.493489 21271 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:59.550493 19216 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:59.551080 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1403) took 1664 ms. Trace:
I20260709 13:18:59.551700 19110 leader_election.cc:400] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:18:59.554265 21288 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:18:59.554986 21288 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.555866 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:59.551476 19216 rpcz_store.cc:276] 0709 13:18:57.890403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.506615 (+1616212us) service_pool.cc:224] Handling call
0709 13:18:59.528385 (+ 21770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.550860 (+ 22475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.551025 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.559311 21288 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:59.562162 21288 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.560993 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:18:59.563589 19749 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:18:59.563438 21288 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.564767 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:18:59.565507 21288 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:59.566180 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 282521us
I20260709 13:18:59.457374 21112 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.467989 21020 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:59.451713 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1186) took 2162 ms. Trace:
W20260709 13:18:59.575870 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 390997us
I20260709 13:18:59.573042 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.577764 19146 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:59.499404 21261 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.612352 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 217) took 2148 ms. Trace:
I20260709 13:18:59.581770 19218 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:59.572299 21204 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.504552 21081 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.612223 21182 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:18:59.481597 19743 rpcz_store.cc:276] 0709 13:18:58.119976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.061858 (+941882us) service_pool.cc:224] Handling call
0709 13:18:59.384763 (+322905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.572784 21020 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:59.567648 21220 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:59.619580 21285 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:18:59.649464 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.636040 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:59.650444 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.650542 19141 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:59.651289 21182 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.450902 19746 rpcz_store.cc:276] 0709 13:18:57.862012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.862155 (+   143us) service_pool.cc:224] Handling call
0709 13:18:57.871753 (+  9598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.140155 (+268402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.176686 (+ 36531us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.223387 (+ 46701us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.294597 (+1071210us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:59.297496 (+  2899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.340394 (+ 42898us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.387376 (+ 46982us) raft_consensus.cc:1685] finished
0709 13:18:59.387411 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.387605 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22282,"raft.queue_time_us":12885,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5849,"thread_start_us":895718,"threads_started":2,"wal-append.queue_time_us":826172}
I20260709 13:18:59.653373 21286 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.653548 21220 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.653920 21286 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.656275 21220 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:59.657624 19744 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:59.658113 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 243) took 1556 ms. Trace:
I20260709 13:18:59.658540 19744 rpcz_store.cc:276] 0709 13:18:58.101644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.193601 (+1091957us) service_pool.cc:224] Handling call
0709 13:18:59.658051 (+464450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.613762 21292 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:59.646538 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:18:59.658978 21020 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.660265 21020 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.660454 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.661523 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.662039 19216 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:18:59.662774 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:18:59.663196 19742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 235) took 2607 ms (client timeout 2879 ms). Trace:
W20260709 13:18:59.663610 19742 rpcz_store.cc:269] 0709 13:18:57.055419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.063859 (+  8440us) service_pool.cc:224] Handling call
0709 13:18:59.662993 (+2599134us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54000c0dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:59.663119 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710372224}
W20260709 13:18:59.664113 21162 consensus_meta.cc:287] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.636s	user 0.013s	sys 0.000s
I20260709 13:18:59.664860 19213 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:59.665221 19213 pending_rounds.cc:85] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 2
I20260709 13:18:59.665510 19213 pending_rounds.cc:107] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:59.665789 19213 raft_consensus.cc:2889] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.611871 21112 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:18:59.647502 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.678525 21210 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.679018 21112 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:59.633514 21288 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.679523 21112 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:59.679706 21288 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.628269 20454 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:59.681242 20454 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:59.682550 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.682828 21288 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:59.613121 19220 rpcz_store.cc:276] 0709 13:18:57.463720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.027296 (+1563576us) service_pool.cc:224] Handling call
0709 13:18:59.027670 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.027915 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:59.436512 (+408597us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.611826 (+175314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.611894 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:59.611970 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.612075 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.612238 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3847,"prepare.queue_time_us":512465,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"thread_start_us":515809,"threads_started":2}
I20260709 13:18:59.683671 20454 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.658010 20961 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:18:59.687286 20961 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.666041 21217 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.688182 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1162) took 2684 ms. Trace:
I20260709 13:18:59.688403 21217 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.688550 19144 rpcz_store.cc:276] 0709 13:18:57.004158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.006324 (+  2166us) service_pool.cc:224] Handling call
0709 13:18:57.011968 (+  5644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.663881 (+651913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.687943 (+2024062us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b540018a454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:59.688103 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497860480}
I20260709 13:18:59.689431 20961 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.689821 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.691052 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.680383 21112 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:18:59.694558 19742 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEARNER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:59.694736 21112 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:59.695611 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.646863 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.696559 21081 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.697126 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:59.698997 19035 connection.cc:256] RPC call timeout handler was delayed by -1.2904782610000893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:18:59.699816 19035 connection.cc:256] RPC call timeout handler was delayed by -1.2184782609999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:18:59.639127 19214 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:18:59.701316 21083 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.667815 20951 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:59.674379 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1646) took 1848 ms. Trace:
I20260709 13:18:59.702507 19138 rpcz_store.cc:276] 0709 13:18:57.826340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.062279 (+235939us) service_pool.cc:224] Handling call
0709 13:18:58.062604 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.099298 (+ 36694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.100699 (+  1401us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.217123 (+116424us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.452196 (+1235073us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:59.452286 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.452403 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.674151 (+221748us) raft_consensus.cc:1685] finished
0709 13:18:59.674182 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.674320 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":583,"raft.queue_time_us":2929,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4133,"thread_start_us":777782,"threads_started":1,"wal-append.queue_time_us":1020116}
I20260709 13:18:59.704366 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.674721 21089 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.675428 21285 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.706739 21089 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.707253 21285 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:18:59.573922 19212 rpcz_store.cc:276] 0709 13:18:57.288955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.045483 (+756528us) service_pool.cc:224] Handling call
0709 13:18:58.045797 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.046014 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:58.059255 (+ 13241us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.349818 (+1290563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.365380 (+ 15562us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.435001 (+ 69621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.445760 (+ 10759us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.448438 (+  2678us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7902,"prepare.run_cpu_time_us":347,"prepare.run_wall_time_us":5370,"raft.queue_time_us":632733,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":851424,"threads_started":2,"wal-append.queue_time_us":1232683}
I20260709 13:18:59.677434 21221 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.678314 21261 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.678975 19218 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:59.699218 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1187) took 2410 ms. Trace:
I20260709 13:18:59.709120 19221 rpcz_store.cc:276] 0709 13:18:57.289216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.097211 (+807995us) service_pool.cc:224] Handling call
0709 13:18:58.999810 (+902599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.000723 (+   913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.699040 (+698317us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540032dcd0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:59.699159 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052442496}
I20260709 13:18:59.656306 21286 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:18:59.715060 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 131767us
W20260709 13:18:59.715907 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.692498 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.717924 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.718597 19144 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 2.
I20260709 13:18:59.718986 19113 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:59.668869 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.720896 19141 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:59.721411 19146 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:18:59.729283 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:18:59.732479 19035 connection.cc:256] RPC call timeout handler was delayed by -1.0681782609999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:18:59.733263 19035 connection.cc:256] RPC call timeout handler was delayed by -1.0163334500000474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 13:18:59.734123 21081 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.734683 21081 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.736066 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1193) took 2278 ms. Trace:
I20260709 13:18:59.736449 19219 rpcz_store.cc:276] 0709 13:18:57.457145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.885651 (+1428506us) service_pool.cc:224] Handling call
0709 13:18:58.885975 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.886199 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:59.320774 (+434575us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.735746 (+414972us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.735798 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.735848 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.735909 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.736013 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13459,"prepare.queue_time_us":666766,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":804255,"threads_started":2,"wal-append.queue_time_us":370642}
I20260709 13:18:59.737851 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:18:59.737895 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:59.590677 19139 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:59.765933 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.766927 19144 raft_consensus.cc:2410] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:59.768229 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.769567 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.769747 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.770206 19139 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:59.770833 19144 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:18:59.774549 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.699829 21208 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:18:59.787616 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:59.791414 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53649.8us
I20260709 13:18:59.653362 21182 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.774037 21285 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.791822 19035 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:59.795320 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1391) took 1708 ms. Trace:
I20260709 13:18:59.797323 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:18:59.793339 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 141579us
I20260709 13:18:59.795909 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.768079 21261 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.801551 19141 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:18:59.802099 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:59.805821 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.806900 19717 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:59.776186 21250 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.801397 20936 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.797081 21020 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.813585 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1649) took 2868 ms. Trace:
I20260709 13:18:59.813964 19063 rpcz_store.cc:276] 0709 13:18:56.944742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.977506 (+ 32764us) service_pool.cc:224] Handling call
0709 13:18:57.002577 (+ 25071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.293194 (+290617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.813338 (+2520144us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54001b9754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:18:59.813501 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666605312}
I20260709 13:18:59.784896 21202 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:59.785110 21288 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.816538 19140 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:18:59.817435 21210 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:59.817912 20680 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:59.818478 21261 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.785471 20839 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.819772 19113 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:18:59.896034 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 76331us
I20260709 13:18:59.896787 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:59.897773 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:59.898403 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:18:59.819120 19745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 350) took 1924 ms (client timeout 1668 ms). Trace:
I20260709 13:18:59.824076 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:18:59.900242 19144 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:59.824291 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:18:59.826217 19714 connection.cc:256] RPC call timeout handler was delayed by -1.0676281530002143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:18:59.903906 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 79668.7us
I20260709 13:18:59.819507 21091 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:59.910717 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:18:59.911454 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:18:59.908280 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:59.826637 21081 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:18:59.833087 21210 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.923327 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.904152 21250 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:59.905335 21208 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:59.928711 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:18:59.929286 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.929718 19141 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:18:59.831210 21020 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.090s
W20260709 13:18:59.922575 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 125332us
I20260709 13:18:59.904947 20680 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:18:59.905555 21182 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:59.927448 19219 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:59.912144 21292 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.928650 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.925182 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.912703 21157 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.918619 21232 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:59.808296 21285 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:18:59.899070 19745 rpcz_store.cc:269] 0709 13:18:57.895191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.896755 (+  1564us) service_pool.cc:224] Handling call
0709 13:18:59.818898 (+1922143us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540049f054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:18:59.819037 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2539700608}
I20260709 13:18:59.830291 21202 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.832720 21288 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:18:59.920784 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:18:59.918445 21266 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:18:59.833316 21112 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 13:18:59.922106 20839 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.932571 21091 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:18:59.982988 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 179168us
I20260709 13:18:59.932086 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:18:59.921974 20454 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:59.986665 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 59932.5us
I20260709 13:19:00.112838 19714 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:00.035851 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.076548 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:00.116688 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:18:59.919867 21204 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:59.923848 21210 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.074287 21157 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.020007 20961 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:00.257405 20961 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:00.257562 21157 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:00.069845 20680 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:00.083570 19184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.005s	sys 0.023s
W20260709 13:19:00.276912 19184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.459s	user 0.005s	sys 0.023s
I20260709 13:19:00.056361 21306 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:00.066962 21182 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.318887 21182 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.281085 21272 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.320633 21272 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:00.320760 19112 connection.cc:256] RPC call timeout handler was delayed by -1.7850596929999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:19:00.321048 21272 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.043321 21180 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:19:00.071897 21083 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:00.036022 21297 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:00.064088 21232 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.088135 21261 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:00.071828 21017 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.093748 21307 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:19:00.096959 21230 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 2.741s	user 0.003s	sys 0.014s
I20260709 13:19:00.096971 21312 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:19:00.099635 21285 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:18:59.928288 21250 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:18:59.932200 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:00.064160 21081 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:59.929219 21208 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.992070 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:00.179677 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.105134 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 241) took 2027 ms. Trace:
I20260709 13:19:00.366453 19216 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.253916 21282 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:00.255501 21217 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.000s
W20260709 13:19:00.267530 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 154771us
I20260709 13:19:00.373345 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:00.317641 21314 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:00.277248 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 1.46033e+06us
W20260709 13:19:00.278874 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 243113us
I20260709 13:19:00.387490 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.391139 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.364713 21250 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.084769 19139 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:00.077615 21291 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.237s
I20260709 13:19:00.311224 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:00.369912 21208 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.084085 20936 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.312573 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:00.317061 21221 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.069743 21091 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.307431 21207 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:00.317621 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:00.308782 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1652) took 3077 ms. Trace:
I20260709 13:19:00.307710 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1205) took 2366 ms. Trace:
I20260709 13:19:00.415069 19213 rpcz_store.cc:276] 0709 13:18:57.941089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.537581 (+1596492us) service_pool.cc:224] Handling call
0709 13:18:59.537866 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.697119 (+159253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.307372 (+610253us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001ea0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:00.307631 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291343616}
I20260709 13:19:00.322916 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:00.416504 19146 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.316685 21288 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:00.326395 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 306075us
I20260709 13:19:00.403330 21266 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:19:00.253372 21204 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.367473 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:00.366786 19748 rpcz_store.cc:276] 0709 13:18:58.078155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.078267 (+   112us) service_pool.cc:224] Handling call
0709 13:18:58.092225 (+ 13958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.138644 (+ 46419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.104850 (+1966206us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5400624154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:00.105067 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36835584}
I20260709 13:19:00.413431 19068 rpcz_store.cc:276] 0709 13:18:57.231289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.231450 (+   161us) service_pool.cc:224] Handling call
0709 13:18:57.231903 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.485303 (+253400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.526580 (+ 41277us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.528841 (+  2261us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.717463 (+188622us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:57.717504 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.308311 (+2590807us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540024b654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:00.308376 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.308446 (+    70us) raft_consensus.cc:1685] finished
0709 13:19:00.308456 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.308726 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7422,"raft.queue_time_us":15069,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6227,"spinlock_wait_cycles":381363072,"thread_start_us":135788,"threads_started":1,"wal-append.queue_time_us":186144,"wal-append.run_cpu_time_us":33847,"wal-append.run_wall_time_us":1027012}
I20260709 13:19:00.421451 19141 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:00.326396 21232 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.084410 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1651) took 2184 ms. Trace:
I20260709 13:19:00.324728 21083 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:00.393859 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:00.306015 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1381) took 3019 ms. Trace:
I20260709 13:19:00.399924 21285 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:00.401386 21292 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.404791 19221 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:00.258250 20961 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.406558 19216 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:00.450736 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:00.452263 19216 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:00.369582 21282 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.407819 19219 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:19:00.363370 21017 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.386253 21309 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.382057 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:00.387082 21314 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.358937 20454 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:00.404182 21112 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.386576 21217 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.422362 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1655) took 2521 ms. Trace:
I20260709 13:19:00.428648 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1383) took 3470 ms. Trace:
I20260709 13:19:00.424901 19145 rpcz_store.cc:276] 0709 13:18:57.899529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.969966 (+1070437us) service_pool.cc:224] Handling call
0709 13:18:58.970366 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.183965 (+213599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.084155 (+900190us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54002d8554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:00.084351 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476128000}
I20260709 13:19:00.323583 21306 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.437443 19067 rpcz_store.cc:276] 0709 13:18:57.286918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.287210 (+   292us) service_pool.cc:224] Handling call
0709 13:18:57.287509 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.681576 (+394067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.305602 (+2624026us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540025d854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:00.305926 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904344832}
W20260709 13:19:00.437316 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43670.3us
I20260709 13:19:00.452737 19216 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:00.466555 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.454330 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:00.467998 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.456259 19221 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:00.424433 21204 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.460673 19146 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:00.463950 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:00.447989 21288 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.463198 19142 rpcz_store.cc:276] 0709 13:18:57.900644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.080162 (+1179518us) service_pool.cc:224] Handling call
0709 13:18:59.098429 (+ 18267us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.498363 (+399934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.498393 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:59.511806 (+ 13413us) log.cc:844] Serialized 52 byte log entry
0709 13:18:59.794630 (+282824us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:00.064933 (+270303us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.383506 (+318573us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.383695 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.387328 (+  3633us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.420675 (+ 33347us) raft_consensus.cc:1685] finished
0709 13:19:00.420699 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.422295 (+  1596us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297997,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":213405,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":16611,"spinlock_wait_cycles":20187392,"thread_start_us":1156918,"threads_started":4,"wal-append.queue_time_us":370548}
I20260709 13:19:00.419122 21207 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.437500 21083 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.477427 21202 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:00.479187 21306 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:00.479571 21261 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.479450 21056 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:00.467202 19216 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:00.489583 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.480552 19146 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:00.489890 19216 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.471175 19145 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:00.471918 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.483418 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:00.484627 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 366734us
I20260709 13:19:00.463366 19215 rpcz_store.cc:276] 0709 13:18:56.958230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.046572 (+ 88342us) service_pool.cc:224] Handling call
0709 13:18:57.055324 (+  8752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.060296 (+  4972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.060339 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.070849 (+ 10510us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.188093 (+117244us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.188142 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.189018 (+   876us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.096416 (+2907398us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:00.413332 (+316916us) raft_consensus.cc:1685] finished
0709 13:19:00.413357 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.428585 (+ 15228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12641,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9824,"spinlock_wait_cycles":4422912,"thread_start_us":82361,"threads_started":1,"wal-append.queue_time_us":162560}
I20260709 13:19:00.456736 21282 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.497588 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:00.501786 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:00.470204 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:00.461714 21314 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.534363 21083 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.532776 19216 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 13:19:00.533829 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 61989.9us
I20260709 13:19:00.566679 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.482832 21288 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.487838 21290 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.482391 20454 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.554185 19742 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 7. Ops: []
I20260709 13:19:00.568019 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.569084 19216 pending_rounds.cc:85] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 5
I20260709 13:19:00.556917 21285 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.556340 19143 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:18:59.796941 19069 rpcz_store.cc:276] 0709 13:18:58.086564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.192227 (+1105663us) service_pool.cc:224] Handling call
0709 13:18:59.192542 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.192720 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:59.582691 (+389971us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.795014 (+212323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.795058 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:59.795093 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.795161 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.795262 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":306439,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":12640,"raft.queue_time_us":773,"thread_start_us":569119,"threads_started":2}
I20260709 13:19:00.575733 19216 pending_rounds.cc:107] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:19:00.565471 21261 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.579733 19216 raft_consensus.cc:2889] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:00.577088 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.570192 21288 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.578109 21285 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:00.570422 21290 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:00.580502 21202 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.588744 21285 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.605916 21290 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:00.633965 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.587466 21261 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.639286 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:00.639662 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1193) took 1089 ms. Trace:
I20260709 13:19:00.640025 19139 rpcz_store.cc:276] 0709 13:18:59.550247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.793052 (+242805us) service_pool.cc:224] Handling call
0709 13:19:00.084343 (+291291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.403020 (+318677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.639484 (+236464us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54002d8550. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:00.639610 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669178112}
I20260709 13:19:00.641966 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 220) took 2928 ms. Trace:
I20260709 13:19:00.642392 19217 rpcz_store.cc:276] 0709 13:18:57.714067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.504948 (+1790881us) service_pool.cc:224] Handling call
0709 13:18:59.537178 (+ 32230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.633326 (+ 96148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.633370 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.633434 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:59.633483 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.641712 (+1008229us) spinlock_profiling.cc:243] Waited 95.9 ms on lock 0x7b540034d354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:00.641760 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.641914 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220580096}
I20260709 13:19:00.630502 21202 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.647900 21297 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.611753 21182 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:00.670401 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 221554us
W20260709 13:19:00.675371 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 173669us
I20260709 13:19:00.641825 20680 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:19:00.681288 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:00.649922 21309 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:00.673846 21297 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.672745 21320 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:00.675173 21180 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.679441 21170 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.680789 21207 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:00.690338 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 113334us
I20260709 13:19:00.688277 21297 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.713934 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:00.714551 19217 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:00.688753 21320 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:00.702678 21180 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.720186 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:00.706552 21170 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:00.723670 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47469.9us
I20260709 13:19:00.687456 21208 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.728904 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:00.718356 21322 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:19:00.723814 21180 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.728109 21170 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.738365 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.746047 21324 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:00.736781 21329 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:19:00.755194 21333 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:19:00.733151 21338 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.737694 20454 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:00.747112 21312 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.767098 21062 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:00.769253 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.754019 21272 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.809940 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:00.810446 21272 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:00.810672 19215 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.760476 21204 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.776921 21261 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:00.819073 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 103641us
I20260709 13:19:00.773749 21323 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.820088 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:00.773645 21312 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:00.779537 21062 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:00.843259 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:00.843947 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:00.854259 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:00.866269 21308 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.906s	user 0.004s	sys 0.000s
W20260709 13:19:00.867625 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.813148 21335 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:19:00.869683 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1183) took 1331 ms. Trace:
I20260709 13:19:00.870075 19140 rpcz_store.cc:276] 0709 13:18:59.538323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.545078 (+  6755us) service_pool.cc:224] Handling call
0709 13:19:00.869520 (+1324442us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54000ff0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:00.869625 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478341888}
I20260709 13:19:00.872587 21342 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:00.873135 21342 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:00.873791 21321 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:19:00.874014 21330 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:19:00.875649 21342 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:00.770153 21338 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.763952 21232 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.821280 21323 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.808221 21182 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:00.902140 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:00.780544 21250 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.844020 21312 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:00.906749 21328 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:19:00.928442 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 85241.8us
I20260709 13:19:00.933357 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:00.934461 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 80287.4us
W20260709 13:19:00.928092 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 108113us
W20260709 13:19:00.935398 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56929.9us
I20260709 13:19:00.935640 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:00.911933 21323 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.944447 19215 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:00.946828 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:00.920051 21322 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.947919 19139 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:00.924224 21304 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.936793 21261 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.955312 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:00.937819 21266 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.930657 21202 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:19:00.927184 21346 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:00.932150 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:00.944666 21335 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:00.966447 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet b07ef65c060943509b105c2f74e22ff5: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }.
  Pending config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:00.944553 20680 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:00.970189 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.968500 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.932950 21180 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.952140 21304 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.967772 19138 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:00.974849 19067 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:00.970821 19070 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:00.972965 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.957001 21232 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:00.951676 21272 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:00.957615 21347 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.986832 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.971132 21325 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:00.951920 21182 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:19:00.981657 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.967283 21335 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:00.997280 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.997952 19069 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:01.000916 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 61907.1us
I20260709 13:19:00.990191 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.986198 21304 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.004097 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.004588 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:00.975363 21342 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:19:01.008503 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 72680.6us
I20260709 13:19:00.969277 19743 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
W20260709 13:19:01.013774 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.002951 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:00.987725 21157 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:01.019999 19067 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:00.968555 21266 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.947193 21320 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.027256 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.019125 21325 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:01.025079 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 407) took 1202 ms. Trace:
I20260709 13:19:00.974494 20680 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:00.982044 21340 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:01.028050 19067 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:19:01.031474 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 68925.3us
I20260709 13:19:01.038172 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:01.021090 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:01.037262 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:01.038762 19218 raft_consensus.cc:2376] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4. Re-sending same reply.
I20260709 13:19:01.039776 19184 leader_election.cc:400] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6.
I20260709 13:19:01.040191 19184 leader_election.cc:403] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:01.040488 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:01.044866 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:01.046114 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.038772 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:01.048357 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:01.054059 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107718us
I20260709 13:19:01.054852 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.048484 21180 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.049376 21250 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.049688 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.050130 21320 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.049400 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.051335 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.052372 19144 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:01.072351 19215 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:01.041231 19221 raft_consensus.cc:2376] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4. Re-sending same reply.
W20260709 13:19:01.055725 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 153704us
I20260709 13:19:01.056985 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.073721 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.029098 21325 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.023221 21157 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.023667 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.025410 21232 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.018956 21261 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:01.019410 21342 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:01.060148 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:01.088086 21343 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:19:01.103791 19145 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:01.068594 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:01.069730 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:01.045601 19139 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:01.089288 21180 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:01.073931 19140 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:00.971261 21062 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.077147 21355 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.079015 21362 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6.
I20260709 13:19:01.074383 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.028730 19743 rpcz_store.cc:276] 0709 13:18:59.823132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.825069 (+  1937us) service_pool.cc:224] Handling call
0709 13:19:00.920532 (+1095463us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:01.025018 (+104486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14885632}
I20260709 13:19:01.066999 21324 consensus_queue.cc:1243] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:01.081007 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.081809 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:01.132144 19217 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:01.090230 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:01.056566 21346 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:19:01.052814 21089 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:01.084846 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.104660 21340 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.067540 21322 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.102255 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.092103 21157 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.107409 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.098693 21351 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:19:01.151963 19139 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:01.075449 21335 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.104709 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.105156 19067 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:01.111063 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.113497 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.155499 19145 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:01.100550 21232 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:01.179823 21217 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.179713 21232 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.182756 21342 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.184345 21342 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.187928 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.189093 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:01.190073 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.106864 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:01.037716 21204 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.100127 19215 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:01.129516 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:01.104496 21261 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.072947 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:01.209836 19214 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:01.124720 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.159492 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.210974 19070 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:01.159955 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.133117 21180 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:01.169528 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 56073us
I20260709 13:19:01.151386 21083 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.145323 21089 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.223208 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.173787 21192 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.175107 20680 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.177105 19745 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:01.178179 21266 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.178853 21335 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.195961 19067 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:01.260424 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.261444 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.261969 19067 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:01.262712 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:01.262992 21346 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.263459 21346 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.265857 21346 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.143932 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:01.211404 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:01.215072 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 85642.7us
I20260709 13:19:01.227098 21360 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.219054 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:01.283087 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 64117.6us
I20260709 13:19:01.284153 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.228839 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.127110 21355 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.180869 21232 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.138834 21326 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:19:01.145591 21338 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.202257 21182 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:01.209085 21088 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.224613 19143 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:01.241117 21190 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:01.251813 21285 consensus_meta.cc:287] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
I20260709 13:19:01.254905 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.255914 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 405) took 1433 ms. Trace:
I20260709 13:19:01.318277 19742 rpcz_store.cc:276] 0709 13:18:59.822149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.824969 (+  2820us) service_pool.cc:224] Handling call
0709 13:18:59.923284 (+ 98315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.575074 (+651790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.255682 (+680608us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54005b4ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:01.255856 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318724480}
I20260709 13:19:01.257748 21089 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:01.214952 21207 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:19:01.259248 21210 consensus_meta.cc:287] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.005s	user 0.007s	sys 0.004s
I20260709 13:19:01.319729 21207 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:01.319844 21210 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.320645 21207 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.322474 21210 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.323235 19063 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:01.263731 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.324205 19067 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:01.128500 19065 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:01.265622 21180 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.180639 21217 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:01.219545 21250 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:01.216840 21324 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:01.271502 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.273763 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 199473us
I20260709 13:19:01.278498 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.217748 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:01.338958 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 121310us
I20260709 13:19:01.339257 19714 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.339658 19110 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.238874 21362 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.239768 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:01.292127 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:01.283833 21282 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.743s	user 0.003s	sys 0.006s
I20260709 13:19:01.221907 21204 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:19:01.266798 20680 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.301085 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.297111 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.193392 21322 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:01.289129 21170 consensus_meta.cc:287] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.002s
I20260709 13:19:01.229091 21083 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.277181 21354 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:01.315667 21349 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.317863 21261 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.287312 19746 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.285526 21360 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:01.285758 21309 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:01.298621 21297 consensus_meta.cc:287] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.004s
W20260709 13:19:01.331982 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7623503810000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:19:01.301400 21317 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:01.333485 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.302562 21351 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:01.341629 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 63221.1us
I20260709 13:19:01.342468 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:01.344331 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52295.8us
I20260709 13:19:01.440176 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.345752 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:01.339715 21288 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.728s	user 0.005s	sys 0.005s
W20260709 13:19:01.367214 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 175988us
I20260709 13:19:01.442857 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:01.379189 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:01.343058 21314 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.776s	user 0.004s	sys 0.006s
W20260709 13:19:01.341956 21333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.009s	sys 0.020s
I20260709 13:19:01.426573 21354 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:01.346450 21290 consensus_meta.cc:287] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.002s
I20260709 13:19:01.337947 21324 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:01.306210 21312 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.341766 21089 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.329025 21285 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.343765 21182 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:01.346668 21352 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.347262 21210 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.467371 21354 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:01.381400 21091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.006s	sys 0.039s
W20260709 13:19:01.467913 21091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.007s	sys 0.039s
I20260709 13:19:01.468328 21355 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.469823 19066 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:01.344074 21367 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:01.453996 21229 raft_consensus.cc:2764] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:01.458511 21324 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.331771 21217 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:01.444021 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:01.448239 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.474635 19071 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:01.445246 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:01.449062 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 108229us
I20260709 13:19:01.334990 21250 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:01.385121 20680 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.451222 19035 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:01.453027 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56569.5us
I20260709 13:19:01.468415 21157 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.400679 21170 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.536798 19745 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:19:01.538084 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:01.538311 21170 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.377472 21282 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.538729 19214 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:19:01.538707 21157 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.540387 21282 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.373925 21362 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:19:01.455960 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 110259us
I20260709 13:19:01.542491 21362 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:01.451140 21333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.009s	sys 0.021s
I20260709 13:19:01.444705 21056 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.459580 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:01.544582 19215 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.544191 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:01.547087 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:01.463210 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.464362 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.445811 21317 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:01.548827 21381 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:01.549286 21381 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.549612 21381 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.549642 21317 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.454046 21191 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.466826 21322 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:01.552325 21191 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:01.552762 21191 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.431524 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.553967 19072 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:01.554935 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.555640 19072 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 2.
I20260709 13:19:01.438822 21309 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.427215 21349 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.558403 21309 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.473380 19068 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:01.438285 19067 raft_consensus.cc:2410] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:19:01.469038 21360 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.558986 21349 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:01.470780 21239 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.559475 21360 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:01.559845 21378 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:01.476328 19221 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:01.474539 21304 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.457986 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:01.561789 21304 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.483913 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.559693 21239 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:01.562767 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 79032.2us
I20260709 13:19:01.563305 21089 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.563462 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.458060 21290 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.564430 19216 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:01.560672 19065 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.565412 21204 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.565709 19110 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:01.565888 21204 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:01.566329 21204 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.566780 21315 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:01.567046 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.567353 21315 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:01.567771 21266 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.445554 21288 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.569057 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:01.569618 19069 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.570365 21288 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.494119 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.571110 19144 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:19:01.571982 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.453821 20839 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:19:01.574360 20839 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:01.574710 20839 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:19:01.496335 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 45177.3us
I20260709 13:19:01.424172 20961 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:01.565421 21290 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.568181 21315 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.471092 20836 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:01.532588 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49466.2us
I20260709 13:19:01.533865 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.595140 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.496080 21182 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.496188 21250 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.497323 19146 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:01.535640 20680 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:01.496345 21372 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:01.535809 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:01.544414 21056 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:01.593437 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.437533 21297 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.449673 21314 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.556720 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:01.617087 19072 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:01.490288 19184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.552s (SENT) [suppressed 10 similar messages]
I20260709 13:19:01.575058 20839 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.585717 21266 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.586086 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:01.590638 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:01.624609 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.591567 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:01.557561 21381 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.491384 21217 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.609112 19215 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:01.610077 19069 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:01.609789 21372 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.617848 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:01.603539 21182 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:01.630939 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.559662 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.636027 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:01.616231 21056 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.638456 19064 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:01.620680 20680 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:01.640079 19144 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:01.640892 19213 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:01.642379 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 64933.6us
I20260709 13:19:01.658229 19214 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:01.637984 19138 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:01.640218 21083 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:01.627250 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:01.630015 20961 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.633246 21201 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.636061 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:01.697264 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:01.643466 21379 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:01.639909 21372 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.641494 21182 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.635277 21320 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:19:01.766377 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.608254 21369 consensus_queue.cc:1059] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
W20260709 13:19:01.802043 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 171190us
I20260709 13:19:01.758975 20680 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:01.759264 21266 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:01.813504 21381 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:01.812718 19246 heartbeater.cc:646] Failed to heartbeat to 127.17.139.62:35345 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.139.62:35345 timed out after 15.000s (SENT)
I20260709 13:19:01.818109 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:01.821391 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:01.839119 19072 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:01.794509 21285 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:01.804229 21317 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.850574 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:01.879895 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.824798 21312 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:01.850880 21375 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 13:19:01.873466 21386 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:19:01.876057 21323 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.923s	user 0.008s	sys 0.000s
W20260709 13:19:01.872303 21232 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.000s
W20260709 13:19:01.872303 21335 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.612s	user 0.003s	sys 0.003s
W20260709 13:19:02.033093 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 542788us
W20260709 13:19:02.160753 19113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.000s
I20260709 13:19:02.307760 19145 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
W20260709 13:19:02.308663 19113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.012s	sys 0.002s
I20260709 13:19:01.893146 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.860577 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:02.306582 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.859851 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:02.309098 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1672) took 1202 ms. Trace:
W20260709 13:19:02.324281 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 688259us
W20260709 13:19:01.993140 19746 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.005s
I20260709 13:19:02.332904 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:02.088776 19065 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.002s
I20260709 13:19:02.335175 19745 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:02.337066 19063 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:02.310472 21180 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.308123 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:02.317800 21315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.014s	sys 0.022s
W20260709 13:19:02.358779 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 50702.9us
I20260709 13:19:02.307029 19214 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.351289 19067 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:19:02.239048 21020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.013s	sys 0.044s
I20260709 13:19:02.371665 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:02.372583 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1423) took 1281 ms. Trace:
I20260709 13:19:02.316527 19141 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:02.373142 19067 rpcz_store.cc:276] 0709 13:19:01.091387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.361865 (+1270478us) service_pool.cc:224] Handling call
0709 13:19:02.372510 (+ 10645us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:02.292308 19213 consensus_meta.cc:287] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.630s	user 0.005s	sys 0.002s
I20260709 13:19:02.354487 21083 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:02.334290 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 474511us
I20260709 13:19:01.956372 20839 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.917656 21389 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:01.996562 21390 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:19:01.952497 21190 consensus_meta.cc:287] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.623s	user 0.002s	sys 0.006s
W20260709 13:19:02.269104 21217 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.628s	user 0.005s	sys 0.005s
W20260709 13:19:02.266934 21324 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.000s
W20260709 13:19:02.274777 20836 consensus_meta.cc:287] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.002s
W20260709 13:19:02.309744 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 714619us
I20260709 13:19:02.320935 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:01.982499 21360 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:01.981417 21314 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.357399 19146 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:02.427341 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.952778 21297 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:02.284055 21364 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.008s
I20260709 13:19:02.074926 21290 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:02.353462 19143 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.437994 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.341675 21232 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.374488 19213 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:19:02.444092 21232 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.444707 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.445395 19213 raft_consensus.cc:2368] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6.
I20260709 13:19:02.445266 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.446018 19212 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:02.425603 20836 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:02.334065 19145 rpcz_store.cc:276] 0709 13:19:01.106300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.156271 (+ 49971us) service_pool.cc:224] Handling call
0709 13:19:01.821184 (+664913us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:02.309041 (+487857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86873984}
I20260709 13:19:02.446041 21232 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.447288 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.447645 19145 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:02.340468 21335 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:01.975262 21204 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.395393 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.452510 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1671) took 1337 ms. Trace:
I20260709 13:19:02.453019 19067 rpcz_store.cc:276] 0709 13:19:01.115374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.374119 (+1258745us) service_pool.cc:224] Handling call
0709 13:19:02.452415 (+ 78296us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:02.371521 21020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.019s	sys 0.046s
W20260709 13:19:02.375175 19036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.008s	sys 0.006s
W20260709 13:19:02.455411 19036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.009s	sys 0.006s
W20260709 13:19:02.359668 21315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.018s	sys 0.022s
I20260709 13:19:02.353160 19746 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:02.316642 21266 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.469018 21266 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.469664 21335 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:02.471033 21335 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:01.960891 21056 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.340036 21203 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.409983 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:01.870847 21191 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.315125 21323 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.374006 21081 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:02.491343 21191 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:02.358336 19065 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:02.492441 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 163) took 1433 ms. Trace:
I20260709 13:19:02.421666 19214 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:19:02.426749 19147 raft_consensus.cc:2410] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:02.432753 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.505437 19065 rpcz_store.cc:276] 0709 13:19:01.058803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.433226 (+374423us) service_pool.cc:224] Handling call
0709 13:19:02.492325 (+1059099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.506069 21318 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.506436 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1686) took 1019 ms. Trace:
I20260709 13:19:02.506712 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.506572 21318 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.506830 19072 rpcz_store.cc:276] 0709 13:19:01.486857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.423865 (+937008us) service_pool.cc:224] Handling call
0709 13:19:02.506378 (+ 82513us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:02.430364 21364 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.009s	sys 0.008s
I20260709 13:19:02.508153 19072 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:02.508720 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1418) took 1482 ms. Trace:
I20260709 13:19:02.427160 21083 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:02.429508 21285 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.509256 19065 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:02.513474 21239 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.516225 19138 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.457930 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.517724 19067 raft_consensus.cc:2410] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:19:02.518687 19064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1413) took 1514 ms (client timeout 1537 ms). Trace:
I20260709 13:19:02.509531 21083 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.519520 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 160) took 1480 ms. Trace:
I20260709 13:19:02.509033 19072 rpcz_store.cc:276] 0709 13:19:01.026808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.507631 (+1480823us) service_pool.cc:224] Handling call
0709 13:19:02.507956 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.508496 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.508670 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.521782 21083 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:02.522689 19072 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:19:02.466545 19746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 410) took 1364 ms (client timeout 1521 ms). Trace:
W20260709 13:19:02.523871 19746 rpcz_store.cc:269] 0709 13:19:01.101863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.103030 (+  1167us) service_pool.cc:224] Handling call
0709 13:19:02.466452 (+1363422us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:02.491547 21392 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:19:02.438107 21394 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.525660 21394 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.479624 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.531363 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.424274 21324 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.529944 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 162) took 1490 ms. Trace:
I20260709 13:19:02.412628 20680 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.557921 19070 raft_consensus.cc:3055] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:02.558261 19070 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:02.558995 19070 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:02.451704 21223 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.560714 21223 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.562703 21223 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.426230 21217 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.565155 19742 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:02.429111 21360 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.566977 20936 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:02.567209 21360 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:02.567353 20936 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:02.423457 21389 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:02.490850 21384 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:02.568243 20936 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.491047 21323 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.491454 21081 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:02.374017 21382 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.013s	sys 0.024s
I20260709 13:19:02.353703 21212 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:19:02.499316 21056 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.499359 21398 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:19:02.500375 20839 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:02.501027 21232 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:02.484479 21203 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.502338 21204 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:02.504063 21250 consensus_meta.cc:287] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.000s
W20260709 13:19:02.484982 21357 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 1.300s	user 0.008s	sys 0.010s
I20260709 13:19:02.441344 21290 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.510025 21285 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:02.534502 21324 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:02.482457 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 72555.8us
I20260709 13:19:02.535605 21017 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.536896 21320 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.519251 19064 rpcz_store.cc:269] 0709 13:19:01.004170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.004309 (+   139us) service_pool.cc:224] Handling call
0709 13:19:02.518424 (+1514115us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54001a8e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:02.518612 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426152320}
I20260709 13:19:02.550285 21345 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:02.528656 21394 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:02.553125 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1685) took 1068 ms. Trace:
I20260709 13:19:02.532823 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.557303 19067 rpcz_store.cc:276] 0709 13:19:01.039251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.518481 (+1479230us) service_pool.cc:224] Handling call
0709 13:19:02.518863 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.519085 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.519125 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:02.519186 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:02.519243 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.519320 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.519453 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.458678 19141 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:02.569612 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1230) took 1122 ms. Trace:
I20260709 13:19:02.564661 21217 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.570080 19072 rpcz_store.cc:276] 0709 13:19:01.039732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.521868 (+1482136us) service_pool.cc:224] Handling call
0709 13:19:02.522270 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.529257 (+  6987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.529782 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.576089 19145 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:19:02.569232 20936 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:02.574741 21382 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.013s	sys 0.025s
I20260709 13:19:02.583415 21367 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.579535 21232 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:02.583918 21081 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:02.597095 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 245345us
W20260709 13:19:02.599069 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 223922us
I20260709 13:19:02.606123 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:02.608808 19218 rpcz_store.cc:276] 0709 13:19:01.447691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.452252 (+  4561us) service_pool.cc:224] Handling call
0709 13:19:01.452688 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:01.456793 (+  4105us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:01.469057 (+ 12264us) log.cc:844] Serialized 14 byte log entry
0709 13:19:01.636753 (+167696us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:01.637249 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:19:01.637384 (+   135us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:01.637414 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.637479 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.569409 (+931930us) raft_consensus.cc:1685] finished
0709 13:19:02.569430 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.569556 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12598,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3573,"raft.queue_time_us":4081,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":5524,"thread_start_us":167198,"threads_started":1,"wal-append.queue_time_us":866885}
I20260709 13:19:02.614995 19064 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.598600 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:02.585181 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:02.612438 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.620805 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.616247 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:02.590242 21389 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.617939 19750 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEARNER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:02.618189 21315 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:19:02.622618 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:02.622875 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:02.657791 19747 raft_consensus.cc:2368] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4.
I20260709 13:19:02.614009 21083 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:02.623459 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:02.623620 21056 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.615787 21232 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.613078 21017 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.608009 21191 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.623744 21372 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.624573 19143 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:02.586745 21182 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:02.625345 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1187) took 3085 ms (client timeout 1839 ms). Trace:
I20260709 13:19:02.627766 21290 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:02.613492 21345 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.634735 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:02.636941 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.637096 19212 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:02.637953 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:02.638607 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:02.639431 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.640530 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:02.644317 19064 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:02.648130 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:02.615612 21324 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:02.623641 21332 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:02.653985 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:02.585469 21250 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.655598 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.598354 21285 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.628955 21081 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.608158 21320 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.606537 21204 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:19:02.663264 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:02.786772 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.730644 21208 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:02.787074 19147 rpcz_store.cc:269] 0709 13:18:59.539547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.695406 (+155859us) service_pool.cc:224] Handling call
0709 13:19:02.625115 (+2929709us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b540010ed54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:02.625249 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6279073664}
I20260709 13:19:02.758811 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:02.763818 21359 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:02.789279 21282 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:02.789901 21282 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:02.790140 19749 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:02.726274 19213 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.790828 21282 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.792093 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.792361 21250 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.792951 19213 raft_consensus.cc:2393] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:02.793794 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.793418 21056 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.794116 19038 leader_election.cc:400] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6.
I20260709 13:19:02.794480 19213 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:02.794608 19038 leader_election.cc:403] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:02.795060 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.795209 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.795526 21350 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.796183 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.753839 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 175) took 1173 ms. Trace:
I20260709 13:19:02.796818 21324 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.797339 19063 rpcz_store.cc:276] 0709 13:19:01.580433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.852203 (+271770us) service_pool.cc:224] Handling call
0709 13:19:02.753631 (+901428us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b540024b654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:02.753768 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13959040}
I20260709 13:19:02.798384 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:02.798960 21324 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:02.729177 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.799930 19220 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.618793 21367 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.801844 21367 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.803574 21285 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:02.719022 21400 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:02.805158 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 164691us
I20260709 13:19:02.805984 21220 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:02.806463 21220 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:02.807271 21220 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:02.723826 21210 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.810611 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.811290 19212 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:02.812240 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.788632 21332 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:02.813319 21332 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.764814 21201 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:02.817369 19064 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.663597 19072 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:02.817979 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 166) took 1712 ms. Trace:
I20260709 13:19:02.818528 19064 rpcz_store.cc:276] 0709 13:19:01.105410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.816952 (+1711542us) service_pool.cc:224] Handling call
0709 13:19:02.817218 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.817730 (+   512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.817928 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.819442 19072 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.819592 19064 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.820289 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1673) took 1704 ms. Trace:
I20260709 13:19:02.611928 19065 rpcz_store.cc:276] 0709 13:19:01.485211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.506438 (+1021227us) service_pool.cc:224] Handling call
0709 13:19:02.553057 (+ 46619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.686662 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:02.639503 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:02.826289 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 191610us
I20260709 13:19:02.788206 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.799418 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:02.884507 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.842922 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:02.886133 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:02.841166 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.910528 19145 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:02.910809 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.820783 19072 rpcz_store.cc:276] 0709 13:19:01.115921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.818865 (+1702944us) service_pool.cc:224] Handling call
0709 13:19:02.819216 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.820015 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.820226 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.820266 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1675) took 1703 ms. Trace:
W20260709 13:19:02.911372 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.909277 19217 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:19:02.911580 19064 rpcz_store.cc:276] 0709 13:19:01.116491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.819228 (+1702737us) service_pool.cc:224] Handling call
0709 13:19:02.819458 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.820070 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.820221 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.796188 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.912918 19213 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:02.838397 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 214988us
I20260709 13:19:02.837677 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.882903 19215 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:02.915848 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:02.916401 19063 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:02.916775 19038 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:02.849890 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 227320us
I20260709 13:19:02.790158 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:02.909744 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 66918.2us
I20260709 13:19:02.846583 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:02.788475 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:02.856621 19747 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:19:02.920492 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.786830 19146 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:02.868067 19220 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:02.944954 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:02.946657 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.950244 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.951107 19214 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:19:02.947294 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 100844us
I20260709 13:19:02.952503 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:02.953550 21266 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:02.954020 21266 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.954425 21266 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.960592 19219 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:02.855692 19745 raft_consensus.cc:2410] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:19:02.948812 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.961896 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:02.963562 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.885175 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:02.812980 19212 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:03.538765 19217 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:03.068397 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:03.295768 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 345393us
I20260709 13:19:02.990341 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:02.865927 21315 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.291575 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:03.226804 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.294303 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 377058us
I20260709 13:19:02.891672 21320 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.142093 19213 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:02.891752 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 172) took 1006 ms. Trace:
I20260709 13:19:03.630312 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.964599 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.631801 19147 raft_consensus.cc:2410] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:03.632396 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1218) took 1275 ms. Trace:
I20260709 13:19:03.632833 19147 rpcz_store.cc:276] 0709 13:19:02.356553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.964299 (+607746us) service_pool.cc:224] Handling call
0709 13:19:03.632312 (+668013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.634052 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:03.634747 19147 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.634833 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:03.294056 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 341661us
I20260709 13:19:02.831907 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 167) took 1709 ms. Trace:
I20260709 13:19:03.636224 19065 rpcz_store.cc:276] 0709 13:19:01.123747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.821574 (+1697827us) service_pool.cc:224] Handling call
0709 13:19:02.821995 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.831447 (+  9452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.831492 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:02.831553 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:02.831601 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.831687 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.831835 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.637822 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:02.835542 21208 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.639796 21208 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.642052 21208 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.914992 20680 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:03.643144 20680 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.643633 20680 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.645319 19147 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:02.730280 21203 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.648345 21203 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:03.648833 21203 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:03.648490 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:03.649348 21203 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.650403 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:02.890093 21182 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:02.828960 21201 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.653311 19219 raft_consensus.cc:2368] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4.
I20260709 13:19:02.919927 21324 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:03.291621 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:03.617795 19747 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:03.068826 19067 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:03.618191 19035 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:03.618935 19072 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:03.621507 21420 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.346232 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 355) took 1829 ms. Trace:
W20260709 13:19:03.626539 21400 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.000s
W20260709 13:19:03.622823 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.700034 21083 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.676982 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:02.789304 21359 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.677982 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:03.545662 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:02.892539 21339 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:02.875602 21285 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:03.542128 19145 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.645790 20680 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.646201 19065 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:03.684728 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 168) took 2538 ms. Trace:
I20260709 13:19:03.685138 19065 rpcz_store.cc:276] 0709 13:19:01.146616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.638891 (+2492275us) service_pool.cc:224] Handling call
0709 13:19:03.639167 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.684405 (+ 45238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.684658 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.846194 21350 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6.
W20260709 13:19:03.324091 21232 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.002s
I20260709 13:19:02.882577 21372 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.654282 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:03.655406 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:02.946241 21291 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.015895 21250 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:19:03.701189 19748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 353) took 2620 ms (client timeout 1790 ms). Trace:
W20260709 13:19:03.701979 19748 rpcz_store.cc:269] 0709 13:19:01.081126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.081339 (+   213us) service_pool.cc:224] Handling call
0709 13:19:03.545498 (+2464159us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:03.701115 (+155617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10135424}
I20260709 13:19:03.657416 21207 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:03.703377 21207 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.703662 21250 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:03.476673 21056 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.704486 21201 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.704723 21250 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:03.709096 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 90973.8us
I20260709 13:19:02.828799 21332 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.709510 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.709800 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:03.710572 19147 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:02.841899 21020 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.789s
W20260709 13:19:03.676440 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.967133 21202 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:19:03.701296 21081 consensus_meta.cc:287] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.888s	user 0.010s	sys 0.000s
I20260709 13:19:03.681357 21290 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:03.683229 21339 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:03.484799 21345 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:03.519922 21408 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.947059 21204 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.919428 21335 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.677587 19217 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.678797 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:03.729327 19212 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:03.729568 21345 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.729674 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:03.730093 21345 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.730238 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:03.730930 19212 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.681391 19214 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:03.627182 21282 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:02.961095 21191 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:02.948123 21017 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.653620 21315 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:03.630664 19143 rpcz_store.cc:276] 0709 13:19:01.859451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.860229 (+   778us) service_pool.cc:224] Handling call
0709 13:19:02.865463 (+1005234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.622232 21416 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:03.703758 21207 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.675873 19744 rpcz_store.cc:276] 0709 13:19:01.497167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.533598 (+ 36431us) service_pool.cc:224] Handling call
0709 13:19:01.533923 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.561096 (+ 27173us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:01.634255 (+ 73159us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.224018 (+1589763us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b1800362b00. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:19:03.224215 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.224276 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:03.224320 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.225179 (+   859us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b5400572454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:03.225222 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.326262 (+101040us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":227259,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":51,"raft.queue_time_us":11346,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":28242,"spinlock_wait_cycles":108778496,"thread_start_us":295787,"threads_started":2,"wal-append.queue_time_us":219034,"wal-append.run_cpu_time_us":13858,"wal-append.run_wall_time_us":1564416}
I20260709 13:19:02.882262 20454 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.745s
I20260709 13:19:03.742025 20454 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:03.742357 20454 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:03.743106 20454 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.744180 20454 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.745298 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.747110 21017 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.701700 21232 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.711587 19145 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
W20260709 13:19:03.715072 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.749699 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.328833 21367 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.300s
I20260709 13:19:03.750620 21232 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.680369 21400 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.714390 21202 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.716192 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:03.751569 21400 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.751870 19147 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.752707 21202 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.722471 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:03.753122 21416 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.753717 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1438) took 1016 ms. Trace:
I20260709 13:19:03.754069 19220 rpcz_store.cc:276] 0709 13:19:02.737586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.711075 (+973489us) service_pool.cc:224] Handling call
0709 13:19:03.753661 (+ 42586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.755234 21416 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.755349 19220 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:03.755952 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1436) took 1030 ms. Trace:
I20260709 13:19:03.756269 19220 rpcz_store.cc:276] 0709 13:19:02.725517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.754769 (+1029252us) service_pool.cc:224] Handling call
0709 13:19:03.755086 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.755733 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.755906 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.714718 21352 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.756809 21315 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.757755 21182 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.758489 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1227) took 1139 ms. Trace:
I20260709 13:19:03.758909 19145 rpcz_store.cc:276] 0709 13:19:02.618937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.963082 (+344145us) service_pool.cc:224] Handling call
0709 13:19:03.758432 (+795350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.759855 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.762195 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.762791 19145 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:03.764961 19217 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:03.731166 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:03.717834 21324 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:03.769460 21324 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.769868 21324 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.737082 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:03.774238 19214 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:03.721444 21364 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.056s
W20260709 13:19:03.777000 21364 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.005s	sys 0.056s
I20260709 13:19:03.738664 21282 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.467593 21266 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.699150 21285 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.677503 21420 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:03.740178 21358 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 2.579s	user 0.015s	sys 0.027s
I20260709 13:19:03.710937 21291 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.748795 21191 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.725697 21290 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:03.723057 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.790241 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 108351us
I20260709 13:19:03.752800 21320 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.778111 19147 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
W20260709 13:19:03.781594 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50468.7us
I20260709 13:19:03.798583 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.799875 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:03.782624 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:03.744753 19138 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.918s	user 0.006s	sys 0.002s
I20260709 13:19:03.790588 19035 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:03.736505 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 101756us
I20260709 13:19:03.812741 19113 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:03.802096 21291 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.732627 21408 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.803499 21266 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.804008 19064 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:03.826198 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 170) took 2621 ms. Trace:
I20260709 13:19:03.826678 19064 rpcz_store.cc:276] 0709 13:19:01.205039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.803424 (+2598385us) service_pool.cc:224] Handling call
0709 13:19:03.803708 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.825883 (+ 22175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.826130 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.786123 19143 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:03.804849 21282 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.727152 21335 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.811741 19035 leader_election.cc:400] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4.
I20260709 13:19:03.821471 19145 raft_consensus.cc:2410] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:03.836503 19035 leader_election.cc:403] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:19:03.822063 19147 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:03.828691 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1680) took 2681 ms. Trace:
W20260709 13:19:03.814118 21337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.009s	sys 0.018s
I20260709 13:19:03.833293 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.839115 19139 raft_consensus.cc:2368] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6.
I20260709 13:19:03.823585 21056 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:03.824646 20454 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:03.820557 19138 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:03.826357 21232 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:03.806474 21320 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:03.791235 21339 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.837709 19065 rpcz_store.cc:276] 0709 13:19:01.147611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.686162 (+2538551us) service_pool.cc:224] Handling call
0709 13:19:03.686514 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.686760 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:03.736605 (+ 49845us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.828280 (+ 91675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.828359 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:03.828419 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.828498 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.828625 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":112357,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1934,"raft.run_wall_time_us":3693,"thread_start_us":127452,"threads_started":2}
I20260709 13:19:03.940461 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1444) took 1201 ms. Trace:
W20260709 13:19:03.944059 19141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 170) took 2095 ms (client timeout 1851 ms). Trace:
I20260709 13:19:03.945698 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1688) took 2371 ms. Trace:
W20260709 13:19:03.988665 19141 rpcz_store.cc:269] 0709 13:19:01.848449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.848606 (+   157us) service_pool.cc:224] Handling call
0709 13:19:03.943863 (+2095257us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b5400221d54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:03.943994 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21142912}
I20260709 13:19:03.910040 19147 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:03.990806 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1207) took 1653 ms. Trace:
I20260709 13:19:03.991516 19147 rpcz_store.cc:276] 0709 13:19:02.337927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.873510 (+1535583us) service_pool.cc:224] Handling call
0709 13:19:03.909768 (+ 36258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.990479 (+ 80711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.990733 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.927968 19070 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:03.928508 19071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1409) took 2952 ms (client timeout 2604 ms). Trace:
I20260709 13:19:03.839926 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.950289 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.949585 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 242) took 1314 ms. Trace:
I20260709 13:19:03.989603 19214 rpcz_store.cc:276] 0709 13:19:02.739277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.774850 (+1035573us) service_pool.cc:224] Handling call
0709 13:19:03.775125 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.775328 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:03.791738 (+ 16410us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.940035 (+148297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.940100 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:03.940163 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.940246 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.940395 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":82321,"prepare.run_wall_time_us":15988,"raft.queue_time_us":393,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2266,"thread_start_us":163522,"threads_started":2}
I20260709 13:19:03.989702 19063 rpcz_store.cc:276] 0709 13:19:01.574393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.944972 (+2370579us) service_pool.cc:224] Handling call
0709 13:19:03.945261 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.945425 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.945448 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.945485 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:03.945519 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.945566 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.945650 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.996297 19218 rpcz_store.cc:276] 0709 13:19:02.635438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.637414 (+  1976us) service_pool.cc:224] Handling call
0709 13:19:03.948786 (+1311372us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465eee 0000000000375939 00007f61084d91e0 00007f61085a20c4 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:03.948991 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.949200 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.949237 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.949289 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:03.949335 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.949401 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.949523 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5731584}
I20260709 13:19:03.997821 19063 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:03.998385 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 174) took 2418 ms. Trace:
I20260709 13:19:03.998863 19145 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:03.998711 19063 rpcz_store.cc:276] 0709 13:19:01.580088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.997247 (+2417159us) service_pool.cc:224] Handling call
0709 13:19:03.997527 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.998161 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.998338 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:03.994994 19071 rpcz_store.cc:269] 0709 13:19:00.976095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.976255 (+   160us) service_pool.cc:224] Handling call
0709 13:19:03.911483 (+2935228us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400036454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:03.928383 (+ 16900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060764928}
I20260709 13:19:03.844977 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:03.989295 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1427) took 2412 ms. Trace:
I20260709 13:19:03.839843 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.001185 19139 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:04.000692 19065 rpcz_store.cc:276] 0709 13:19:01.576576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.988394 (+2411818us) service_pool.cc:224] Handling call
0709 13:19:03.988767 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.988999 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.989024 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.989059 (+    35us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:03.989086 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.989136 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.989239 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.828719 21423 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:03.934463 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:04.007201 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.008690 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.025010 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.025645 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:03.838589 21335 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.030834 19147 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:19:04.029673 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 239) took 2434 ms. Trace:
I20260709 13:19:04.065821 19145 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:04.024650 19218 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:19:04.025931 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 181066us
I20260709 13:19:03.902886 21420 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.858275 21345 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:03.943087 21359 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:03.908109 21207 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:03.873574 21337 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.024160 21418 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.069445 19215 rpcz_store.cc:276] 0709 13:19:01.595597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.634285 (+ 38688us) service_pool.cc:224] Handling call
0709 13:19:01.634625 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.916439 (+1281814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.029425 (+1112986us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000758d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:04.029618 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870119680}
I20260709 13:19:04.424357 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:04.159544 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.857441 21315 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.030984 21201 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.109884 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1208) took 1771 ms. Trace:
I20260709 13:19:04.023564 21083 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:04.431990 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1390) took 6337 ms. Trace:
I20260709 13:19:04.483347 19066 rpcz_store.cc:276] 0709 13:18:58.086261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.167254 (+1080993us) service_pool.cc:224] Handling call
0709 13:18:59.167573 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.470202 (+2302629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.423671 (+2953469us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b5400036954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:04.423858 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5293901184}
I20260709 13:19:04.484833 19145 rpcz_store.cc:276] 0709 13:19:02.338216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.108966 (+1770750us) service_pool.cc:224] Handling call
0709 13:19:04.109321 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.109519 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.109549 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.109597 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.109632 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.109694 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.109809 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:03.932188 21408 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:03.927538 21282 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.426975 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.124392 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1443) took 1385 ms. Trace:
I20260709 13:19:04.427956 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.428093 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1241) took 1596 ms. Trace:
I20260709 13:19:04.429419 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1440) took 1691 ms. Trace:
I20260709 13:19:04.429746 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:04.428645 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 494216us
W20260709 13:19:04.427745 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.471308 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.067667 21371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.399s	user 0.028s	sys 0.033s
I20260709 13:19:04.029351 21191 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:04.023928 21417 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:04.601655 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:04.031909 21339 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.933459 19212 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:04.023658 21369 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:04.038719 21332 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:04.002529 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1228) took 1383 ms. Trace:
I20260709 13:19:04.614398 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1679) took 3125 ms. Trace:
I20260709 13:19:04.630383 19144 rpcz_store.cc:276] 0709 13:19:01.488830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.572753 (+ 83923us) service_pool.cc:224] Handling call
0709 13:19:01.575736 (+  2983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.662179 (+ 86443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.614145 (+2951966us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b54000febd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:04.614340 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145185536}
I20260709 13:19:04.608917 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.425631 21056 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.839715 21203 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:04.023617 21232 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:04.607849 21371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.970s	user 0.044s	sys 0.034s
I20260709 13:19:04.620781 19215 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:04.626251 19214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.046s	sys 0.065s
W20260709 13:19:04.650894 19214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.046s	sys 0.065s
I20260709 13:19:04.651028 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1242) took 1819 ms. Trace:
I20260709 13:19:04.628898 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1434) took 1900 ms. Trace:
I20260709 13:19:04.662976 19212 rpcz_store.cc:276] 0709 13:19:02.724968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.729962 (+1004994us) service_pool.cc:224] Handling call
0709 13:19:04.625571 (+895609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.664716 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:04.665333 19750 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:04.665925 21318 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:04.628850 19218 rpcz_store.cc:276] 0709 13:19:02.831328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.023488 (+1192160us) service_pool.cc:224] Handling call
0709 13:19:04.024227 (+   739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.427825 (+403598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.428034 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.666945 19218 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:04.667508 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1249) took 1758 ms. Trace:
I20260709 13:19:04.667871 19218 rpcz_store.cc:276] 0709 13:19:02.909014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.666515 (+1757501us) service_pool.cc:224] Handling call
0709 13:19:04.666754 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.667289 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.667446 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.633162 19220 rpcz_store.cc:276] 0709 13:19:02.738145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.761651 (+1023506us) service_pool.cc:224] Handling call
0709 13:19:03.782761 (+ 21110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.787572 (+  4811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.787615 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.788146 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.014011 (+225865us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:04.014067 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.014171 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.429170 (+414999us) raft_consensus.cc:1685] finished
0709 13:19:04.429195 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.429351 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":11709,"thread_start_us":185395,"threads_started":1,"wal-append.queue_time_us":282138}
I20260709 13:19:04.116039 21335 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:04.630256 19138 rpcz_store.cc:276] 0709 13:19:02.619241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.639213 (+ 19972us) service_pool.cc:224] Handling call
0709 13:19:03.996007 (+1356794us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.669971 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 247) took 1376 ms. Trace:
I20260709 13:19:04.670080 19138 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:04.670639 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1210) took 2331 ms. Trace:
I20260709 13:19:04.670922 21335 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:04.671108 19138 rpcz_store.cc:276] 0709 13:19:02.352687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.669672 (+2316985us) service_pool.cc:224] Handling call
0709 13:19:04.669926 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.670434 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.670591 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.670315 19220 rpcz_store.cc:276] 0709 13:19:03.293544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.669252 (+1375708us) service_pool.cc:224] Handling call
0709 13:19:04.669530 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.669690 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.669712 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.669749 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:04.669789 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.669837 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.669925 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.666139 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:04.635046 19217 rpcz_store.cc:276] 0709 13:19:02.738951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.765827 (+1026876us) service_pool.cc:224] Handling call
0709 13:19:03.774421 (+  8594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.775837 (+  1416us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:03.901037 (+125200us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.122204 (+221167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.122265 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.122328 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.124154 (+  1826us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.124319 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":291566,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":14364,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":313114,"threads_started":2}
I20260709 13:19:04.637027 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:04.673873 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:04.674064 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1251) took 1764 ms. Trace:
W20260709 13:19:04.632570 21204 consensus_meta.cc:287] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.900s	user 0.006s	sys 0.003s
I20260709 13:19:04.137207 21360 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:04.090715 21089 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.090976 21416 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.638202 21315 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:04.640379 19069 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:19:04.642030 19143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1690) took 1232 ms (client timeout 1628 ms). Trace:
I20260709 13:19:04.643914 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1225) took 3589 ms. Trace:
W20260709 13:19:04.684002 19143 rpcz_store.cc:269] 0709 13:19:03.409448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.745062 (+335614us) service_pool.cc:224] Handling call
0709 13:19:04.641850 (+896788us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b54002a7e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:04.641970 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73723264}
I20260709 13:19:04.684098 19221 rpcz_store.cc:276] 0709 13:19:01.054044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.073029 (+ 18985us) service_pool.cc:224] Handling call
0709 13:19:01.073281 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.560304 (+487023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.643670 (+3083366us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540014b4d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:04.643857 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926355200}
I20260709 13:19:04.611524 21282 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:04.648818 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1244) took 1816 ms. Trace:
I20260709 13:19:04.688678 19213 rpcz_store.cc:276] 0709 13:19:02.832176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.648007 (+1815831us) service_pool.cc:224] Handling call
0709 13:19:04.648319 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.648511 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.648541 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.648584 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.648612 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.648659 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.648752 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.651364 19215 rpcz_store.cc:276] 0709 13:19:02.831622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.602053 (+1770431us) service_pool.cc:224] Handling call
0709 13:19:04.620545 (+ 18492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.650797 (+ 30252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.650977 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.658798 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:04.659271 21207 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:04.659535 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:04.660665 19746 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:19:04.662153 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:04.671505 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:04.682942 21204 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:04.680408 21360 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:04.672775 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1211) took 2319 ms. Trace:
I20260709 13:19:04.675674 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:04.637723 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.105674 21426 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:19:04.106767 21290 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:04.372061 20936 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.679307 19144 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:19:04.421032 21364 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.408205 21285 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:04.676690 19145 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:04.682819 19141 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:04.090241 21423 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:04.683471 21345 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:19:04.686627 19139 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:04.615754 21191 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:04.691365 19217 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:04.680786 21398 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.685250 21089 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:04.674383 19218 rpcz_store.cc:276] 0709 13:19:02.912232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.668548 (+1756316us) service_pool.cc:224] Handling call
0709 13:19:04.668792 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.673745 (+  4953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.673802 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.673840 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.673876 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.673930 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.674020 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.631963 21369 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:04.492544 21418 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:01.612270 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:04.702160 19070 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.001s
I20260709 13:19:04.792179 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:04.749593 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1248) took 1840 ms. Trace:
I20260709 13:19:04.701844 21367 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:04.827672 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 400590us
I20260709 13:19:04.763506 21332 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.690605 21320 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:04.940716 19070 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:04.941211 21335 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:04.941294 20936 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:04.941114 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 149049us
I20260709 13:19:04.947666 21335 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:04.943879 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.015s
W20260709 13:19:04.967321 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.006s	sys 0.016s
I20260709 13:19:04.948627 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1420) took 3890 ms. Trace:
I20260709 13:19:04.941699 21367 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.957438 21336 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:19:04.958662 21232 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:04.959244 21315 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:04.942520 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1209) took 2604 ms. Trace:
I20260709 13:19:05.029381 19145 rpcz_store.cc:276] 0709 13:19:02.338487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.655600 (+2317113us) service_pool.cc:224] Handling call
0709 13:19:04.676472 (+ 20872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.942298 (+265826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.942464 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.031005 21089 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.033140 20936 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:05.035758 19110 leader_election.cc:336] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.537s (SENT)
I20260709 13:19:04.944739 21320 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.943835 21332 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.037643 21320 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.039564 21332 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.040150 21320 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.040262 21367 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.048965 21359 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.049657 21359 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:05.051034 19142 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:04.965373 19146 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
W20260709 13:19:04.942657 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.944793 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 269167us
I20260709 13:19:05.053413 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:04.966135 21324 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.191s	user 0.011s	sys 0.000s
I20260709 13:19:04.941744 21398 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:04.942782 19138 rpcz_store.cc:276] 0709 13:19:02.353046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.672034 (+2318988us) service_pool.cc:224] Handling call
0709 13:19:04.672326 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.672478 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.672523 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.672560 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.672591 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.672639 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.672723 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.942726 21364 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:04.943135 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1212) took 2589 ms. Trace:
I20260709 13:19:05.058257 19144 rpcz_store.cc:276] 0709 13:19:02.353341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.674699 (+2321358us) service_pool.cc:224] Handling call
0709 13:19:04.679008 (+  4309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.942893 (+263885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.943081 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:04.974500 21418 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:04.941649 21360 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:04.977547 19068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1404) took 4008 ms (client timeout 1702 ms). Trace:
W20260709 13:19:05.060810 19068 rpcz_store.cc:269] 0709 13:19:00.969348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.969464 (+   116us) service_pool.cc:224] Handling call
0709 13:19:04.977361 (+4007897us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54003093d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:04.977474 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064468864}
I20260709 13:19:04.979130 21272 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.980054 19140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1668) took 3903 ms (client timeout 1974 ms). Trace:
W20260709 13:19:05.062355 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.028s	sys 0.057s
I20260709 13:19:04.993340 21282 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:04.994447 21335 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:04.997577 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.941777 19212 rpcz_store.cc:276] 0709 13:19:02.908735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.663761 (+1755026us) service_pool.cc:224] Handling call
0709 13:19:04.664108 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.688450 (+ 24342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.691436 (+  2986us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.694239 (+  2803us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.700885 (+  6646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.709084 (+  8199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.744332 (+ 35248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:05.005285 19067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1429) took 2412 ms (client timeout 1871 ms). Trace:
W20260709 13:19:05.064914 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 366775us
W20260709 13:19:05.065083 19067 rpcz_store.cc:269] 0709 13:19:02.592600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.789866 (+197266us) service_pool.cc:224] Handling call
0709 13:19:05.005045 (+2215179us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400057b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.005190 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345355008}
I20260709 13:19:05.066286 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.008589 21389 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:04.945014 21285 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.070312 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:05.010085 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.070773 19138 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:05.072710 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1216) took 2717 ms. Trace:
I20260709 13:19:05.073104 19138 rpcz_store.cc:276] 0709 13:19:02.355940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.055837 (+2699897us) service_pool.cc:224] Handling call
0709 13:19:05.070606 (+ 14769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.072425 (+  1819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.072644 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.011876 21088 raft_consensus.cc:3055] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:19:05.012358 21337 consensus_meta.cc:287] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.006s
I20260709 13:19:04.969813 19070 rpcz_store.cc:276] 0709 13:19:01.058170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.557504 (+1499334us) service_pool.cc:224] Handling call
0709 13:19:02.557793 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.911033 (+1353240us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b58004c2bd0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61034e60aa 00007f6103568447 00007f6103580fe7 00007f61035827de 00007f610358cb49 00007f610358d416 00007f6103589d8f 00007f610358983e 00007f610854e419 00007f6101ac5bd4
0709 13:19:04.948228 (+1037195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.948555 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211569024}
I20260709 13:19:05.031098 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1215) took 2676 ms. Trace:
I20260709 13:19:04.963671 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:05.051234 21349 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.054824 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.057312 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:05.062817 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.028s	sys 0.057s
I20260709 13:19:05.057986 21398 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.064303 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:05.062671 19140 rpcz_store.cc:269] 0709 13:19:01.076491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.109966 (+ 33475us) service_pool.cc:224] Handling call
0709 13:19:04.979859 (+3869893us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540010de54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:04.979988 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521325312}
I20260709 13:19:05.060459 21332 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.092093 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.096602 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:05.099354 19071 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.056372 21317 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.067644 20839 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.096406 19063 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:05.058068 21232 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:05.078523 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:05.058182 21201 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.091547 21089 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.063807 20936 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.101393 19140 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:05.107192 19113 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:05.097747 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:05.108614 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1222) took 2685 ms. Trace:
I20260709 13:19:05.108841 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:05.109164 19140 rpcz_store.cc:276] 0709 13:19:02.423425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.100966 (+2677541us) service_pool.cc:224] Handling call
0709 13:19:05.101235 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.108314 (+  7079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.108542 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.110570 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:05.091732 21360 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.113796 19113 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:05.112118 19184 leader_election.cc:400] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6.
I20260709 13:19:05.114483 19184 leader_election.cc:403] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.067485 21329 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.068646 21389 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:05.113291 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:05.092810 21420 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.077109 21088 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:05.114579 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1224) took 4077 ms. Trace:
I20260709 13:19:05.125134 19216 rpcz_store.cc:276] 0709 13:19:01.053687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.058074 (+  4387us) service_pool.cc:224] Handling call
0709 13:19:01.058370 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.564770 (+506400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.114378 (+3549608us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540024c554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:05.114529 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163345792}
I20260709 13:19:05.114914 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:05.115569 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.127302 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:05.112538 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 148939us
I20260709 13:19:05.113047 21318 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:05.095213 21444 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:05.117170 21204 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:05.121143 21285 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:05.056080 21324 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.120939 21201 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.095975 21337 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4.
I20260709 13:19:05.101023 21290 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:05.110426 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.101176 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.104279 21282 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:05.156014 21282 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.156510 21282 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.158829 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.106101 21317 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.159688 19069 raft_consensus.cc:2410] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:19:05.160516 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.209417 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:05.210762 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.130715 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:05.131271 19714 connection.cc:256] RPC call timeout handler was delayed by -1.4691187789999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:19:05.211675 19714 connection.cc:256] RPC call timeout handler was delayed by -1.4691187789999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 13:19:05.211859 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.070382 21355 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:05.116308 21232 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.070541 21272 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.215261 21272 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.216567 21317 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:05.218573 19139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1699) took 1282 ms (client timeout 1641 ms). Trace:
W20260709 13:19:05.219115 19139 rpcz_store.cc:269] 0709 13:19:03.936207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.008451 (+ 72244us) service_pool.cc:224] Handling call
0709 13:19:05.218348 (+1209897us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400327654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.218499 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428520192}
I20260709 13:19:05.223716 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1224) took 2795 ms. Trace:
I20260709 13:19:05.225061 21389 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.225492 21203 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.129294 21329 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:05.226416 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.228014 21329 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.229733 21417 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:05.230140 21417 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:05.230491 21417 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.230968 21389 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.233178 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:05.234148 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.234867 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.235603 19219 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:05.235816 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.236442 19220 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:05.236639 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.237823 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:05.238654 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:05.239336 19215 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.234719 21355 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:05.241174 21355 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:05.241294 19213 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 13:19:05.241989 21355 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.242404 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.243124 21355 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.243836 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.244227 19139 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:05.244504 19063 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:19:05.139144 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:05.310503 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 171431us
I20260709 13:19:05.145881 19140 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:05.312855 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1226) took 2695 ms. Trace:
I20260709 13:19:05.313207 19140 rpcz_store.cc:276] 0709 13:19:02.617607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.123519 (+2505912us) service_pool.cc:224] Handling call
0709 13:19:05.145567 (+ 22048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.312623 (+167056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.312803 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.314441 19140 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:19:05.314970 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1687) took 1987 ms. Trace:
I20260709 13:19:05.315250 19140 rpcz_store.cc:276] 0709 13:19:03.327340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.313930 (+1986590us) service_pool.cc:224] Handling call
0709 13:19:05.314239 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.314760 (+   521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.314916 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.124341 21408 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:05.316527 21408 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:05.145357 21416 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6.
I20260709 13:19:05.133999 21437 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.161684 21204 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:05.161115 19071 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:05.318828 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.319124 19140 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:05.163487 21369 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.145404 21440 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.172472 21423 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.173285 21088 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.361621 21088 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.361689 21352 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:05.362462 21352 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.150743 21290 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.365224 21317 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.365450 21290 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.365935 21317 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.147665 21207 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:05.369639 21329 consensus_queue.cc:1059] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:05.184026 19068 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:05.186224 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:05.370937 21336 raft_consensus.cc:3055] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:05.368611 21317 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:05.188112 19146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1681) took 2268 ms (client timeout 2195 ms). Trace:
I20260709 13:19:05.371378 21336 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:05.371789 19146 rpcz_store.cc:269] 0709 13:19:02.919451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.927550 (+  8099us) service_pool.cc:224] Handling call
0709 13:19:05.187937 (+2260387us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002a7954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.188042 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3079643392}
I20260709 13:19:05.372610 21336 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.373237 19146 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.095455 21345 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:05.373859 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1232) took 1661 ms. Trace:
I20260709 13:19:05.373816 21345 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.374280 19146 rpcz_store.cc:276] 0709 13:19:03.712719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.372722 (+1660003us) service_pool.cc:224] Handling call
0709 13:19:05.373074 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.373625 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.373810 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.375555 19146 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:05.375933 21345 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.376099 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1233) took 1658 ms. Trace:
I20260709 13:19:05.189061 19067 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:05.376502 19221 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.377535 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:05.378578 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:05.379220 19067 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:05.379861 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.380381 19067 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:05.097910 21349 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.191110 21339 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.381748 21339 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.382997 21349 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.145450 21081 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:19:05.383623 19069 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:05.383558 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:05.384276 21081 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:05.384449 19068 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.384717 21081 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:05.134045 21420 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.192332 19745 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:05.192935 21364 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.148602 21444 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.134902 21318 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:05.122545 20936 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.194545 21449 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:05.122434 21089 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.196574 21359 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.129402 21332 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:05.206466 19065 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
W20260709 13:19:05.212033 19714 connection.cc:256] RPC call timeout handler was delayed by -1.4163955750000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 13:19:05.099478 19145 rpcz_store.cc:276] 0709 13:19:02.354846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.030328 (+2675482us) service_pool.cc:224] Handling call
0709 13:19:05.030619 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.030796 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.030820 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:05.030862 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:05.030894 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.030945 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.031045 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:05.212105 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 81462.8us
I20260709 13:19:05.105970 20839 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.237854 19220 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:05.136579 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:05.224196 19138 rpcz_store.cc:276] 0709 13:19:02.428498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.101406 (+2672908us) service_pool.cc:224] Handling call
0709 13:19:05.221997 (+120591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.222227 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.222262 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:05.222326 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:05.222372 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.222441 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.223520 (+  1079us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b5400327650. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.223647 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229641088}
I20260709 13:19:05.244818 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1686) took 1922 ms. Trace:
I20260709 13:19:05.136379 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:05.261893 19064 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:05.245014 21406 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.262544 19141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1696) took 1327 ms (client timeout 1519 ms). Trace:
I20260709 13:19:05.263545 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:05.234771 19212 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:05.263459 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.264652 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.265079 21324 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.265806 19217 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:05.265905 21232 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:05.267858 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.268317 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 358) took 1979 ms. Trace:
I20260709 13:19:05.271471 19216 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:05.275291 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 354) took 3778 ms. Trace:
I20260709 13:19:05.282096 21191 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:05.291465 19142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1700) took 1355 ms (client timeout 1767 ms). Trace:
I20260709 13:19:05.310811 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.342020 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.343931 19215 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
W20260709 13:19:05.570694 19714 connection.cc:256] RPC call timeout handler was delayed by -1.4163955750000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 13:19:05.317492 21408 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.348834 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1688) took 2000 ms. Trace:
I20260709 13:19:05.351496 21056 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:05.570072 18969 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 233) took 20527 ms (client timeout 15000 ms). Trace:
I20260709 13:19:05.570340 19063 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:05.353623 21204 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.354936 21367 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.356264 21282 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.356735 21383 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:05.357623 21210 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:05.359525 21180 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:05.359988 21417 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.371374 19750 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.186436 21201 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.124255 20454 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:05.364602 21352 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:05.441099 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.347229 21427 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:05.571201 19140 rpcz_store.cc:276] 0709 13:19:03.348033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.318707 (+1970674us) service_pool.cc:224] Handling call
0709 13:19:05.318973 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.341556 (+ 22583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.348762 (+  7206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.572811 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:05.570075 19142 rpcz_store.cc:269] 0709 13:19:03.936485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.066388 (+129903us) service_pool.cc:224] Handling call
0709 13:19:05.291222 (+1224834us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54002d8554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.291390 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956985600}
I20260709 13:19:05.634714 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:05.435067 19221 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:05.575901 19217 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:05.572289 19714 connection.cc:256] RPC call timeout handler was delayed by -1.3008446629999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:19:05.573032 19139 rpcz_store.cc:276] 0709 13:19:03.322508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.220188 (+1897680us) service_pool.cc:224] Handling call
0709 13:19:05.220527 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.244605 (+ 24078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.244768 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:05.571249 19141 rpcz_store.cc:269] 0709 13:19:03.935363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.002177 (+ 66814us) service_pool.cc:224] Handling call
0709 13:19:05.246003 (+1243826us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54003101d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.262477 (+ 16474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414978304}
W20260709 13:19:05.572741 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 436422us
I20260709 13:19:05.636003 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.576378 19146 rpcz_store.cc:276] 0709 13:19:03.717945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.375008 (+1657063us) service_pool.cc:224] Handling call
0709 13:19:05.375324 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.375872 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.376053 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:05.636900 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:05.573307 19747 rpcz_store.cc:276] 0709 13:19:03.288690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.288917 (+   227us) service_pool.cc:224] Handling call
0709 13:19:03.617625 (+328708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.658926 (+ 41301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.268104 (+1609178us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54005fc150. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.268255 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666424192}
W20260709 13:19:05.184049 21439 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.272s	user 0.002s	sys 0.004s
I20260709 13:19:05.641826 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.642432 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1452) took 2901 ms. Trace:
I20260709 13:19:05.642607 19749 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:05.643532 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.644299 19139 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:05.587122 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:05.417981 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 365167us
I20260709 13:19:05.625939 21056 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:05.383819 21339 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.626262 21210 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.603554 21332 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:05.585669 21207 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:05.563506 21389 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.582371 21318 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.639789 21364 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.641772 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.569012 18968 catalog_manager.cc:5697] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 2, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:05.703845 21290 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.788388 19744 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:05.504935 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.790092 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.790956 21290 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.792202 19147 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:05.747275 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.577504 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.805989 19067 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:05.807498 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:05.564648 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 468556us
I20260709 13:19:05.811244 19038 leader_election.cc:400] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 3 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4.
I20260709 13:19:05.395828 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:05.814796 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 418960us
I20260709 13:19:05.751390 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.817584 19066 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:05.818598 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:05.819799 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.820464 19066 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:05.821182 21383 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:19:05.582650 18969 rpcz_store.cc:269] 0709 13:18:45.034223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.034472 (+   249us) service_pool.cc:224] Handling call
0709 13:19:05.561910 (+20527438us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:56.453400 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:56.454073 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:56.454121 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:18:56.454141 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:56.675002 (+220861us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:56.685819 (+ 10817us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:56.690166 (+  4347us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:18:56.874632 (+184466us) tablet.cc:701] Row locks acquired
0709 13:18:56.874703 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:18:56.890297 (+ 15594us) write_op.cc:270] Start()
0709 13:18:56.920211 (+ 29914us) write_op.cc:276] Timestamp: P: 1783603136874825 usec, L: 0
0709 13:18:56.927547 (+  7336us) op_driver.cc:348] REPLICATION: starting
0709 13:18:56.998928 (+ 71381us) log.cc:844] Serialized 4754 byte log entry
0709 13:18:57.965410 (+966482us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f61004800ac 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b
0709 13:19:00.089897 (+2124487us) op_driver.cc:464] REPLICATION: finished
0709 13:19:00.687162 (+597265us) write_op.cc:301] APPLY: starting
0709 13:19:00.701051 (+ 13889us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:00.734906 (+ 33855us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:00.747040 (+ 12134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:00.953260 (+206220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:01.025238 (+ 71978us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:19:01.028821 (+  3583us) write_op.cc:312] APPLY: finished
0709 13:19:01.029195 (+   374us) log.cc:844] Serialized 89 byte log entry
0709 13:19:01.118382 (+ 89187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.150366 (+ 31984us) write_op.cc:454] Released schema lock
0709 13:19:01.150453 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:01.284538 (+134085us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.293962 (+  9424us) write_op.cc:454] Released schema lock
0709 13:19:02.464147 (+1170185us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b2000060c78. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6103138b91 00007f610315aa19 00007f61031258c3 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169 00007f610312e131 00007f610312d42d 000000000038f354
Metrics: {"mutex_wait_us":1564832,"reported_tablets":23,"spinlock_wait_cycles":53504,"child_traces":[["op",{"apply.queue_time_us":582759,"apply.run_cpu_time_us":56043,"apply.run_wall_time_us":533617,"num_ops":12,"prepare.queue_time_us":385950,"prepare.run_cpu_time_us":79419,"prepare.run_wall_time_us":2400862,"raft.queue_time_us":636681,"raft.run_cpu_time_us":47803,"raft.run_wall_time_us":536070,"replication_time_us":3128534,"spinlock_wait_cycles":50673664,"thread_start_us":2924146,"threads_started":5,"wal-append.queue_time_us":2322425,"wal-append.run_cpu_time_us":97884,"wal-append.run_wall_time_us":3985360}]]}
I20260709 13:19:05.754390 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1682) took 4539 ms. Trace:
I20260709 13:19:05.823382 19064 rpcz_store.cc:276] 0709 13:19:01.215082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.827661 (+2612579us) service_pool.cc:224] Handling call
0709 13:19:03.828038 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.572237 (+1744199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.753677 (+181440us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540025dd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:05.754167 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3270090496}
I20260709 13:19:05.757197 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 177) took 1329 ms. Trace:
I20260709 13:19:05.385242 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:05.826517 19065 rpcz_store.cc:276] 0709 13:19:04.427911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.429496 (+  1585us) service_pool.cc:224] Handling call
0709 13:19:05.756683 (+1327187us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400353ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.756964 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208709888}
I20260709 13:19:05.827272 19069 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 3: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:05.575362 19072 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:05.758845 19071 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:05.770102 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:19:05.775876 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.638770 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:05.648252 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.636587 19140 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:05.639348 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:05.861370 19141 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.861745 19072 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:05.655875 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.864387 19064 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:19:05.580856 19143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.026s	sys 0.050s
I20260709 13:19:05.650045 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.583215 19145 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:05.871914 21083 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:05.872471 21083 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.670586 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.879678 19146 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:05.879920 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.653154 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.642792 19214 rpcz_store.cc:276] 0709 13:19:02.741483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.024303 (+1282820us) service_pool.cc:224] Handling call
0709 13:19:04.024693 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.066278 (+ 41585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.066325 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.070756 (+  4431us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.651260 (+580504us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:04.941004 (+289744us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.945200 (+  4196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.945296 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.181509 (+236213us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b18003180a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db
0709 13:19:05.183411 (+  1902us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:05.642242 (+458831us) raft_consensus.cc:1685] finished
0709 13:19:05.642263 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.642378 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":416488,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":16372,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":1887,"spinlock_wait_cycles":33911040,"thread_start_us":784260,"threads_started":2,"wal-append.queue_time_us":645849}
I20260709 13:19:05.871858 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.885546 19212 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:05.886945 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:05.887195 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.887971 19214 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.647562 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.887210 19064 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:05.889226 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.890478 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:05.890815 21088 consensus_meta.cc:287] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.006s
I20260709 13:19:05.890986 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.891510 19221 raft_consensus.cc:2410] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:05.892016 19212 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:05.892211 19139 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:05.779081 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.654347 20839 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.894898 19141 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:05.655825 20936 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.646436 21056 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:05.897333 21056 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.897921 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.898763 19212 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:05.899212 21056 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:05.871992 19143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.031s	sys 0.051s
I20260709 13:19:05.899873 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.630421 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.636053 19217 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.903332 19217 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.779235 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1221) took 3367 ms. Trace:
I20260709 13:19:05.905017 19144 rpcz_store.cc:276] 0709 13:19:02.411939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.059320 (+2647381us) service_pool.cc:224] Handling call
0709 13:19:05.291974 (+232654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.292436 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.292476 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.293118 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.566669 (+273551us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:05.566705 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.566773 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.777274 (+210501us) raft_consensus.cc:1685] finished
0709 13:19:05.777309 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.778553 (+  1244us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002d8550. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:05.779017 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1952,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":528513792,"thread_start_us":273139,"threads_started":1,"wal-append.queue_time_us":351673}
I20260709 13:19:05.906983 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:05.907598 19144 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.620440 21232 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.632604 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:05.913807 21232 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.571791 19219 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:05.916823 20839 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:05.569684 19742 rpcz_store.cc:276] 0709 13:19:01.496847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.538885 (+ 42038us) service_pool.cc:224] Handling call
0709 13:19:01.539182 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.565582 (+1026400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.275010 (+2709428us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54005956d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:05.275209 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359003520}
I20260709 13:19:05.780243 21250 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.634809 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 62076.2us
I20260709 13:19:05.918808 19213 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:19:05.918493 21250 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.919678 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:05.649430 21272 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:05.921504 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.921739 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:05.660862 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.645569 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.651508 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.657274 19749 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.934625 19748 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:05.646373 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:19:05.936172 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 289695us
I20260709 13:19:05.937500 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:05.659777 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:05.669232 19750 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:05.566849 21081 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.658586 21089 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.638602 21191 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.950057 21191 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.685581 21207 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:05.650045 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:05.653208 21360 consensus_meta.cc:287] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.000s
I20260709 13:19:05.667750 21367 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.955523 21081 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.955889 19218 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:05.957420 21091 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:05.958045 21091 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:05.958406 19218 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:05.695801 21210 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.666044 21282 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.959165 21091 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:05.960316 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.647672 21336 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.694023 21364 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.965665 21232 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.967216 21364 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.644603 21345 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:05.656358 21398 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.550s	user 0.004s	sys 0.001s
I20260709 13:19:05.969422 21398 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.971554 21398 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.685849 21389 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.974378 21389 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.586539 21406 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.976971 21406 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.977594 21449 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:05.980098 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:05.662365 21417 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:05.981943 21191 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:05.686806 21418 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:05.983225 21418 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:05.984381 21418 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.985913 21418 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.651342 21420 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.649515 21437 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:19:05.644987 21440 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:05.776419 19068 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:05.793530 19063 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:05.794600 21212 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.997426 21212 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.793849 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1230) took 3103 ms. Trace:
I20260709 13:19:05.842036 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.000154 19147 rpcz_store.cc:276] 0709 13:19:02.690154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.168285 (+2478131us) service_pool.cc:224] Handling call
0709 13:19:05.168627 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.792706 (+624079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.793544 (+   838us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540017bbd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:05.793795 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413965568}
I20260709 13:19:05.843974 19071 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:05.843143 21332 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.845898 19069 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:05.851662 21444 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:05.855896 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 217048us
W20260709 13:19:05.865207 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 95638.9us
I20260709 13:19:05.855818 19138 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:05.861789 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.817584 18968 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 2 to 3, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.869287 19066 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:05.867226 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.872738 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1238) took 2135 ms. Trace:
I20260709 13:19:05.881665 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.881708 19065 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:06.004951 19142 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:06.005307 19065 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:05.881968 21383 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:19:06.006007 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:06.006758 19142 raft_consensus.cc:2410] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:05.877015 21083 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.007529 21423 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.008773 21318 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.892547 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:05.892906 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1694) took 2035 ms. Trace:
I20260709 13:19:05.913950 20936 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:05.620177 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:05.639390 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.029428 19220 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.031795 19748 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:05.922175 21272 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:06.031826 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:06.033702 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.034104 19138 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:06.035161 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:06.035707 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.036348 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:05.922389 19746 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:06.007579 19142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:05.923012 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.037308 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:06.038139 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 115289us
I20260709 13:19:06.039559 19063 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:06.039764 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:05.922897 21339 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:19:05.931023 19216 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:05.923183 21250 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.040995 21212 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:05.938763 21458 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.041713 21449 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.041805 21458 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:06.042884 21449 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:06.043196 21458 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:05.932090 19745 raft_consensus.cc:2410] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:05.941967 19144 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:06.045969 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:06.046660 19144 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:05.955005 21207 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:05.992931 19213 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:06.001039 19218 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:06.047644 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:05.923429 21408 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:06.009224 21423 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.917245 19219 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.001648 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:06.009819 19221 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:06.010074 19139 rpcz_store.cc:276] 0709 13:19:03.857427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.891482 (+2034055us) service_pool.cc:224] Handling call
0709 13:19:05.891934 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.892619 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.892806 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.004768 19145 rpcz_store.cc:276] 0709 13:19:03.737418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.570510 (+1833092us) service_pool.cc:224] Handling call
0709 13:19:05.582946 (+ 12436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.872210 (+289264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.872558 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.062039 19145 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:19:06.062480 19145 pending_rounds.cc:85] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 3
I20260709 13:19:06.062769 19145 pending_rounds.cc:107] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:19:06.063102 19145 raft_consensus.cc:2889] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.064586 21423 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.017279 19217 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:06.066574 21417 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.066987 21417 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:06.067360 21417 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.069643 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.070593 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.071615 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:06.073923 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.074563 19145 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.075348 21420 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:06.018837 19214 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:06.022044 21440 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:06.022403 18968 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 3, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.025414 19140 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:06.043362 21449 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.032604 21210 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:06.033051 21272 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:05.925351 19141 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:19:06.037436 19142 raft_consensus.cc:606] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:06.038184 19069 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:05.931527 21329 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:05.923524 21290 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:05.649324 21427 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.030226 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:06.049117 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.052948 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1241) took 1571 ms. Trace:
I20260709 13:19:06.067391 19220 raft_consensus.cc:2410] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:06.016750 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.138936 19144 rpcz_store.cc:276] 0709 13:19:04.481968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.047369 (+1565401us) service_pool.cc:224] Handling call
0709 13:19:06.047788 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.052474 (+  4686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.052519 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.052584 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.052640 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.052715 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.052832 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.028438 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.074360 21406 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:06.080606 18968 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.081065 21191 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:06.081967 21345 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.082382 21398 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.079252 21339 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:06.098894 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1213) took 3745 ms. Trace:
I20260709 13:19:06.099354 21290 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:06.147624 19215 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
W20260709 13:19:06.105072 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 125181us
I20260709 13:19:06.105652 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.100121 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.106559 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.107877 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.107568 21440 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.076272 21437 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.149679 19066 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:06.108713 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.109504 19142 raft_consensus.cc:614] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.095333 19141 pending_rounds.cc:85] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 1
I20260709 13:19:06.110108 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.112635 19138 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:06.153406 19141 pending_rounds.cc:107] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:19:06.136474 21383 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.084789 21210 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.153627 19068 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:06.154806 21210 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.111812 21083 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.114642 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:06.117280 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 69712us
W20260709 13:19:06.118124 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.116699 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.156782 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:06.157244 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.158030 21083 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.158767 21083 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.083150 21389 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.159300 21083 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.159787 21083 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.083462 21408 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.160105 21389 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:06.160424 21408 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:06.160925 21408 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.161384 21389 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:06.162793 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.163321 19147 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:06.133103 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.136000 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.153753 19141 raft_consensus.cc:2889] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.141381 19139 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.141538 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.105545 21272 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.159149 21250 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:06.158776 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.166280 21250 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:06.165690 19072 raft_consensus.cc:2376] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6. Re-sending same reply.
I20260709 13:19:06.167872 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.165342 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1239) took 1739 ms. Trace:
I20260709 13:19:06.168157 21083 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.167685 21250 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.154819 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.104341 21423 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.168570 19141 rpcz_store.cc:276] 0709 13:19:04.426339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.895901 (+1469562us) service_pool.cc:224] Handling call
0709 13:19:05.896356 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.164833 (+268477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.165289 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:06.172658 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.173252 19063 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
W20260709 13:19:06.173619 21472 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:19:06.176508 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 68060.2us
I20260709 13:19:06.177184 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:06.177953 21446 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.147601 21290 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.179252 21449 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.127014 21444 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:19:06.179742 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:06.198030 19138 raft_consensus.cc:2368] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
W20260709 13:19:06.198472 21475 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.100s	user 0.004s	sys 0.000s
I20260709 13:19:06.180996 21318 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.199395 21336 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.199968 21336 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.141844 21406 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:06.188580 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 51039.3us
W20260709 13:19:06.201462 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 95069.7us
I20260709 13:19:06.146055 21329 consensus_queue.cc:1243] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:06.168845 21207 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.241319 21207 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:06.241755 21207 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.242473 21449 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.146245 19143 rpcz_store.cc:276] 0709 13:19:02.353614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.697116 (+2343502us) service_pool.cc:224] Handling call
0709 13:19:04.763251 (+ 66135us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.033802 (+270551us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:05.900105 (+866303us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.064164 (+164059us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.064776 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.065012 (+   236us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:06.065050 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.065128 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.098508 (+ 33380us) raft_consensus.cc:1685] finished
0709 13:19:06.098543 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.098751 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64343,"prepare.queue_time_us":660333,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":904,"raft.queue_time_us":195583,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":201,"thread_start_us":967786,"threads_started":2,"wal-append.queue_time_us":114909}
I20260709 13:19:06.243006 19065 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.206727 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.244283 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:06.244611 19066 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
W20260709 13:19:06.207023 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.245647 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:06.246202 19184 connection.cc:256] RPC call timeout handler was delayed by -1.826653886000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:19:06.246663 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7726538859999437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:19:06.246970 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7177538859998549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:19:06.247268 19184 connection.cc:256] RPC call timeout handler was delayed by -1.6889538860000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:19:06.247087 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:06.247699 19184 connection.cc:256] RPC call timeout handler was delayed by -1.5953538859998844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:19:06.248016 19184 connection.cc:256] RPC call timeout handler was delayed by -1.5953538859998844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:19:06.248299 19184 connection.cc:256] RPC call timeout handler was delayed by -1.530553886000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:19:06.248597 19184 connection.cc:256] RPC call timeout handler was delayed by -1.2074538859999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:19:06.252460 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1840538859999015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
I20260709 13:19:06.208061 21091 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:06.211784 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:06.212138 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.244329 19065 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.214845 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1243) took 1602 ms. Trace:
I20260709 13:19:06.215418 21446 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:06.217401 21336 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.183557 21210 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.219239 18968 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 3, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 3 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:06.221287 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:06.266438 19141 raft_consensus.cc:2410] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:06.221562 21056 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.269272 21446 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.269359 21056 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:06.271349 21056 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.275691 21437 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.276378 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:06.278147 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.279192 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:06.221798 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:06.221841 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65231.7us
I20260709 13:19:06.222856 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:06.201718 21083 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.223914 21408 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.225981 21444 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.226500 21383 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.227612 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:06.237036 21367 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:19:06.207187 21406 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.250752 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:06.254877 19139 rpcz_store.cc:276] 0709 13:19:04.612124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.059842 (+1447718us) service_pool.cc:224] Handling call
0709 13:19:06.060286 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.165028 (+104742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.214464 (+ 49436us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b5400327b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:06.214740 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185968512}
I20260709 13:19:06.145808 21420 consensus_queue.cc:1243] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:06.282879 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.283084 19143 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:06.294646 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.296299 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.298805 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.304311 19144 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:06.300632 19142 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 3.
I20260709 13:19:06.291823 21336 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.290113 21444 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.311429 19747 raft_consensus.cc:2410] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:06.290388 21339 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:06.312453 19143 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:19:06.292040 21383 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.317097 19138 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:06.293964 21191 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:06.318186 19139 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:06.319463 21408 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:06.321013 19063 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:06.321858 21406 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.322546 19070 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:06.325332 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.327199 19142 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:06.327594 21444 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.335737 21339 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.330237 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.331211 21383 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.335857 19113 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.343763 21207 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:06.337198 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 158804us
I20260709 13:19:06.335501 21191 consensus_queue.cc:1243] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:06.347565 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.294226 21332 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.331241 21345 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:06.351591 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.351936 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.335783 21420 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:06.349885 21440 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.367022 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.369827 19220 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.367645 19747 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:06.371363 21408 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.371814 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.351353 21056 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.380236 21056 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.381325 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.381537 19142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3627cae163084c338404a5153ef0efb9"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:06.382102 19142 raft_consensus.cc:606] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.382148 19215 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:06.382543 19142 raft_consensus.cc:614] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.364938 21332 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:06.383878 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52399.9us
I20260709 13:19:06.384793 21056 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.385088 21332 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:06.385368 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48713us
I20260709 13:19:06.352334 21437 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:19:06.386261 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.389302 21383 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.391459 21383 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:06.392639 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 701310a5195343c081bea195df509e65: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:06.392998 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.394078 21423 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.394649 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.394908 21056 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.395534 21056 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.396215 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.396061 21444 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.396528 21056 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.397538 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.398170 19214 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:06.398638 21272 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.382902 21290 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.400409 21212 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.400867 21212 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.401297 21212 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.402143 21290 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:06.403988 19070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1692) took 1280 ms (client timeout 1507 ms). Trace:
I20260709 13:19:06.292788 21427 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:06.404500 19070 rpcz_store.cc:269] 0709 13:19:05.125482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.127844 (+  2362us) service_pool.cc:224] Handling call
0709 13:19:06.403757 (+1275913us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b540017ded4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:06.403915 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524743936}
I20260709 13:19:06.408701 21329 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.409765 19146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:06.363544 21210 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.369362 21440 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.413913 19146 raft_consensus.cc:606] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.414458 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:06.415097 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.417826 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.422776 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:06.413264 21336 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.418609 21389 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.413386 21329 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.429557 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.427734 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.431291 19220 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:06.427436 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:06.432734 21420 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.422880 21440 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.439477 21420 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:06.425479 21081 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:19:06.441494 19065 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:19:06.441856 19065 pending_rounds.cc:85] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 5
I20260709 13:19:06.442102 19065 pending_rounds.cc:107] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:19:06.442337 19065 raft_consensus.cc:2889] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.443010 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1453) took 1376 ms. Trace:
I20260709 13:19:06.443337 19065 rpcz_store.cc:276] 0709 13:19:05.066750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.848519 (+781769us) service_pool.cc:224] Handling call
0709 13:19:05.870635 (+ 22116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.242604 (+371969us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000ca6a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610350806f 00007f6103580f60 00007f61035827de 00007f610358cb49 00007f610358d416 00007f6103589d8f 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62
0709 13:19:06.442802 (+200198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.442964 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540957440}
W20260709 13:19:06.426608 21483 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:19:06.396231 21360 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:06.445128 21360 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:06.446254 21360 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.376906 21449 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:19:06.450011 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44736us
I20260709 13:19:06.453337 19214 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:06.449501 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 124303us
I20260709 13:19:06.424813 21336 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.456580 21336 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.448151 21212 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.459677 21212 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.427160 21417 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.462881 21417 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:06.427426 21329 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.467662 21349 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:06.468065 21212 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:06.469544 21418 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:06.469816 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:06.469908 21418 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.470784 21369 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.471192 21369 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.471597 21212 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.471760 19038 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.471812 21349 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:06.472249 21212 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:06.472952 21212 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.473273 21349 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:06.474007 21349 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:06.474328 21349 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.474948 21091 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:06.471555 21369 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.475198 21349 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.476406 21349 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.454560 20839 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:06.466881 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.496385 21336 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.471192 21418 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.497908 21418 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.498551 21336 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.492759 21207 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.509327 21360 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.513258 21329 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.518267 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.526835 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.527420 19214 raft_consensus.cc:2368] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:06.484128 21272 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:06.530475 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 44478.3us
I20260709 13:19:06.519414 20839 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.536478 19220 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.529699 21088 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:06.537878 20454 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:06.539148 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 72469.7us
I20260709 13:19:06.542917 19065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:19:06.543380 19065 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.543663 19065 raft_consensus.cc:614] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.538046 21088 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.531733 21272 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.516844 21212 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.549012 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.549916 19220 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:06.550554 21056 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:06.553038 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:06.552577 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.531965 21336 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:19:06.552839 21329 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.557729 19219 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.553655 19063 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:06.554111 19070 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:06.555477 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.545380 21440 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.560385 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:06.595578 19072 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
W20260709 13:19:06.560500 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.662s (SENT) [suppressed 18 similar messages]
I20260709 13:19:06.561837 21088 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.563191 21446 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.565004 19067 raft_consensus.cc:2376] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6. Re-sending same reply.
I20260709 13:19:06.565372 20839 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.565853 21212 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.565415 21369 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.567479 21207 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.607903 21417 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:06.608387 21417 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:06.608747 21417 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.611514 21207 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.612823 19066 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:06.568382 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.568971 21437 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.572399 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.573503 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.549495 21272 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.575623 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.576426 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.587430 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:06.606381 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 60771.8us
I20260709 13:19:06.612113 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.622259 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.625059 21444 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.626281 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.627079 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.627399 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.628134 19217 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:06.628011 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.628500 21360 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.611986 21207 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.621168 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.628845 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.638700 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.639504 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.639870 19212 raft_consensus.cc:2410] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:06.640672 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.642300 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:06.646932 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 78656.3us
W20260709 13:19:06.648075 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 74640.5us
I20260709 13:19:06.651126 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.651777 19217 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:06.653120 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.659613 19216 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.653977 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.652235 21444 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:06.660491 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 88164.7us
I20260709 13:19:06.671281 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.671690 19216 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:06.628938 21360 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:06.661536 19068 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:06.647010 21088 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:06.647286 21212 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:06.689208 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 46992.2us
I20260709 13:19:06.677089 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.678175 21417 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.679706 21440 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.669914 21191 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:19:06.674553 21444 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.685774 19217 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:06.688066 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.689482 21212 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.661219 20454 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:19:06.694670 19068 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.695952 19216 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.696633 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.661804 21339 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.710739 19220 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.629765 21446 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:06.705125 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 144635us
I20260709 13:19:06.706779 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:06.712718 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 58834.1us
I20260709 13:19:06.690788 21360 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.716063 20454 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:06.713655 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.716562 20454 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:06.712064 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.708052 21444 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.708956 21212 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.725623 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.710916 21339 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.726007 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:06.737217 21339 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.737548 19147 raft_consensus.cc:606] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:06.726090 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 49124.5us
I20260709 13:19:06.726387 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.718005 21389 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.710844 21290 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:06.727401 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.727808 21349 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.729773 21446 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.709398 21420 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.730058 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.730466 21332 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:06.743623 19219 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:06.749372 19217 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
W20260709 13:19:06.756242 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.718371 21437 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.732578 21406 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:19:06.751549 21191 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:19:06.759367 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.760737 19113 leader_election.cc:400] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:06.763494 19113 leader_election.cc:403] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:19:06.769375 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 56401.5us
I20260709 13:19:06.747913 21389 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.771673 19219 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:06.772540 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 45182.2us
I20260709 13:19:06.757892 21088 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.780463 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.760217 20454 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.782444 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:06.784202 19147 raft_consensus.cc:606] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.758962 21437 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.784637 19147 raft_consensus.cc:614] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:06.784920 21088 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.814788 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.815774 21088 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.818246 20454 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.821161 21207 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.822909 21339 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.783411 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.825189 19215 raft_consensus.cc:2368] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7.
I20260709 13:19:06.825955 21369 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.826447 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.827363 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.827622 21207 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.828003 21207 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:06.828083 21191 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.828418 21207 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.829206 21339 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.814836 21440 raft_consensus.cc:993] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:19:06.833621 21440 raft_consensus.cc:1081] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
W20260709 13:19:06.834098 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.814085 21417 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.834482 21408 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:06.836437 21191 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:06.838246 21420 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:06.832746 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57684.2us
I20260709 13:19:06.838747 21420 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.781792 21482 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:06.841418 21336 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.841533 21482 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:06.842483 21482 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.843750 21482 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.770987 21272 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.840994 19038 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.845806 21481 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:06.846746 21367 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:06.846948 21481 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:06.847554 21481 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:06.847859 21367 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:06.848263 21367 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:06.846987 21272 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.848613 21481 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.833931 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:06.851078 21481 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.851936 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.852850 21406 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.815178 21290 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.853489 21406 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:06.853892 21406 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.855055 21290 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:06.855542 21437 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.855980 21417 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.856518 21417 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:06.857354 21349 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.858179 21336 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:06.859704 21056 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:06.860175 21056 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.855084 21332 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:19:06.861667 21332 consensus_queue.cc:1243] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:06.861251 21056 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.862146 21332 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:06.862498 21332 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:06.863406 21332 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.864535 21332 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.865053 21349 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.876427 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:06.814329 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:06.865733 21367 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.866811 21417 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.867488 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:06.881764 19220 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.826558 21369 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.758841 20839 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.767879 21345 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.867842 21336 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:19:06.785409 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.876111 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.776661 21389 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.875238 21423 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.763011 21444 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.876060 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:06.902944 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 117656us
I20260709 13:19:06.777879 21329 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 13:19:06.909739 21367 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.906973 21250 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:06.881546 21081 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:19:06.878126 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:06.915889 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.915714 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.916775 21250 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:06.920269 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:06.920512 21250 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.921869 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.923421 21458 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.924010 21477 raft_consensus.cc:2764] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:06.925370 21444 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:06.923751 21081 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:06.926349 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48323.6us
I20260709 13:19:06.924099 21349 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.876295 21418 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:19:06.879339 21427 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:19:06.945644 19038 leader_election.cc:400] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7.
I20260709 13:19:06.946918 19038 leader_election.cc:403] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:06.903250 21345 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:06.944001 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:06.943404 19220 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:06.914791 21339 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.925905 21081 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:06.949420 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:06.923808 21458 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.889771 21360 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:06.956101 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:06.961934 21408 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:06.950604 21345 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.950742 21329 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:06.952028 21339 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:06.963443 21091 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:06.964155 21081 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:06.952730 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:06.950304 21444 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:06.951562 21418 consensus_queue.cc:1243] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:19:07.024381 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 148055us
W20260709 13:19:07.025799 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 151928us
I20260709 13:19:07.017021 19217 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:07.018285 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.952970 21477 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.957827 21458 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.028576 19220 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:07.018074 21339 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.969576 21446 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:19:06.957346 21272 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:19:07.023587 21444 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.023171 21449 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.965075 21406 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:07.070111 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 161501us
I20260709 13:19:07.028020 21477 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:07.073653 21444 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:07.075544 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.017110 21212 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:07.077527 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 108484us
I20260709 13:19:07.083675 21406 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:07.085843 21481 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:07.087177 21272 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:07.087743 21389 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.061111 20839 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.087862 21272 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.071827 21081 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.075575 21477 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:07.080197 21091 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:07.071645 21191 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:07.168288 21367 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.163432 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:07.174093 21091 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:07.182559 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 79130.1us
W20260709 13:19:07.184547 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 207294us
I20260709 13:19:07.162931 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:07.178656 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 103184us
I20260709 13:19:07.087666 21437 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.168305 21272 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:07.221662 21389 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:07.190518 21519 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:07.179047 21329 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:07.178175 21367 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.223714 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:07.229441 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.251144 21482 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.251734 21482 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.253881 21482 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:07.254032 21517 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:07.254422 21482 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:07.255218 21440 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:07.255764 21482 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:07.255828 21440 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:07.254069 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:07.256628 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 93807.8us
I20260709 13:19:07.262283 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:07.262588 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.262964 19212 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.254137 21336 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.274121 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 87470us
I20260709 13:19:07.243467 21191 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:07.210136 21420 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.256381 21482 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:07.295046 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:07.295673 19065 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:07.288302 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:07.288847 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:07.296844 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:07.289783 19068 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:19:07.297314 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.297964 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:07.298179 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.294716 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.289615 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:07.258718 21525 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:07.299376 19216 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.304287 21345 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.298753 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:07.308983 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.312702 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.249351 21418 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:07.313028 19215 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.315877 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.316042 19139 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:07.316665 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:07.315292 19216 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
W20260709 13:19:07.294409 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 131572us
I20260709 13:19:07.315660 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.305653 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.320101 19069 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:07.321197 19143 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:07.321941 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.322757 19147 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:07.323954 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:07.325227 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:07.325732 19070 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:07.305104 19213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:19:07.327399 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:07.327539 19213 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.288054 21290 raft_consensus.cc:2764] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:07.336853 21290 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.337292 21290 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.337735 19140 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:07.339265 21290 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:07.328524 19213 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.254051 21207 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.330322 21522 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:07.330684 19071 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:07.331185 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.331070 21440 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.333005 21517 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.333298 21329 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:07.334712 21505 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:19:07.343129 19212 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
W20260709 13:19:07.385607 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 76755.7us
I20260709 13:19:07.386052 19072 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:07.386416 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:07.387300 19220 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.290903 21406 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.306361 21191 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:07.328598 21360 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:07.429992 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.355422 19215 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:07.273027 21336 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.362025 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:07.327912 21506 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:19:07.386471 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.321194 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.388989 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.434859 19145 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.435079 19065 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:19:07.393827 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 74379.6us
I20260709 13:19:07.306156 21525 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:19:07.429179 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.347198 21437 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:07.433128 19184 leader_election.cc:400] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:19:07.385182 21349 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:07.440498 19212 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.441794 19184 leader_election.cc:403] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:19:07.451864 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.454217 19220 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:07.462888 19212 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.462424 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:07.463646 19069 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
W20260709 13:19:07.457170 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 70772.2us
I20260709 13:19:07.485517 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:07.486230 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.486737 19215 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:07.488016 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 59036.3us
I20260709 13:19:07.488828 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:07.444351 21250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.003s	sys 0.015s
I20260709 13:19:07.385893 21517 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.486191 19071 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:07.497673 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:07.463140 21088 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.005s
I20260709 13:19:07.502813 19144 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:07.504374 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:07.439245 21406 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.454891 21360 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5.
I20260709 13:19:07.330296 21529 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:07.518574 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:07.522940 19143 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:07.516392 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:07.527856 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:07.533417 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:07.533048 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.538605 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.540230 19747 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:07.541288 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.542142 19144 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:07.539798 19212 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:07.507746 21417 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:07.550711 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.441203 21482 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.517772 21408 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.569873 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:07.570197 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 53953.2us
I20260709 13:19:07.570474 19143 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.487112 21522 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:19:07.534533 21367 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:07.510303 21088 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.582751 21250 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:07.583031 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:07.577643 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:07.608520 19144 raft_consensus.cc:2410] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:07.590837 21521 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.592947 21458 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.002s
I20260709 13:19:07.593063 21513 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:07.593557 21526 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:19:07.593989 21336 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:07.594221 21527 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:07.594669 21515 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:07.595052 21533 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 13:19:07.598724 21423 consensus_meta.cc:287] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.001s
I20260709 13:19:07.616909 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:07.598855 21444 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.616407 21530 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:07.566597 21091 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.613229 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:07.567878 21290 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.623695 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.578358 21360 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:07.626232 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 140057us
I20260709 13:19:07.633682 19141 raft_consensus.cc:2368] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7.
I20260709 13:19:07.623140 21458 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.653597 19140 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:07.630378 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:07.600672 21345 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:07.522329 21525 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.644533 21423 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:07.643424 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.618868 21513 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:07.630199 21339 consensus_meta.cc:287] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:19:07.661604 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:07.662092 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 48958.6us
I20260709 13:19:07.662837 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:07.655184 19746 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:07.534193 21191 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.640511 21482 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.640004 21207 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:07.659003 19144 raft_consensus.cc:2368] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6.
I20260709 13:19:07.665138 19748 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:07.601938 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.650727 21091 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.665006 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.621451 21521 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.651175 21534 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:07.673156 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:07.661732 21513 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.659286 21290 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.664563 21406 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:07.689410 21531 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:19:07.693790 21444 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:07.672061 21360 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:07.694954 21345 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:07.695278 21539 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:19:07.696278 21332 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.000s
I20260709 13:19:07.676532 21250 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:07.715368 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 59754.3us
I20260709 13:19:07.715595 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:07.716188 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.701632 19143 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:07.716804 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.717831 19143 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:19:07.678223 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:07.692639 19145 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:07.670253 21091 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.709049 19213 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.719400 19144 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.666301 21339 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.721832 19035 leader_election.cc:400] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6.
I20260709 13:19:07.724036 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:07.726238 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.726567 19147 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:07.724612 19219 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:07.724787 19146 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:07.724685 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:07.728551 19213 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:07.734019 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:07.739205 19146 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:07.739316 19143 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.740756 21427 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:07.741922 19145 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.749198 21514 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.749740 21514 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.751320 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:07.711766 21345 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:07.774086 21345 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:07.743235 21522 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:07.753319 21538 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:07.714738 21408 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:19:07.779445 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:07.734323 21336 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.754087 21524 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:19:07.783466 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.785306 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:07.785940 19067 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:07.786847 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.787418 19072 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.789175 21517 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:07.789511 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:07.790143 19068 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.761291 21533 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:07.790938 21533 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:07.777076 21081 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:07.754725 21360 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:07.792184 21360 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:07.791828 21533 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.761421 21516 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:07.793080 21360 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.793830 21516 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:07.794174 21516 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:07.761643 21290 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:07.723850 21527 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:07.752303 21444 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.794898 21516 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.795292 21444 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.796059 21516 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.753682 21544 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.797398 21444 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:07.797214 21544 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.798369 21088 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:07.799358 21544 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:07.752748 19746 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:07.799683 19070 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:07.799891 19215 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:07.755918 19113 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:07.711853 21406 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:19:07.801066 21530 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:07.801563 21530 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:07.802403 21449 raft_consensus.cc:3055] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:07.800619 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 44766.8us
I20260709 13:19:07.802790 21449 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:07.803587 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:07.803704 21449 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:07.804911 19220 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:07.805115 21250 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:07.806491 21250 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:07.806936 21250 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:07.807762 21250 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.765453 21339 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:07.766340 21510 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.599s	user 0.006s	sys 0.000s
I20260709 13:19:07.802433 21530 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.773061 21056 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:07.752571 21545 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.811283 21545 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:07.790030 21336 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.789199 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:07.753232 19212 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:07.828614 19216 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:07.828557 19072 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:07.834610 19143 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:19:07.839244 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 123118us
I20260709 13:19:07.791663 21081 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:07.817443 19068 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:07.752048 21514 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:07.898782 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 164821us
I20260709 13:19:08.355366 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:07.990998 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:08.377137 19213 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.834035 21544 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:08.057185 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:08.392618 19071 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.289165 21408 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.000444 19220 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:07.831984 21449 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:08.367717 19138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.023s	sys 0.028s
W20260709 13:19:08.224627 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 484103us
I20260709 13:19:08.001035 19215 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:08.369361 19066 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:08.206817 21091 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.370009 21406 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.834935 21336 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.285028 21482 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:08.371073 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:08.238833 21417 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:19:07.828378 21427 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.055192 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:08.373430 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:08.124042 21345 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.055128 21547 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.320s
W20260709 13:19:08.337198 19140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.008s
W20260709 13:19:08.433501 19140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.009s	sys 0.008s
I20260709 13:19:08.406714 21544 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:08.124492 21477 consensus_meta.cc:287] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.936s	user 0.010s	sys 0.000s
W20260709 13:19:08.290258 21529 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
W20260709 13:19:08.143328 21537 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.424s	user 0.000s	sys 0.000s
W20260709 13:19:08.063768 21510 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:19:08.130299 20839 consensus_meta.cc:287] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.967s	user 0.006s	sys 0.003s
W20260709 13:19:08.353368 21191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.001s
W20260709 13:19:08.208799 21513 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.002s
W20260709 13:19:08.376015 21056 consensus_meta.cc:287] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.002s
I20260709 13:19:08.387586 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:08.057135 21543 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:08.379326 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:08.460229 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 83398.7us
I20260709 13:19:08.461118 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:08.461899 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:08.389753 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.216658 21210 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.464558 21210 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.466586 21210 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:08.391273 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:08.287860 21290 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.257803 21339 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:08.406960 19138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.024s	sys 0.028s
I20260709 13:19:08.408480 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:07.840461 21524 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.548s
I20260709 13:19:08.411942 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.414525 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.414736 19145 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:08.117034 21520 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.566s
I20260709 13:19:08.418224 19212 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:19:08.002022 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 105976us
I20260709 13:19:08.417508 21406 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.434727 19215 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:08.456907 21420 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:08.446791 19213 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:08.433081 21408 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.455061 21212 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:08.455914 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1291) took 1777 ms. Trace:
I20260709 13:19:08.412775 21545 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:08.435499 21383 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:08.499840 19214 rpcz_store.cc:276] 0709 13:19:06.678087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.738659 (+ 60572us) service_pool.cc:224] Handling call
0709 13:19:06.738932 (+   273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.739302 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.739337 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.739844 (+   507us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.952661 (+212817us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:06.965091 (+ 12430us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.965304 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.965443 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.765383 (+799940us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:08.455596 (+690213us) raft_consensus.cc:1685] finished
0709 13:19:08.455707 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.455838 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16007,"prepare.queue_time_us":16643,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":1104,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":19325,"spinlock_wait_cycles":12615936,"thread_start_us":212426,"threads_started":1,"wal-append.queue_time_us":320722}
I20260709 13:19:08.473177 21418 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.435616 21521 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:08.456972 21191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.015s	sys 0.001s
I20260709 13:19:08.468124 19067 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:08.451251 21477 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.491496 21360 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.517158 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:08.473269 21519 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:19:08.521250 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:08.530139 19221 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:08.473698 19141 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:19:08.475085 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:08.477733 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.532441 19145 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:08.124213 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.517824 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:08.478493 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 70097.7us
I20260709 13:19:08.533895 19213 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:19:08.534055 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:08.535465 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:08.471704 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 101769us
I20260709 13:19:08.409091 21349 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.436723 21482 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.481382 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:08.481087 21339 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.481323 21520 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:08.482056 21210 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:08.480700 21056 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:08.475634 21530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.022s	sys 0.018s
I20260709 13:19:08.478083 21524 consensus_queue.cc:1243] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:08.485603 21512 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:08.438062 21427 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.488113 21336 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:08.434235 21081 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.463178 21513 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.489898 21091 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:08.479519 21290 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.496558 19142 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
W20260709 13:19:08.543308 21530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.023s	sys 0.019s
W20260709 13:19:08.498453 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.499104 19146 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:08.471182 21522 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:08.456120 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.462740 19144 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:08.531288 19214 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:08.579028 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.571468 19212 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:08.531462 19218 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:08.456504 20839 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7.
I20260709 13:19:08.540403 19147 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:08.514590 21418 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.543447 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:08.543572 21512 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:08.538905 21521 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:19:08.519723 21360 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:08.512297 21383 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:08.539692 21417 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:08.570526 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.539876 21349 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.610517 19064 raft_consensus.cc:2410] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:19:08.574649 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.544504 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:08.582916 19214 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:08.585047 19141 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.568121 21523 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.593295 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.496788 19071 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:08.669946 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.601711 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:08.569432 21056 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:08.608206 19145 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:08.571552 19139 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:08.676688 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:08.676910 21056 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:08.677013 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.677477 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.677733 19746 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:08.678272 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 76634.7us
I20260709 13:19:08.678068 21056 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.678771 21250 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:08.679201 21056 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.663308 21417 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.679494 21250 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:08.680092 21417 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.680658 21250 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.682307 21417 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:08.581278 21547 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:19:08.682895 21523 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.685096 21523 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:08.657481 21383 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.686035 21383 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.588951 21514 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.686682 21514 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.589011 21418 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.662827 21512 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:08.688932 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.689523 21512 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.689606 21191 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.690189 21191 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.691109 19147 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:08.692196 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:08.692948 19221 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:08.664654 21560 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:08.693346 19750 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:08.668637 21408 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:08.694602 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:08.695000 21339 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:08.695147 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.695951 19144 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:08.697003 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:08.609450 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 140097us
W20260709 13:19:08.602330 21556 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:19:08.585078 21081 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.703002 21345 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:08.703063 20839 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:08.705420 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.706097 19142 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:08.707695 21427 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:08.581198 21336 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:08.708328 21336 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:08.709569 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.710764 21482 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:08.711024 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.712255 21523 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:08.713240 21477 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:08.713496 21523 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.713863 21523 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:08.715083 21513 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:08.573071 21369 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:19:08.729138 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1295) took 1557 ms. Trace:
I20260709 13:19:08.695516 19214 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:08.709220 21336 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.573488 21088 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
W20260709 13:19:08.734329 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 189901us
I20260709 13:19:08.734789 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.729624 19217 rpcz_store.cc:276] 0709 13:19:07.171698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.171838 (+   140us) service_pool.cc:224] Handling call
0709 13:19:07.177237 (+  5399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.177586 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.177613 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.178049 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.450337 (+272288us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:07.450378 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.450441 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.728721 (+1278280us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b2c0007e678. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f610183a291 00007f61018550ca 00007f61035834ad 00007f610358af8e 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:19:08.728804 (+    83us) raft_consensus.cc:1685] finished
0709 13:19:08.728817 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.729067 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4509,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":8994560,"thread_start_us":271912,"threads_started":1,"wal-append.queue_time_us":491404}
I20260709 13:19:08.737720 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:08.738333 19071 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.738351 19146 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:08.743151 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.745975 19144 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:08.753556 19141 raft_consensus.cc:2410] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:08.714682 21523 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.593149 21091 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.786518 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.787283 19142 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 3.
I20260709 13:19:08.787752 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.781687 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:08.789876 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:08.657547 21544 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:08.792510 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 255081us
I20260709 13:19:08.593449 21360 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.611574 21522 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:08.658604 21212 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:08.794814 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:08.795581 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.732975 21527 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.798491 19146 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:08.792172 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:08.579039 21562 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:08.738833 21427 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.808331 19141 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:08.811432 19035 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:08.780138 21521 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.849234 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 54491us
I20260709 13:19:08.817682 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.673022 21530 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 13:19:08.814697 19071 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:08.806984 20839 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:08.874946 19748 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:08.849642 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:08.741477 21513 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:08.853073 21559 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.356s	user 0.002s	sys 0.003s
I20260709 13:19:08.861220 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 199) took 1047 ms. Trace:
I20260709 13:19:08.860036 21525 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:08.852671 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.892550 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:08.889104 19070 rpcz_store.cc:276] 0709 13:19:07.813432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.813776 (+   344us) service_pool.cc:224] Handling call
0709 13:19:07.839365 (+ 25589us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:07.839768 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.839808 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:07.917280 (+ 77472us) log.cc:844] Serialized 52 byte log entry
0709 13:19:08.450887 (+533607us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:08.450930 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.450996 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.860990 (+409994us) raft_consensus.cc:1685] finished
0709 13:19:08.861017 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.861160 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157585,"raft.queue_time_us":56110,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":24939,"thread_start_us":395008,"threads_started":1,"wal-append.queue_time_us":459408}
I20260709 13:19:08.852231 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:08.894057 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:08.861418 21477 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:08.864439 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 53125.1us
W20260709 13:19:08.789089 21554 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.322s	user 0.003s	sys 0.007s
W20260709 13:19:08.789453 21567 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.085s	user 0.004s	sys 0.000s
W20260709 13:19:08.869617 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.787250 21383 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:08.797026 21056 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.613842 21420 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.232s
I20260709 13:19:08.798584 21336 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:08.878146 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.915392 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.916200 19749 raft_consensus.cc:2410] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:08.819550 21524 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:08.835227 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.898062 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 5f49755f447d4bfba9fb1a68e2fedfa3: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:08.923485 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.849406 21212 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.799492 21091 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:08.910049 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.888715 19747 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:08.874996 21290 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:08.878590 21513 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.914317 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:08.889194 21519 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:08.901239 19751 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:08.819114 21527 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.894802 21523 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.869349 21521 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.929430 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:08.906371 21408 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:08.937937 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.912417 21339 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.873826 21427 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:08.978163 19219 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:08.922976 21524 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:08.979871 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 50538.7us
I20260709 13:19:08.977805 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.981160 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:08.905416 21482 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:08.926086 19744 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:19:08.989988 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:08.997179 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.000859 19748 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:08.998492 19215 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:08.951700 21513 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.001034 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:08.932292 21477 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.000519 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:09.005062 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:08.917625 21383 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.008265 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:09.013257 19142 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
W20260709 13:19:09.013469 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 109657us
I20260709 13:19:09.010669 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:09.009245 19751 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:08.979136 21408 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.983781 21339 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.952373 21418 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:08.956370 21522 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.004093 21524 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.324028 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1276) took 1782 ms. Trace:
I20260709 13:19:09.107224 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:09.048084 19215 pending_rounds.cc:85] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 2
I20260709 13:19:09.331570 19215 pending_rounds.cc:107] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:09.294281 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:09.163074 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:09.323314 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 297820us
I20260709 13:19:09.184188 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:09.333328 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:09.026604 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.998935 21345 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:09.071717 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 41fc665fafb64d08b393d9c8a77d2608: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:09.336918 21545 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:09.337430 21545 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.329747 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:09.332100 19215 raft_consensus.cc:2889] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.152396 21589 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.339442 21545 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:09.339660 21589 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.341176 19065 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.341889 21589 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:09.342033 19070 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
W20260709 13:19:09.325706 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 315106us
I20260709 13:19:09.346192 19184 leader_election.cc:400] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7.
I20260709 13:19:09.335235 21482 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:09.347195 19184 leader_election.cc:403] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:09.005105 21578 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.065913 21516 consensus_meta.cc:287] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.269s	user 0.012s	sys 0.001s
I20260709 13:19:09.350778 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:09.354416 19219 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:09.331180 19138 rpcz_store.cc:276] 0709 13:19:07.541207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.715128 (+173921us) service_pool.cc:224] Handling call
0709 13:19:07.725946 (+ 10818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.762700 (+ 36754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.762745 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.763369 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.472701 (+709332us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:08.472743 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.472811 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.080264 (+607453us) raft_consensus.cc:1685] finished
0709 13:19:09.080292 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.323961 (+243669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24180,"raft.queue_time_us":54661,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"thread_start_us":708941,"threads_started":1,"wal-append.queue_time_us":647924}
W20260709 13:19:09.354161 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 364185us
I20260709 13:19:09.078819 19744 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:09.012068 21290 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.078644 21594 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:09.357899 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:09.358383 19147 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.221266 21520 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:09.327317 21339 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.345309 21056 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:09.369172 19065 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:09.363310 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:09.356256 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:09.007234 21519 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.348s
I20260709 13:19:09.327143 21408 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.366426 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:09.327250 21529 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:19:09.345686 21383 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:09.078325 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:09.368494 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:09.065430 21569 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:09.372681 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:09.373195 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:09.389753 21519 consensus_queue.cc:1243] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:09.081223 21575 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.284s
I20260709 13:19:09.377377 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:09.699522 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:09.700788 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:09.100543 20839 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:09.704255 21596 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.704362 20839 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.355595 21345 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:19:09.710215 21345 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:09.710807 21345 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.379190 21566 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.379037 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:09.713624 19743 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:09.369845 21056 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.371174 21520 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:09.383052 21081 consensus_meta.cc:287] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.000s
I20260709 13:19:09.015636 21477 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.386001 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:09.726902 19219 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:09.387180 19147 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:09.357961 21578 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.394374 19142 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:09.394347 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:09.732955 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 354372us
W20260709 13:19:09.553265 21571 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.503s	user 0.001s	sys 0.000s
W20260709 13:19:09.435634 21582 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:19:09.390043 21290 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:09.553057 21573 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.493s	user 0.000s	sys 0.001s
W20260709 13:19:09.515960 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.753970 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 188) took 1360 ms. Trace:
W20260709 13:19:09.551120 21513 consensus_meta.cc:287] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:19:09.754830 21513 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.757380 21513 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:09.481302 19746 consensus_meta.cc:287] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.000s
W20260709 13:19:09.546902 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.758123 19746 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:09.758803 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 370) took 1082 ms. Trace:
I20260709 13:19:09.759199 19746 rpcz_store.cc:276] 0709 13:19:08.676052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.676714 (+   662us) service_pool.cc:224] Handling call
0709 13:19:09.758710 (+1081996us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:09.693707 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 337587us
I20260709 13:19:09.760100 21578 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:09.694738 19070 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:09.761441 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:09.694758 19065 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:09.761740 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:09.353914 21482 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7.
I20260709 13:19:09.762790 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:09.764111 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:09.764652 21336 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.841s	user 0.003s	sys 0.004s
I20260709 13:19:09.394361 21091 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:09.436214 21576 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:09.648821 21521 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:09.478575 21512 consensus_meta.cc:287] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.789s	user 0.009s	sys 0.000s
W20260709 13:19:09.723385 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.713402 21566 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.395547 21589 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.506047 21529 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:09.733865 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:09.795481 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 291135us
I20260709 13:19:09.736780 19066 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:09.737473 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:09.420574 21383 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:09.705119 21596 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.759779 21524 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.761636 21477 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:09.724479 21056 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:09.684769 21587 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.232s	user 0.004s	sys 0.004s
I20260709 13:19:09.374912 21562 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:09.460533 19216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.011s	sys 0.003s
I20260709 13:19:09.765793 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:09.766716 21594 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:09.767068 21525 consensus_meta.cc:287] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.870s	user 0.005s	sys 0.002s
I20260709 13:19:09.725500 21519 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.767851 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:09.715162 21418 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:09.795703 21521 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.774034 19213 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:09.774617 21290 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:09.832844 21290 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.774786 21482 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:09.835603 21482 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.835979 21482 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.775768 21345 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:09.837177 21345 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.837630 21345 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.804548 21529 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.839617 21345 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:09.840130 21345 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:09.840458 21345 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.840514 21529 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:09.775868 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:09.776451 19219 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:19:09.841250 19219 pending_rounds.cc:85] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 2
I20260709 13:19:09.841118 21458 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:09.841660 19219 pending_rounds.cc:107] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:19:09.841964 19219 raft_consensus.cc:2889] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.793406 21589 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.731236 21520 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:09.754422 19139 rpcz_store.cc:276] 0709 13:19:08.393319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.506267 (+112948us) service_pool.cc:224] Handling call
0709 13:19:08.571162 (+ 64895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.676489 (+105327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.753762 (+1077273us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b540017a7d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:09.753904 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126651648}
I20260709 13:19:09.778012 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 192) took 2500 ms. Trace:
I20260709 13:19:09.806391 21383 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.843030 19064 rpcz_store.cc:276] 0709 13:19:07.276728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.276906 (+   178us) service_pool.cc:224] Handling call
0709 13:19:09.776698 (+2499792us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540024ac54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:09.776851 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019126656}
I20260709 13:19:09.844236 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:09.780920 21523 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.791s	user 0.003s	sys 0.003s
I20260709 13:19:09.844764 21383 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:09.783842 21360 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.952s	user 0.011s	sys 0.000s
I20260709 13:19:09.798400 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:09.845335 21360 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:09.845737 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47454.9us
W20260709 13:19:09.804033 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 66660.8us
I20260709 13:19:09.847295 21360 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:09.720578 21569 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.816349 21581 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:09.819236 19216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.011s	sys 0.010s
W20260709 13:19:09.820616 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 86849.1us
I20260709 13:19:09.773280 21606 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.825091 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 57331.5us
I20260709 13:19:09.799322 21336 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.786466 21339 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.848847 19064 raft_consensus.cc:2368] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7.
I20260709 13:19:09.849061 19214 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:09.818548 19065 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.786319 21408 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.803107 21578 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:09.868155 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:09.840866 21345 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.884298 19068 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.874336 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1302) took 2038 ms. Trace:
W20260709 13:19:09.876188 19714 connection.cc:256] RPC call timeout handler was delayed by -1.0093871409999338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
I20260709 13:19:09.829887 21576 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.831410 21562 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:09.879865 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:09.902377 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:09.884037 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:09.885686 19110 leader_election.cc:400] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7.
I20260709 13:19:09.861307 21530 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:09.884804 19216 rpcz_store.cc:276] 0709 13:19:07.835849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.436520 (+600671us) service_pool.cc:224] Handling call
0709 13:19:08.450078 (+ 13558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.450312 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:08.718828 (+268516us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.874036 (+1155208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.874088 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:09.874129 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.874186 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.874283 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12019,"prepare.queue_time_us":329663,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":12776,"thread_start_us":1407249,"threads_started":2,"wal-append.queue_time_us":1049474}
I20260709 13:19:09.859382 21520 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.886695 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:09.886166 21523 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:09.889752 21477 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.910931 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:09.891705 21406 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:09.896443 19745 raft_consensus.cc:2410] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:09.897270 19139 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:09.897701 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1728) took 1206 ms. Trace:
I20260709 13:19:09.919852 19147 rpcz_store.cc:276] 0709 13:19:08.691177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.691972 (+   795us) service_pool.cc:224] Handling call
0709 13:19:09.897467 (+1205495us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400189a54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:09.897601 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530753408}
I20260709 13:19:09.898146 21408 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:09.898614 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1290) took 1162 ms. Trace:
I20260709 13:19:09.861783 21521 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:09.921459 19144 rpcz_store.cc:276] 0709 13:19:08.736384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.752081 (+ 15697us) service_pool.cc:224] Handling call
0709 13:19:08.752416 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:08.790762 (+ 38346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.790801 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:08.810310 (+ 19509us) log.cc:844] Serialized 52 byte log entry
0709 13:19:09.007070 (+196760us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:09.352085 (+345015us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.353636 (+  1551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.353757 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.898423 (+544666us) raft_consensus.cc:1685] finished
0709 13:19:09.898444 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.898563 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29713,"prepare.queue_time_us":338706,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":48730,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9149,"spinlock_wait_cycles":13012224,"thread_start_us":467329,"threads_started":2,"wal-append.queue_time_us":586682}
I20260709 13:19:09.902380 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 277) took 2445 ms. Trace:
I20260709 13:19:09.868798 21581 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.904049 19110 leader_election.cc:403] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:09.904103 19064 raft_consensus.cc:2368] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5.
I20260709 13:19:09.903636 19142 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:09.906062 19068 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:09.906843 19070 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:09.830150 21519 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.922253 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:09.871654 21336 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:09.924487 19218 rpcz_store.cc:276] 0709 13:19:07.457073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.568570 (+111497us) service_pool.cc:224] Handling call
0709 13:19:07.589529 (+ 20959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.583132 (+993603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.902079 (+1318947us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b540026a2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:09.902284 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165695232}
W20260709 13:19:09.921314 21603 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:19:09.916132 21523 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.915728 21576 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.941280 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:09.918375 21594 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:09.957005 19065 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
W20260709 13:19:09.957518 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 71961.4us
I20260709 13:19:09.957816 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 369) took 1282 ms. Trace:
I20260709 13:19:09.959582 19063 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:09.871380 21606 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.961474 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:09.970885 21594 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:09.965059 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:09.970110 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:09.973940 19065 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 3.
I20260709 13:19:09.974363 19064 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:09.936019 21581 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.971303 19750 rpcz_store.cc:276] 0709 13:19:08.675609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.675747 (+   138us) service_pool.cc:224] Handling call
0709 13:19:09.957663 (+1281916us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b5400522454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:09.957762 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14870912}
I20260709 13:19:09.916342 21520 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:09.974530 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 125963us
I20260709 13:19:09.975548 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:09.995232 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:09.977201 19110 leader_election.cc:400] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5.
I20260709 13:19:09.911518 21578 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.998458 19110 leader_election.cc:403] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:09.998785 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:09.921589 21477 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:09.962652 21250 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.969586 21339 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.003191 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:09.964586 21408 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:09.964535 21576 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:09.960853 21523 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.996203 21360 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:10.009213 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:10.009268 19067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 200) took 2007 ms (client timeout 1999 ms). Trace:
I20260709 13:19:10.009907 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.010530 19218 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 4.
I20260709 13:19:10.010102 19065 raft_consensus.cc:2410] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:19:10.010095 19067 rpcz_store.cc:269] 0709 13:19:08.001844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.002030 (+   186us) service_pool.cc:224] Handling call
0709 13:19:10.009102 (+2007072us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b5400209c54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:10.009205 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116519296}
I20260709 13:19:09.965951 21056 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:10.025229 21609 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:19:10.026271 21520 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.026883 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1731) took 1087 ms. Trace:
I20260709 13:19:10.027321 19138 rpcz_store.cc:276] 0709 13:19:08.939562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.701697 (+762135us) service_pool.cc:224] Handling call
0709 13:19:09.702021 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.702435 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.702476 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.703072 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.813139 (+110067us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.813180 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.813271 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.026324 (+213053us) raft_consensus.cc:1685] finished
0709 13:19:10.026343 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.026479 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":95692,"threads_started":1,"wal-append.queue_time_us":183098}
I20260709 13:19:10.028496 21477 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.028595 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.029073 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1524) took 1159 ms. Trace:
I20260709 13:19:10.029330 19065 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.013612 21519 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.030426 19215 rpcz_store.cc:276] 0709 13:19:08.869999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.771229 (+901230us) service_pool.cc:224] Handling call
0709 13:19:09.771648 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.774884 (+  3236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.774913 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.775351 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.879402 (+104051us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:09.879436 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.879495 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.028856 (+149361us) raft_consensus.cc:1685] finished
0709 13:19:10.028894 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.029022 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28053,"raft.queue_time_us":49850,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":35053,"thread_start_us":103519,"threads_started":1,"wal-append.queue_time_us":139901}
I20260709 13:19:10.031702 21191 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.032378 19215 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:19:10.033324 21578 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.034092 21458 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:10.035372 21578 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.035866 21578 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:10.015635 21557 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.541s	user 0.002s	sys 0.001s
I20260709 13:19:10.006536 21525 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.038160 21578 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.008809 21408 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.034618 19215 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.038352 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1275) took 2527 ms. Trace:
I20260709 13:19:10.010592 21360 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.019273 21339 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:10.004843 21406 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:10.039301 21561 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:10.040637 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 63769.4us
I20260709 13:19:10.044515 19065 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:10.038702 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.016690 21336 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:09.999321 21562 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.053516 21521 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.055970 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.014343 21606 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.056360 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:10.060300 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:10.011777 21575 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:10.045849 21566 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.048305 21360 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.064500 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1517) took 1555 ms. Trace:
I20260709 13:19:10.047426 19140 rpcz_store.cc:276] 0709 13:19:07.511390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.693898 (+182508us) service_pool.cc:224] Handling call
0709 13:19:07.694191 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.741859 (+ 47668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.741889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.742389 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.433952 (+691563us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:08.434007 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.434083 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.015090 (+1581007us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:10.038021 (+ 22931us) raft_consensus.cc:1685] finished
0709 13:19:10.038042 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.038272 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39184,"raft.queue_time_us":51075,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":8045440,"thread_start_us":643626,"threads_started":1,"wal-append.queue_time_us":684206}
I20260709 13:19:10.050272 21339 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:10.065189 19212 rpcz_store.cc:276] 0709 13:19:08.508670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.508821 (+   151us) service_pool.cc:224] Handling call
0709 13:19:08.509185 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.571316 (+ 62131us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:08.602959 (+ 31643us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.911048 (+308089us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.926789 (+ 15741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.926856 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.926906 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.064268 (+1137362us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b540032dcd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.064312 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.064449 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239337,"prepare.queue_time_us":107468,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":27101,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":25108,"spinlock_wait_cycles":142278912,"thread_start_us":290813,"threads_started":1,"wal-append.queue_time_us":950453}
I20260709 13:19:10.068989 19065 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:10.058884 21596 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:10.065073 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 56902.1us
W20260709 13:19:10.063055 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65109.4us
I20260709 13:19:10.070197 21408 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.070698 21056 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.058573 21406 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:10.057554 21594 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.071398 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.071959 19065 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.072207 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.074770 19215 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:10.054936 21561 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:10.070253 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:10.077559 21561 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.078523 21561 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.079547 21360 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.080674 19218 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:10.047411 21345 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.082475 21345 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.083000 21339 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.083765 21360 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.086696 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.087152 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:10.087319 19749 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.087770 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 379) took 1082 ms. Trace:
I20260709 13:19:10.088130 19749 rpcz_store.cc:276] 0709 13:19:09.005085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.100529 (+ 95444us) service_pool.cc:224] Handling call
0709 13:19:10.086551 (+986022us) spinlock_profiling.cc:243] Waited 873 us on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:10.087711 (+  1160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008448}
I20260709 13:19:10.089643 21527 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.090905 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.092468 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.093979 19069 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.045140 21576 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.097875 21212 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:10.099485 19745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 268) took 2582 ms (client timeout 1699 ms). Trace:
W20260709 13:19:10.099901 19745 rpcz_store.cc:269] 0709 13:19:07.516598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.522001 (+  5403us) service_pool.cc:224] Handling call
0709 13:19:08.455972 (+933971us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:10.099250 (+1643278us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540039b2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:10.099383 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951808640}
I20260709 13:19:10.101271 21533 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:10.101668 21533 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:10.102444 21533 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:10.104120 21553 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.737s	user 0.000s	sys 0.011s
I20260709 13:19:10.064388 21290 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:10.105355 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.115859 19065 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:10.118803 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:10.152776 21575 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:10.164551 21575 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.164958 21575 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.165328 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.166131 19065 raft_consensus.cc:2368] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:10.167011 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.167544 19065 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.171738 21620 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.250733 19065 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:10.153667 21212 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.191912 21360 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:10.071973 21406 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:10.261916 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 191178us
I20260709 13:19:10.173374 21527 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.210510 21290 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.264526 21581 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:10.277786 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.363505 21290 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.278013 21482 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.364205 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1312) took 1548 ms. Trace:
I20260709 13:19:10.283212 21616 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.287494 19069 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.288552 19067 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:19:10.303103 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 216007us
I20260709 13:19:10.210673 21345 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.352422 21250 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7.
I20260709 13:19:10.357211 21081 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.365859 21482 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.367151 21621 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:10.364934 19213 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:10.358675 21212 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:10.364473 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.355193 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.378413 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 181) took 1991 ms. Trace:
I20260709 13:19:10.371328 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:10.379572 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.377208 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:10.373952 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1526) took 1463 ms. Trace:
W20260709 13:19:10.368985 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.381875 19213 rpcz_store.cc:276] 0709 13:19:08.910597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.841362 (+930765us) service_pool.cc:224] Handling call
0709 13:19:09.841692 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.372772 (+531080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.373706 (+   934us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b5400269dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.373895 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202680064}
I20260709 13:19:10.478729 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:10.516426 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 145176us
I20260709 13:19:10.517190 19069 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:10.518179 19110 leader_election.cc:400] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:10.518615 19110 leader_election.cc:403] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:10.515923 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:10.411540 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 332881us
I20260709 13:19:10.377797 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:10.388556 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.521679 19065 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.379009 19143 rpcz_store.cc:276] 0709 13:19:08.387179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.388905 (+  1726us) service_pool.cc:224] Handling call
0709 13:19:08.410808 (+ 21903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.475914 (+ 65106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.475940 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.475979 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:08.476009 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.378199 (+1902190us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b5400220454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.378239 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.378349 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149308672}
I20260709 13:19:10.423746 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.364625 19219 rpcz_store.cc:276] 0709 13:19:08.816069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.740675 (+924606us) service_pool.cc:224] Handling call
0709 13:19:09.741119 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.842426 (+101307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.363954 (+521528us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b54001d6354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.364146 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80471936}
I20260709 13:19:10.485203 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:10.429679 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52542.3us
I20260709 13:19:10.478987 19071 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.542882 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1736) took 1440 ms. Trace:
I20260709 13:19:10.532579 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:10.546322 19065 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.358201 21513 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.543340 19071 rpcz_store.cc:276] 0709 13:19:09.102416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.102530 (+   114us) service_pool.cc:224] Handling call
0709 13:19:10.478551 (+1376021us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:10.478794 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.542630 (+ 63836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.542819 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4780416}
I20260709 13:19:10.371600 21081 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.426640 21621 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 13:19:10.554093 21481 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:10.380455 21360 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:10.557778 21081 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.557853 21360 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.450927 21408 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:10.562987 21620 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5.
I20260709 13:19:10.383884 21250 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:10.564766 21250 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.529258 21477 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.573271 21477 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.575946 21477 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.577646 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.363507 21581 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:10.552040 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.426487 21523 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.579469 21081 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.579945 21081 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.451193 21482 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:10.581333 19071 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:10.581220 21482 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.582017 21081 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.582326 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.583391 21482 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.583659 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.584080 21482 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.584415 19071 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.499351 21339 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.374853 21212 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.514552 21628 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.167s
I20260709 13:19:10.427023 21616 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.163s
I20260709 13:19:10.366425 21527 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.370931 21345 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.604538 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.629624 19069 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.596689 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.631215 19213 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.633213 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:10.576586 21477 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:10.545951 21606 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:10.580652 21523 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.460736 21623 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.554139 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.645190 19071 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:10.646420 19065 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.552920 21622 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.647373 21212 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.647760 21477 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.653861 21524 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.654064 21527 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.654863 21477 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.655020 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1527) took 1671 ms. Trace:
I20260709 13:19:10.584681 21482 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.655411 19218 rpcz_store.cc:276] 0709 13:19:08.983294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.018822 (+1035528us) service_pool.cc:224] Handling call
0709 13:19:10.019242 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.081037 (+ 61795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.654809 (+573772us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b540034a8d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.654969 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140669824}
I20260709 13:19:10.657287 21482 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.658288 21250 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:10.591933 21081 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:19:10.555214 21513 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.657383 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1508) took 2840 ms. Trace:
I20260709 13:19:10.649063 21210 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:19:10.663738 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.586467 21598 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:10.661207 19220 rpcz_store.cc:276] 0709 13:19:07.817001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.400200 (+583199us) service_pool.cc:224] Handling call
0709 13:19:08.418222 (+ 18022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.568066 (+149844us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:08.913190 (+345124us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.289111 (+375921us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.289175 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.289232 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.657186 (+1367954us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002693d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.657229 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.657334 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":358973,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":206431,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":343923968,"thread_start_us":500052,"threads_started":2,"wal-append.queue_time_us":640303,"wal-append.run_cpu_time_us":1063,"wal-append.run_wall_time_us":1002228}
I20260709 13:19:10.656567 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.649552 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1521) took 1920 ms. Trace:
I20260709 13:19:10.669277 19214 rpcz_store.cc:276] 0709 13:19:08.729243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.785542 (+ 56299us) service_pool.cc:224] Handling call
0709 13:19:08.785826 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.863266 (+1077440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.649222 (+785956us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400073fd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.649413 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444433664}
I20260709 13:19:10.650749 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1744) took 1365 ms. Trace:
I20260709 13:19:10.648082 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.671859 19213 raft_consensus.cc:2393] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.664677 19069 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
W20260709 13:19:10.650592 21558 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 2.276s	user 0.000s	sys 0.026s
I20260709 13:19:10.368841 21575 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.672333 19068 rpcz_store.cc:276] 0709 13:19:09.285454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.349951 (+ 64497us) service_pool.cc:224] Handling call
0709 13:19:10.650596 (+1300645us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400353ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:10.650696 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216406912}
I20260709 13:19:10.675611 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.676005 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.662533 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.677342 19071 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:10.678303 19067 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:10.678413 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1499) took 1124 ms. Trace:
I20260709 13:19:10.678956 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.674108 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1501) took 1022 ms. Trace:
I20260709 13:19:10.682029 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:10.682668 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.683056 19218 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.683442 19065 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:10.675524 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.684974 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.685760 19213 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:10.681840 19069 rpcz_store.cc:276] 0709 13:19:09.652168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.643603 (+991435us) service_pool.cc:224] Handling call
0709 13:19:10.674038 (+ 30435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.686897 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1493) took 1136 ms. Trace:
I20260709 13:19:10.650575 21345 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.684209 19068 rpcz_store.cc:276] 0709 13:19:09.552471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.675806 (+1123335us) service_pool.cc:224] Handling call
0709 13:19:10.676599 (+   793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.688210 19071 rpcz_store.cc:276] 0709 13:19:09.550707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.662224 (+1111517us) service_pool.cc:224] Handling call
0709 13:19:10.686835 (+ 24611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.693571 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.667876 21598 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:10.696617 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:10.701084 19220 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.701647 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.650671 21606 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.703492 19213 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:10.702590 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.705657 19068 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:10.707288 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1488) took 1227 ms. Trace:
I20260709 13:19:10.707759 19068 rpcz_store.cc:276] 0709 13:19:09.479541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.702308 (+1222767us) service_pool.cc:224] Handling call
0709 13:19:10.707219 (+  4911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.686487 21212 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:10.709707 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 247080us
I20260709 13:19:10.709852 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.710836 19069 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:10.652024 21622 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.712301 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.713248 19068 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:10.714103 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.714728 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:10.715850 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1502) took 1038 ms. Trace:
I20260709 13:19:10.715866 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.716859 19071 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 3.
I20260709 13:19:10.717160 19065 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.716501 19068 rpcz_store.cc:276] 0709 13:19:09.677166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.712044 (+1034878us) service_pool.cc:224] Handling call
0709 13:19:10.715789 (+  3745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.718415 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.719285 19068 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 3. Current term is 5. Ops: [3.3-3.3]
I20260709 13:19:10.719388 19220 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.722234 19214 raft_consensus.cc:2410] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:10.722586 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1473) took 1271 ms. Trace:
I20260709 13:19:10.723071 19068 rpcz_store.cc:276] 0709 13:19:09.471180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.718681 (+1247501us) service_pool.cc:224] Handling call
0709 13:19:10.719026 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.722258 (+  3232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.722499 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.724093 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:10.725561 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 207527us
I20260709 13:19:10.726289 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:10.726507 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.727182 21616 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.727675 21616 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.728489 21339 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.728360 21598 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.729408 21598 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.729619 21616 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.729925 21513 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.709026 21523 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:10.730531 21329 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:10.731081 21329 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:10.715128 21543 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:19:10.732225 21543 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:10.731846 21329 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.732594 21543 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:10.733438 21543 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.734556 21543 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.735023 21533 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.712037 21212 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:10.730594 21523 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.737355 21523 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:10.737581 21212 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.738237 21622 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.738806 21212 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.739034 21516 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:10.739426 21516 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:10.740192 21516 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.741349 21516 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.741568 21420 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.742082 21420 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:10.728634 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.749718 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.749919 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.750437 19142 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:10.750614 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.751155 19147 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.752992 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.754947 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.754853 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.755089 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.755894 19141 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:10.745849 21481 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:10.764597 19065 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.753361 21339 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.753400 21628 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:10.767628 19069 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:10.777681 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:10.778007 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 51796.2us
I20260709 13:19:10.778405 19065 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:10.748224 21329 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.779114 21632 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:10.779338 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1304) took 2270 ms. Trace:
I20260709 13:19:10.779731 21632 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:10.779759 19221 rpcz_store.cc:276] 0709 13:19:08.509360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.544048 (+ 34688us) service_pool.cc:224] Handling call
0709 13:19:08.571001 (+ 26953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.693311 (+122310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.779111 (+2085800us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400268ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.779283 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234102528}
I20260709 13:19:10.779281 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:10.782815 19065 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:10.784857 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.782325 19147 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.785573 19143 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.788522 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:10.790057 19141 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:10.767254 21481 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.769835 21527 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.791754 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.770105 21408 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:10.793354 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:10.785140 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.796028 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 91806.1us
I20260709 13:19:10.794122 19140 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:10.796007 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.797709 19147 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.780452 21339 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.798477 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.800910 19143 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:10.803303 19065 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 7. Ops: []
I20260709 13:19:10.803804 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1478) took 1331 ms. Trace:
I20260709 13:19:10.804047 19065 rpcz_store.cc:276] 0709 13:19:09.472670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.795509 (+1322839us) service_pool.cc:224] Handling call
0709 13:19:10.803194 (+  7685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.803642 (+   448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.803767 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.794167 21481 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.780741 21628 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.810248 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.811033 21575 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.811161 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.845517 19143 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:10.811237 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.811919 21635 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:10.813004 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:10.814072 19147 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:10.821360 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.823612 21339 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.824906 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.848008 19144 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:10.828016 21523 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.828589 21408 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:10.829478 19065 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:10.832037 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.799577 21622 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:10.852010 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1479) took 1379 ms. Trace:
I20260709 13:19:10.798448 21621 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:10.853132 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.853607 21635 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:10.854483 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.852293 21622 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.855526 21622 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.833741 21606 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.798058 21527 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.835093 21420 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.837762 19218 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:10.838311 21349 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.839918 21589 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.839931 21514 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.806869 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.900746 19141 raft_consensus.cc:2376] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7. Re-sending same reply.
I20260709 13:19:10.856619 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1739) took 1752 ms. Trace:
I20260709 13:19:10.857089 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.852505 19065 rpcz_store.cc:276] 0709 13:19:09.477150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.804573 (+1327423us) service_pool.cc:224] Handling call
0709 13:19:10.829258 (+ 24685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.851687 (+ 22429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.851938 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:10.897511 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 84646.5us
I20260709 13:19:10.896148 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.905216 19750 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
W20260709 13:19:10.897179 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.899125 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.906930 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.902786 19072 rpcz_store.cc:276] 0709 13:19:09.104446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.163149 (+ 58703us) service_pool.cc:224] Handling call
0709 13:19:09.329399 (+166250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.770835 (+441436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.770865 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.771322 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.872484 (+101162us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.872611 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.856249 (+983638us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540017ded4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:10.856296 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.856342 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:10.856355 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.856565 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2276,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":991645312,"thread_start_us":96919,"threads_started":1,"wal-append.queue_time_us":150715}
I20260709 13:19:10.916368 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:10.906519 19138 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:10.918303 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.918764 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:10.919018 19218 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.919970 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:10.920543 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 120087us
I20260709 13:19:10.902704 21628 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.922873 19748 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:10.923286 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 126328us
I20260709 13:19:10.924182 19065 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:19:10.924844 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1484) took 1446 ms. Trace:
I20260709 13:19:10.925163 19065 rpcz_store.cc:276] 0709 13:19:09.478480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.904679 (+1426199us) service_pool.cc:224] Handling call
0709 13:19:10.923910 (+ 19231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.924622 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.924794 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.870955 19742 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:19:10.896760 19744 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:10.926918 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:10.935037 19214 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.927189 19072 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.925467 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:10.927654 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:10.936154 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1485) took 1457 ms. Trace:
I20260709 13:19:10.936475 19072 rpcz_store.cc:276] 0709 13:19:09.478786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.908409 (+1429623us) service_pool.cc:224] Handling call
0709 13:19:10.927014 (+ 18605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.935940 (+  8926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.936105 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:10.924175 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.895819 21339 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.855787 21635 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.870052 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.932329 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.930871 19742 pending_rounds.cc:85] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 5
I20260709 13:19:10.934183 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:10.943590 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.943974 19065 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:19:10.944763 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1486) took 1465 ms. Trace:
I20260709 13:19:10.945143 19065 rpcz_store.cc:276] 0709 13:19:09.479048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.933226 (+1454178us) service_pool.cc:224] Handling call
0709 13:19:10.943686 (+ 10460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.944467 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.944705 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.946668 19065 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:10.947278 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1490) took 1465 ms. Trace:
I20260709 13:19:10.947638 19065 rpcz_store.cc:276] 0709 13:19:09.481778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.945987 (+1464209us) service_pool.cc:224] Handling call
0709 13:19:10.946318 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.947039 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.947223 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.938205 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.940080 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:10.940666 19750 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:10.923974 21514 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.928121 21420 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:10.927922 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:10.927171 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:10.857502 21632 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.952255 21427 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:10.943261 19742 pending_rounds.cc:107] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:19:10.959462 21523 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:10.972275 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:10.972470 21482 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:10.972926 19743 raft_consensus.cc:2376] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7. Re-sending same reply.
I20260709 13:19:10.972922 21482 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.973982 21482 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.974134 19743 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.962339 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:10.975667 19744 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:10.965974 19745 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.975960 21569 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:10.952251 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.975965 19742 raft_consensus.cc:2889] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.932840 21636 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:10.966105 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:10.925707 21547 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:10.968868 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:10.983359 19751 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:10.983733 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1748) took 1118 ms. Trace:
I20260709 13:19:10.971235 19065 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:19:10.938068 21633 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:19:10.940992 21598 consensus_queue.cc:1059] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:19:10.985271 19146 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:10.984217 19067 rpcz_store.cc:276] 0709 13:19:09.865039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.375448 (+510409us) service_pool.cc:224] Handling call
0709 13:19:10.983548 (+608100us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400209754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:10.983667 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353015040}
W20260709 13:19:10.971992 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44140.6us
I20260709 13:19:10.933707 21589 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:19:11.003036 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:10.978171 19141 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:10.978262 19142 raft_consensus.cc:2410] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:10.978858 19742 pending_rounds.cc:107] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:10.962898 21574 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:11.005327 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1492) took 1454 ms. Trace:
I20260709 13:19:11.005815 19065 rpcz_store.cc:276] 0709 13:19:09.550433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.948462 (+1398029us) service_pool.cc:224] Handling call
0709 13:19:10.970973 (+ 22511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.004999 (+ 34026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.005247 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.959887 21481 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:10.966235 21420 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.968911 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.016170 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:11.016492 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:11.017750 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 48930.7us
I20260709 13:19:11.017961 19141 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:11.019127 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.020008 19141 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:10.980064 21636 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.028466 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1497) took 1476 ms. Trace:
I20260709 13:19:11.028618 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:11.029209 19067 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.028915 19065 rpcz_store.cc:276] 0709 13:19:09.551919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.006878 (+1454959us) service_pool.cc:224] Handling call
0709 13:19:11.027916 (+ 21038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.028079 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.028104 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.028146 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.028179 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.028300 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.028410 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.030920 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.032246 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.025533 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:11.038911 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:11.043437 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:11.044185 19751 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:11.007529 19742 raft_consensus.cc:2889] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.990142 21527 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:11.048321 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.050696 19141 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:11.049602 19747 raft_consensus.cc:2368] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5.
I20260709 13:19:11.051445 19065 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:10.966387 21514 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.052239 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1500) took 1499 ms. Trace:
I20260709 13:19:11.007525 21574 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:10.995954 19745 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:11.051550 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:11.065668 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 128652us
I20260709 13:19:11.066087 19141 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.066591 21598 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:11.066854 21523 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:11.067580 21598 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:11.067744 21514 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.067981 21598 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:11.027518 21349 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.027690 21360 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:11.052724 19065 rpcz_store.cc:276] 0709 13:19:09.552791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.030192 (+1477401us) service_pool.cc:224] Handling call
0709 13:19:11.051186 (+ 20994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.051938 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.052174 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.025424 21420 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.040516 21477 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:11.039635 21636 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.081279 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1475) took 1609 ms. Trace:
I20260709 13:19:10.985394 21547 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.082597 19067 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:11.083693 19141 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:11.079504 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:11.084760 19070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1477) took 1612 ms (client timeout 1593 ms). Trace:
W20260709 13:19:11.126149 19070 rpcz_store.cc:269] 0709 13:19:09.472378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.761477 (+289099us) service_pool.cc:224] Handling call
0709 13:19:11.084587 (+1323110us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54002cbd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:11.084690 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52928256}
I20260709 13:19:11.127503 19065 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:10.984639 21622 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.128132 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1738) took 2024 ms. Trace:
I20260709 13:19:11.068660 21523 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:19:11.122901 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.042629 21606 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.084445 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:11.125029 19069 rpcz_store.cc:276] 0709 13:19:09.471839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.723551 (+1251712us) service_pool.cc:224] Handling call
0709 13:19:10.767388 (+ 43837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.770311 (+  2923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.081101 (+310790us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5400057650. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:11.081224 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38806784}
I20260709 13:19:11.077255 21574 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.131954 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.146575 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.147207 19141 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:11.148661 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.128515 19066 rpcz_store.cc:276] 0709 13:19:09.104124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.104252 (+   128us) service_pool.cc:224] Handling call
0709 13:19:09.329399 (+225147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.796134 (+466735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.127935 (+1331801us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54001b9754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:11.128080 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935926912}
I20260709 13:19:11.140353 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1745) took 1353 ms. Trace:
I20260709 13:19:11.150164 19065 rpcz_store.cc:276] 0709 13:19:09.787395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.088093 (+1300698us) service_pool.cc:224] Handling call
0709 13:19:11.127344 (+ 39251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.127869 (+   525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.140278 (+ 12409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.150779 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.086476 21349 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.027318 21569 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:19:11.177686 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.114625 21360 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:11.186138 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.187407 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.187668 19065 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:11.188208 19141 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:11.188452 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1508) took 1187 ms. Trace:
I20260709 13:19:11.187701 19138 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:11.189316 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.167826 19750 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:11.179512 19067 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:11.188953 19065 rpcz_store.cc:276] 0709 13:19:10.001466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.151084 (+1149618us) service_pool.cc:224] Handling call
0709 13:19:11.187390 (+ 36306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.188174 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.188391 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.191038 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1746) took 1397 ms. Trace:
I20260709 13:19:11.191506 19067 rpcz_store.cc:276] 0709 13:19:09.793320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.125859 (+1332539us) service_pool.cc:224] Handling call
0709 13:19:11.179292 (+ 53433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.190726 (+ 11434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.190978 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.192446 19069 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:11.190145 19141 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
W20260709 13:19:11.193564 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.193079 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1506) took 1199 ms. Trace:
I20260709 13:19:11.194169 19069 rpcz_store.cc:276] 0709 13:19:09.993965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.145590 (+1151625us) service_pool.cc:224] Handling call
0709 13:19:11.192148 (+ 46558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.192845 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.193029 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.194271 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.196305 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:11.196844 19141 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:11.197773 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.207515 19066 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:11.214951 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.215669 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1507) took 1217 ms. Trace:
I20260709 13:19:11.216177 19066 rpcz_store.cc:276] 0709 13:19:09.997749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.150225 (+1152476us) service_pool.cc:224] Handling call
0709 13:19:11.195432 (+ 45207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.207995 (+ 12563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.215593 (+  7598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.166392 21606 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.216583 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.125514 21576 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.179150 21349 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.219790 19069 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:11.219274 19141 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:11.131184 21477 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:11.223075 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.226320 19141 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:11.226755 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.227043 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.227595 19141 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:11.228343 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.196480 21360 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.232993 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:11.231220 19066 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:11.237648 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 158195us
I20260709 13:19:11.114391 21598 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.240525 19065 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:11.237885 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.179121 21648 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:19:11.230760 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.240921 19065 pending_rounds.cc:85] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 3
I20260709 13:19:11.219583 21606 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.242309 19065 pending_rounds.cc:107] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:11.242599 19065 raft_consensus.cc:2889] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.243223 19141 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:11.246371 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.247978 19141 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:11.249981 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.251331 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1509) took 1246 ms. Trace:
I20260709 13:19:11.251817 19067 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:11.251770 19065 rpcz_store.cc:276] 0709 13:19:10.004199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.191689 (+1187490us) service_pool.cc:224] Handling call
0709 13:19:11.240210 (+ 48521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.243003 (+  2793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.250729 (+  7726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.253772 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.254671 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:11.255683 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:11.227630 21576 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.257416 21658 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.258128 21658 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:11.258522 21658 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:11.258265 21523 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:11.259537 21658 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.261155 21658 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.263300 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.263777 19138 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:11.264825 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.266454 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.267529 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.269366 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.270443 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.270784 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.271500 21427 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:11.272234 21547 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.271543 21477 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:11.280484 21653 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:19:11.281044 21481 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.285279 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:11.285458 21648 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.285831 21081 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:11.286758 21622 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.288033 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:11.288970 21642 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:19:11.289147 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:11.289912 21651 log.cc:927] Time spent T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:11.290668 21636 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.292250 21633 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.265341 21521 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:11.293135 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1482) took 1815 ms. Trace:
I20260709 13:19:11.265470 21527 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.293478 21420 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.293987 21589 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.295773 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:11.299127 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:11.299618 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.302067 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.302693 19065 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:11.305423 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:11.260717 21523 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:11.304831 21561 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:11.333519 21561 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.333936 21561 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.334712 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.335476 19145 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 4: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:11.336280 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.310451 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1489) took 1829 ms. Trace:
I20260709 13:19:11.337047 19072 rpcz_store.cc:276] 0709 13:19:09.481520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.937178 (+1455658us) service_pool.cc:224] Handling call
0709 13:19:10.950934 (+ 13756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.951348 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.951387 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.965440 (+ 14053us) log.cc:844] Serialized 52 byte log entry
0709 13:19:11.037728 (+ 72288us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.039105 (+  1377us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.042600 (+  3495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.042697 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.310237 (+267540us) raft_consensus.cc:1685] finished
0709 13:19:11.310261 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.310398 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2678,"prepare.queue_time_us":312,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":4755,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":14558,"thread_start_us":29775,"threads_started":1,"wal-append.queue_time_us":55330}
I20260709 13:19:11.306213 21427 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:11.339133 21420 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.339495 21427 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.322244 21589 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.340597 21589 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.341586 21513 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:11.300112 21210 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.315531 19147 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.316006 19138 raft_consensus.cc:2410] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:19:11.317559 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.320165 19063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1742) took 2109 ms (client timeout 1704 ms). Trace:
W20260709 13:19:11.354229 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.353794 19063 rpcz_store.cc:269] 0709 13:19:09.210794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.210918 (+   124us) service_pool.cc:224] Handling call
0709 13:19:09.775721 (+564803us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:11.319972 (+1544251us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400123ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:11.320095 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286597376}
I20260709 13:19:11.321532 19064 rpcz_store.cc:276] 0709 13:19:09.477954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.840816 (+1362862us) service_pool.cc:224] Handling call
0709 13:19:10.843223 (+  2407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.843630 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.843668 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.849988 (+  6320us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.053468 (+203480us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:11.053523 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.053612 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.292942 (+239330us) raft_consensus.cc:1685] finished
0709 13:19:11.292962 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.293079 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22584,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":24270,"thread_start_us":128318,"threads_started":1,"wal-append.queue_time_us":321727}
I20260709 13:19:11.320552 19068 pending_rounds.cc:85] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 5
I20260709 13:19:11.355225 19068 pending_rounds.cc:107] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:19:11.355494 19068 raft_consensus.cc:2889] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:11.319123 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 86234.6us
I20260709 13:19:11.323930 19216 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.355417 21210 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.357903 21513 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:11.358125 21210 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.323939 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.320864 21482 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.361712 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.362106 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1520) took 2677 ms. Trace:
I20260709 13:19:11.362774 21482 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.364440 21212 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.364909 21212 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.364717 21574 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.365358 21212 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.366405 21345 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:11.366772 21574 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.366926 21345 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.367377 21574 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.367803 21574 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.368284 21574 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.304499 21408 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:11.315984 21081 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.369158 21408 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:11.369211 21081 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.362497 19217 rpcz_store.cc:276] 0709 13:19:08.684353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.737299 (+ 52946us) service_pool.cc:224] Handling call
0709 13:19:08.788385 (+ 51086us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:08.842321 (+ 53936us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:09.114740 (+272419us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.805123 (+690383us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:09.821721 (+ 16598us) log.cc:844] Serialized 52 byte log entry
0709 13:19:09.822062 (+   341us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.822850 (+   788us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.361498 (+1538648us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b18003bc2c0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f6103140d70 00007f6103134293 00007f6103129cea 00007f610312a23a 00007f6103594a2a 00007f61035a40bf 00007f61035a4038
0709 13:19:11.361726 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.361805 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.361916 (+   111us) raft_consensus.cc:1685] finished
0709 13:19:11.361932 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.362053 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1586976,"prepare.queue_time_us":72480,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":23559,"raft.queue_time_us":218874,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":37191,"spinlock_wait_cycles":180843392,"thread_start_us":683300,"threads_started":3,"wal-append.queue_time_us":520549}
I20260709 13:19:11.369580 21408 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:11.369832 21458 raft_consensus.cc:3055] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:11.320295 21349 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.330384 21636 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.330945 19218 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:11.331670 21576 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:11.332952 21477 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:11.403718 21477 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:11.341348 21561 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.322400 21633 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.415012 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:11.415761 19064 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.312013 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.343235 19212 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:11.342725 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1747) took 1546 ms. Trace:
I20260709 13:19:11.419472 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.418855 19070 rpcz_store.cc:276] 0709 13:19:09.796100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.127061 (+1330961us) service_pool.cc:224] Handling call
0709 13:19:11.127445 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.127823 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.127866 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.166856 (+ 38990us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.301592 (+134736us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.301631 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.301693 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.341730 (+ 40037us) raft_consensus.cc:1685] finished
0709 13:19:11.341754 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.342440 (+   686us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":46288,"thread_start_us":69677,"threads_started":1,"wal-append.queue_time_us":121022}
I20260709 13:19:11.344350 21606 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.345114 21521 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:11.425661 21521 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.425917 21574 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.316380 19742 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:11.350451 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.435262 19141 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:11.435434 19146 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:19:11.435959 19146 pending_rounds.cc:85] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 5
I20260709 13:19:11.436244 19146 pending_rounds.cc:107] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:19:11.436532 19146 raft_consensus.cc:2889] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.324524 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:11.367859 21210 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.325877 21562 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:11.429585 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.336194 21360 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.375161 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:11.370263 21458 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:11.351444 21523 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.377086 19216 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:11.379621 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.379719 21661 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:11.380990 21622 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:11.383893 21212 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.376039 21408 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.378314 21594 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:11.386508 21081 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.404608 21477 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.388948 19066 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 9. Ops: []
I20260709 13:19:11.357139 21547 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:11.394891 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.396090 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:08.740737 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:11.398351 19144 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:11.402879 21589 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.421542 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:11.508353 19219 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:11.422204 21482 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.378744 21513 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.422546 21420 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:11.424160 21633 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:11.433033 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.445523 19220 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:11.372622 19147 raft_consensus.cc:2410] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:19:11.539849 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 106891us
I20260709 13:19:11.540989 19147 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:11.542011 21569 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.542236 19147 raft_consensus.cc:1217] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Deduplicated request from leader. Original: 3.2->[4.3-5.4]   Dedup: 4.3->[5.4-5.4]
I20260709 13:19:11.542718 19147 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:19:11.448175 21574 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.544193 19146 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:11.436686 21427 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:19:11.449779 19071 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.459074 19750 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:11.459679 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:11.545982 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 86375.8us
I20260709 13:19:11.463820 21458 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:11.465358 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 140869us
I20260709 13:19:11.549242 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:11.494473 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.388327 21349 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.511125 21210 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.511160 21081 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.495846 21561 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.537582 21482 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.554591 21482 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.551924 19216 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:11.555243 21482 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.555871 21482 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.541334 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.557408 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.557502 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:11.557838 21210 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.558079 19744 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.558175 19750 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:11.559517 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.560086 19038 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.560788 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.560820 21210 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.564281 21633 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:11.564762 21633 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.566088 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.566663 21633 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:11.514169 21562 consensus_queue.cc:1243] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:11.567212 21633 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:11.567646 21633 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.568131 21423 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:11.568514 21423 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.568835 21423 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.570624 21360 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.507386 21406 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:11.572427 19064 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:11.514647 21575 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:19:11.505365 21658 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:11.573465 21514 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:11.566766 19220 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:11.519644 19219 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:11.580307 19071 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:11.573478 21575 consensus_queue.cc:1243] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:11.576578 21594 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:11.508766 21547 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.594951 19751 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:11.595383 19751 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:11.582697 21406 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:11.547866 21420 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.612394 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.613641 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.614605 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:11.615340 21423 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.599606 21594 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:11.617125 19744 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:11.622634 19138 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:11.622004 21594 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.623083 21423 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.625046 19751 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.626065 21212 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.626245 19751 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.628103 21633 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:11.630000 21606 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:11.632771 21547 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:11.639047 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.639281 21569 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:11.640942 21589 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.641353 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.642144 19221 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:11.642936 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.643563 19221 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:11.644199 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.645924 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.647300 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:11.647053 21406 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.648452 21622 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:11.649111 21250 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:11.617197 21458 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.649554 21250 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:11.649883 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.650699 19220 raft_consensus.cc:2410] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:11.651469 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.650033 21250 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:11.652130 19035 leader_election.cc:336] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Timed out: RequestConsensusVote RPC to 127.17.139.4:42525 timed out after 1.699s (SENT)
I20260709 13:19:11.655678 19038 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.655766 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:11.620745 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.656865 19750 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:11.656926 19064 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:11.659224 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.656374 19220 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:11.660624 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.667477 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.668023 19750 raft_consensus.cc:2376] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7. Re-sending same reply.
I20260709 13:19:11.668169 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:11.669632 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:11.677738 19035 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.697463 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.698297 19221 raft_consensus.cc:2410] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:11.699599 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:11.700891 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:11.704185 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.704975 19063 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:11.656196 21547 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:11.714322 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.722576 21210 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:11.722846 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.697996 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.723839 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:11.724536 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65477.4us
I20260709 13:19:11.725404 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.726223 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.726784 19063 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:11.727581 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.728109 19063 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:11.728600 19217 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:11.728962 19217 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:11.657533 21589 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.718469 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:11.718856 19035 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.4:42525 timed out after 1.562s (SENT) [suppressed 26 similar messages]
I20260709 13:19:11.730329 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:11.719007 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.698702 21562 raft_consensus.cc:2764] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:11.717334 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.724431 21606 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:11.720219 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.734840 19064 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:11.700007 21212 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:11.724778 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:11.660353 21088 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:19:11.715306 21569 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.771981 19065 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:11.716495 21329 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.663769 21544 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:19:11.663388 21514 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:19:11.721712 21482 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.662802 21622 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.717694 21360 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.768271 19217 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.792915 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:11.731412 21081 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.773340 19751 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:11.731312 21574 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:11.824031 21420 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:11.802892 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.717825 21427 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.737079 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.717418 21672 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.731153 21349 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:11.824802 19221 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:11.824947 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:11.729983 21561 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:11.842909 19063 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:11.843047 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 106038us
I20260709 13:19:11.828785 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.812811 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:11.845340 19067 raft_consensus.cc:2376] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5. Re-sending same reply.
I20260709 13:19:11.734041 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:11.845762 19217 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.729358 21666 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.857586 19065 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:11.842414 21427 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.864063 19746 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:11.903214 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 276) took 1050 ms. Trace:
I20260709 13:19:11.903718 19746 rpcz_store.cc:276] 0709 13:19:10.853225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.871144 (+ 17919us) service_pool.cc:224] Handling call
0709 13:19:11.394728 (+523584us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:11.903122 (+508394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7101184}
I20260709 13:19:11.842537 21514 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:11.905079 21514 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:11.906100 21514 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.907588 21514 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.827282 21406 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:11.909837 19745 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:11.843146 21423 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:11.869688 19217 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:11.873199 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:11.917694 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 260702us
I20260709 13:19:11.878041 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:11.821291 21329 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.883158 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:11.888414 21664 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:19:11.894483 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.937198 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:11.884721 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.897704 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1746) took 1145 ms. Trace:
W20260709 13:19:11.869347 21668 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:11.939260 19142 rpcz_store.cc:276] 0709 13:19:10.752499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.752689 (+   190us) service_pool.cc:224] Handling call
0709 13:19:11.897455 (+1144766us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540017acd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:11.897630 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515863936}
I20260709 13:19:11.925266 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.968845 19072 raft_consensus.cc:2376] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5. Re-sending same reply.
I20260709 13:19:11.843797 21672 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:11.930702 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.974066 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:11.974961 19219 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:11.809728 21569 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.944332 21212 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:11.917512 19743 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.917716 21423 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:11.793853 21547 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 13:19:11.862583 21666 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.921586 21427 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.962738 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:11.735973 21589 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:11.965471 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:12.019879 19217 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:11.828059 21081 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:11.970724 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:12.021377 19216 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:12.022399 21081 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:11.933367 21088 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:19:11.846979 21513 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:11.991616 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:12.013649 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.969998 21210 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:11.943033 21458 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:12.032929 19221 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:12.016824 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:11.963187 21544 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:19:12.020545 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:12.034263 19067 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:12.023818 19070 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:11.976897 21672 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.032065 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:12.038196 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:12.038657 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:12.039337 19143 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.039438 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:12.040182 19139 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.036777 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:12.041355 19142 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.036718 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:12.042574 19067 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:12.053830 19213 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:12.057370 19216 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:12.020607 21666 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.065125 21683 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:12.065999 21689 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:12.036278 21458 consensus_queue.cc:1243] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:12.019941 21684 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 13:19:12.106930 21682 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:19:12.107662 21576 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:19:12.093048 21675 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:19:12.061415 21423 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.127671 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:12.127421 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 190311us
I20260709 13:19:12.129448 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:12.136931 19063 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 4.
I20260709 13:19:12.137843 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:12.144899 19142 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:12.146217 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:12.146889 19142 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.136507 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:12.152379 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:12.153537 19071 raft_consensus.cc:2410] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:12.152714 19143 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:12.155829 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:12.157789 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:12.158696 19063 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:12.133067 21349 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:12.178339 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 247514us
I20260709 13:19:12.175905 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:12.180737 19071 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:12.181517 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:12.182366 19071 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:12.133096 21547 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.183334 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:12.184080 19063 raft_consensus.cc:2368] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:12.176790 19142 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:12.177631 19067 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:12.148684 21574 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.185308 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:12.185773 19067 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:12.185940 19142 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.185355 19063 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:12.187242 19067 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:12.187561 19067 pending_rounds.cc:85] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 3
I20260709 13:19:12.187780 19067 pending_rounds.cc:107] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:12.187987 19067 raft_consensus.cc:2889] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.190217 19063 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:12.195182 19071 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:12.197566 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 182605us
I20260709 13:19:12.199118 19142 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:12.200412 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:12.203202 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:12.148463 21210 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:12.205228 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:12.209661 21210 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:12.210280 21210 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:12.211328 21210 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.213277 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:12.213987 21622 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:12.214265 21513 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:12.214454 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:12.214787 21569 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:12.215574 21569 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:12.206234 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 208) took 1237 ms. Trace:
I20260709 13:19:12.222975 19141 rpcz_store.cc:276] 0709 13:19:10.968721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.438158 (+469437us) service_pool.cc:224] Handling call
0709 13:19:11.444664 (+  6506us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.450117 (+  5453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.450145 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:11.460311 (+ 10166us) log.cc:844] Serialized 52 byte log entry
0709 13:19:11.746691 (+286380us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:11.746745 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.746835 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.206032 (+459197us) raft_consensus.cc:1685] finished
0709 13:19:12.206051 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.206177 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4201,"raft.queue_time_us":165,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4700,"thread_start_us":285947,"threads_started":1,"wal-append.queue_time_us":416763}
I20260709 13:19:12.224954 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:12.226168 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:12.178908 21329 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:12.226331 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:12.226536 21697 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:12.227205 21697 consensus_queue.cc:1243] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:12.176687 21692 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:12.228490 21692 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:12.216051 21569 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:12.207115 21212 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.214836 21513 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:12.229408 21692 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.229765 21569 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.230141 21513 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:12.231174 21669 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.609s	user 0.001s	sys 0.000s
I20260709 13:19:12.217679 21589 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:12.219055 19142 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:12.149051 21690 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
W20260709 13:19:12.222218 21250 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 13:19:12.242700 21250 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.221279 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:12.237141 21606 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:12.238996 19218 raft_consensus.cc:1217] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-7.8]   Dedup: 3.6->[5.7-7.8]
I20260709 13:19:12.190589 21191 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:12.232275 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 202) took 1290 ms. Trace:
I20260709 13:19:12.262012 19218 pending_rounds.cc:85] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:12.265859 19218 pending_rounds.cc:107] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:12.266232 19218 raft_consensus.cc:2889] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.237555 19743 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:12.264125 19145 rpcz_store.cc:276] 0709 13:19:10.941901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.362979 (+421078us) service_pool.cc:224] Handling call
0709 13:19:11.363270 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.363595 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.363618 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.377656 (+ 14038us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.581374 (+203718us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:11.581428 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.581513 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.230618 (+649105us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:12.231985 (+  1367us) raft_consensus.cc:1685] finished
0709 13:19:12.232005 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.232217 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1948,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":52,"spinlock_wait_cycles":77993728,"thread_start_us":132074,"threads_started":1,"wal-append.queue_time_us":215947}
I20260709 13:19:12.191416 21574 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.190861 21547 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.316200 19143 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.289006 21606 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.277446 21272 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 13:19:12.341759 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 127422us
I20260709 13:19:12.278606 21690 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:12.347534 19141 raft_consensus.cc:2410] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:19:12.358079 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:12.261402 21576 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:19:12.277649 21622 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:19:12.364416 21561 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.367586 21576 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:12.367973 21349 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:12.368788 21589 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:12.373380 21606 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:12.388767 19139 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:12.363035 21458 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:12.390695 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1324) took 1150 ms. Trace:
I20260709 13:19:12.363636 21690 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:12.404971 19219 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:12.390125 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:12.429191 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:12.413298 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:12.429581 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.415297 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 210) took 1824 ms. Trace:
I20260709 13:19:12.431377 19066 rpcz_store.cc:276] 0709 13:19:10.590502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.237906 (+647404us) service_pool.cc:224] Handling call
0709 13:19:11.238138 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.506249 (+268111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.415018 (+908769us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540025d854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:12.415226 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346299136}
I20260709 13:19:12.417375 19063 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:12.408041 21349 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:12.401021 21561 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.408394 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:12.401489 19143 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:12.423830 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.393738 21576 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:19:12.407222 21339 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:19:12.427359 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:12.449507 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.455365 19215 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.389715 21598 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.437829 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:12.434940 19220 pending_rounds.cc:85] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:19:12.456863 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:12.420423 19146 rpcz_store.cc:276] 0709 13:19:11.240595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.697374 (+456779us) service_pool.cc:224] Handling call
0709 13:19:11.697676 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.861631 (+163955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.861677 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:11.919763 (+ 58086us) log.cc:844] Serialized 52 byte log entry
0709 13:19:12.127745 (+207982us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:12.152151 (+ 24406us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.152450 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.152640 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.152711 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.243656 (+ 90945us) raft_consensus.cc:1685] finished
0709 13:19:12.243674 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.390636 (+146962us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72004,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":5086,"raft.queue_time_us":182104,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":39809,"spinlock_wait_cycles":13136768,"thread_start_us":279952,"threads_started":2,"wal-append.queue_time_us":237106}
I20260709 13:19:12.448565 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.458446 19221 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.447136 19213 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:12.448746 19035 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:12.447798 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.460031 19219 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.453444 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.457435 19220 pending_rounds.cc:107] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:19:12.461112 19220 raft_consensus.cc:2889] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.433748 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:12.407290 21616 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.464197 19138 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:12.477914 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.480358 19212 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:12.482306 19219 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:12.419793 21458 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:12.453241 21212 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:12.445914 21701 raft_consensus.cc:2764] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:12.485661 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:12.484941 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:12.468068 21524 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:12.493693 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:12.494422 19216 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:12.476393 21527 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.479897 21696 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.490415 21458 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:12.512549 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.502087 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:12.521001 21622 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:12.524789 21458 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:12.525825 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.476208 21616 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:12.526266 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.543967 21622 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:12.517809 21696 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:12.586740 19748 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:12.500636 21704 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:19:12.543134 21250 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:12.644445 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 167768us
W20260709 13:19:12.646616 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 208882us
I20260709 13:19:12.647032 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:12.634234 21672 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.577s	user 0.017s	sys 0.004s
I20260709 13:19:12.504652 21576 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.589785 21696 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.633438 21547 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:12.671835 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 193715us
I20260709 13:19:12.689781 21589 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:12.690665 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 43730.6us
I20260709 13:19:12.641573 21345 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:12.547607 21349 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.656150 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:12.585615 21690 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:12.716122 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 218080us
I20260709 13:19:12.718917 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:12.722836 19146 raft_consensus.cc:2410] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:12.696141 19743 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:12.726774 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:12.729084 21622 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:12.685722 21672 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.694113 21212 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:12.742657 19214 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:12.752385 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:12.753311 19214 raft_consensus.cc:2368] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:12.732630 21576 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.755641 21589 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:12.754725 21704 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:19:12.730391 21561 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:12.767941 19217 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:12.784917 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 132120us
I20260709 13:19:12.788748 21718 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:19:12.790242 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33232 (request call id 14) took 1972 ms. Trace:
I20260709 13:19:12.790635 19140 rpcz_store.cc:276] 0709 13:19:10.818040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.892595 (+1074555us) service_pool.cc:224] Handling call
0709 13:19:12.790001 (+897406us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400121454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103590735 00007f6108550d29 00007f6101acf1d4 00007f6101acf162 00007f6101acf091 00007f6101acf00c 00007f6101ace2c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:12.790170 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314314112}
W20260709 13:19:12.791558 21706 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
W20260709 13:19:12.792201 21708 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:19:12.797901 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:12.799902 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.805336 19215 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:12.800864 21547 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.883104 21547 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.883792 21210 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:12.884496 21709 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:19:12.885321 21547 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:12.887778 21081 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:12.808091 21714 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:19:12.808248 21710 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:19:12.807579 21712 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:19:12.905967 19140 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:12.907272 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:12.809890 21707 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
W20260709 13:19:12.888840 21427 consensus_meta.cc:287] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.856s	user 0.005s	sys 0.009s
I20260709 13:19:12.926492 19220 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:12.816504 21616 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:12.889354 21718 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.808632 21672 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:12.933012 19216 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:12.941849 19140 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:12.948437 19221 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:12.921619 21705 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:12.954492 19214 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:12.941584 21718 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.962478 21408 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.963061 21718 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:12.957922 21735 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.974982 21735 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.977519 21735 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:12.932431 21427 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.914783 21212 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:12.994668 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:12.995545 19146 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:12.998854 19219 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:12.989889 21666 consensus_meta.cc:287] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.002s
I20260709 13:19:13.006714 21666 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.015429 21726 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.949358 21622 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.016155 21726 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:12.954684 21705 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.020282 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1525) took 1221 ms. Trace:
W20260709 13:19:13.367897 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.369771 19113 leader_election.cc:400] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:13.372110 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:13.372354 19113 leader_election.cc:403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:13.316247 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 290) took 1582 ms. Trace:
I20260709 13:19:13.022471 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.373492 19751 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:13.206067 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.374961 19063 rpcz_store.cc:276] 0709 13:19:11.798629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.191987 (+393358us) service_pool.cc:224] Handling call
0709 13:19:12.192768 (+   781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.432646 (+239878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.020065 (+587419us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400035f54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:13.020225 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503438720}
I20260709 13:19:13.209486 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1335) took 1187 ms. Trace:
I20260709 13:19:13.022464 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.376300 19143 rpcz_store.cc:276] 0709 13:19:12.022089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.155623 (+133534us) service_pool.cc:224] Handling call
0709 13:19:13.209273 (+1053650us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002d8054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:13.209408 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367582464}
I20260709 13:19:13.376637 19067 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:13.376978 19751 raft_consensus.cc:1217] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-6.7]   Dedup: 3.6->[6.7-6.7]
I20260709 13:19:13.377816 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:13.382948 19751 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [3.6-6.7]
I20260709 13:19:13.383167 19214 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:13.379742 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.378278 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.380843 19066 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:13.374563 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:13.372911 19747 rpcz_store.cc:276] 0709 13:19:11.733804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.733944 (+   140us) service_pool.cc:224] Handling call
0709 13:19:11.909369 (+175425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.909801 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.909840 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.910354 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.184557 (+274203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:12.184595 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.184653 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.289531 (+104878us) raft_consensus.cc:1685] finished
0709 13:19:12.289551 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.315860 (+1026309us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540039b2d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:13.316138 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1134,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":15793,"spinlock_wait_cycles":307479808,"thread_start_us":273660,"threads_started":1,"wal-append.queue_time_us":367376}
I20260709 13:19:13.383268 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.089998 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1338) took 1645 ms. Trace:
I20260709 13:19:13.389573 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:13.389777 19217 rpcz_store.cc:276] 0709 13:19:11.444621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.020479 (+575858us) service_pool.cc:224] Handling call
0709 13:19:12.037541 (+ 17062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.768428 (+730887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.089694 (+321266us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b5400100254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:13.089918 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679267712}
W20260709 13:19:13.095257 21678 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.064s	user 0.008s	sys 0.004s
I20260709 13:19:13.391326 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:13.392225 19065 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:13.394173 19063 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:13.395843 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:13.023976 21598 consensus_meta.cc:287] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
W20260709 13:19:13.366295 21740 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:19:13.396426 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:13.231968 21458 consensus_meta.cc:287] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.690s	user 0.006s	sys 0.012s
I20260709 13:19:13.317775 21544 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:13.287200 21272 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:13.381448 21711 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.856s	user 0.004s	sys 0.000s
W20260709 13:19:13.050539 21514 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.142s	user 0.018s	sys 0.024s
I20260709 13:19:13.322495 21692 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.020509 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:13.066840 21671 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.454s	user 0.028s	sys 0.042s
I20260709 13:19:13.440596 19144 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:13.414294 19145 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:13.440815 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 297) took 1204 ms. Trace:
I20260709 13:19:13.415625 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:13.416184 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:13.442067 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:13.442600 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:13.443061 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:13.416412 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:13.443691 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:13.024418 21718 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.416671 21726 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:13.418061 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:13.418653 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:13.171205 21654 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:13.421381 19214 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:13.393326 21423 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.170872 21521 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:19:13.425899 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 2653a1baca71467dbf9167aede923a9c: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:13.426455 19750 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:13.415005 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:13.428303 21574 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.064389 21696 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:13.429024 21748 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.050s	user 0.003s	sys 0.000s
I20260709 13:19:13.403142 21695 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:13.064613 21349 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.366s
I20260709 13:19:13.431459 19747 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:13.399915 21689 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:13.434932 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:13.406751 21746 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.341s	user 0.012s	sys 0.015s
I20260709 13:19:13.394273 21666 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:13.436223 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.438336 19140 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:13.440773 21692 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.396246 21729 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:13.417372 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.444555 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:13.474474 19064 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:13.475054 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:13.445611 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:13.414615 21701 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:13.419943 21544 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:13.413532 21724 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:13.441447 19218 rpcz_store.cc:276] 0709 13:19:12.236074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.238449 (+  2375us) service_pool.cc:224] Handling call
0709 13:19:12.238821 (+   372us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:12.266958 (+ 28137us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:12.267000 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:12.267782 (+   782us) log.cc:844] Serialized 52 byte log entry
0709 13:19:12.401271 (+133489us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:12.401310 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.401373 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.204729 (+803356us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:13.436715 (+231986us) raft_consensus.cc:1685] finished
0709 13:19:13.436744 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.440750 (+  4006us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12842,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":41008,"spinlock_wait_cycles":37900544,"thread_start_us":133171,"threads_started":1,"wal-append.queue_time_us":237944}
I20260709 13:19:13.452214 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1322) took 2218 ms. Trace:
I20260709 13:19:13.482558 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:13.483850 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:13.425770 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:13.446897 21718 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.436473 19742 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:13.439304 21339 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.462037 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47090.5us
I20260709 13:19:13.447518 21635 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:13.449302 21081 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.391713 21683 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:19:13.475584 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:13.476697 21729 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.513057 21729 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.496500 21672 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.513350 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 286) took 1873 ms. Trace:
I20260709 13:19:13.514139 19743 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:13.470357 21719 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:19:13.516409 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.478322 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1759) took 1809 ms. Trace:
I20260709 13:19:13.517036 19070 rpcz_store.cc:276] 0709 13:19:11.669208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.671053 (+  1845us) service_pool.cc:224] Handling call
0709 13:19:11.719789 (+ 48736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.034584 (+314795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.473410 (+1438826us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54003093d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:13.478267 (+  4857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686233344}
I20260709 13:19:13.517724 19063 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:13.419255 21272 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:13.488201 19218 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:13.519055 19218 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:13.519821 19218 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.520586 19139 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:13.520694 19218 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.521464 21696 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.521884 19139 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:13.522621 21703 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.037s	user 0.001s	sys 0.003s
I20260709 13:19:13.459095 21576 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:19:13.465016 21648 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:13.491122 19214 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:13.519064 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1337) took 1297 ms. Trace:
I20260709 13:19:13.525372 19144 rpcz_store.cc:276] 0709 13:19:12.222030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.226065 (+  4035us) service_pool.cc:224] Handling call
0709 13:19:13.518885 (+1292820us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400189054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:13.519014 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788066560}
I20260709 13:19:13.489292 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:13.492749 21747 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:13.494904 21606 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:13.460932 21735 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:13.495342 21724 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.496227 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.482048 19147 rpcz_store.cc:276] 0709 13:19:11.235052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.543338 (+308286us) service_pool.cc:224] Handling call
0709 13:19:11.543600 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.633631 (+ 90031us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:11.633900 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.845582 (+211682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.845651 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.845714 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.452064 (+1606350us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b540010e854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:13.452094 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.452172 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17154,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":13387,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":206415104,"thread_start_us":210855,"threads_started":1,"wal-append.queue_time_us":342303,"wal-append.run_cpu_time_us":1696,"wal-append.run_wall_time_us":1129229}
I20260709 13:19:13.458487 21654 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.470028 21700 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.505815 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.505237 21339 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.510143 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:13.552929 19221 raft_consensus.cc:2410] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:19:13.497735 21408 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 13:19:13.486559 21666 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.463785 21521 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.512260 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:13.469539 21695 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.491586 21726 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:13.546265 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57056.3us
I20260709 13:19:13.561832 21676 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.562181 21724 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:13.490738 21701 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.506409 21716 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.501844 19745 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:13.505589 21081 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.498279 21513 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:19:13.549214 21458 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:13.555645 19218 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:13.526290 21672 raft_consensus.cc:2764] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:13.558329 19069 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.543264 21561 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.549769 21723 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:13.548302 21635 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:13.554188 21700 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:13.566470 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 82696.1us
I20260709 13:19:13.562322 21676 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.552469 21606 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:13.569717 19138 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.571480 19218 pending_rounds.cc:85] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 3
I20260709 13:19:13.557911 21666 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:13.551515 21589 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:19:13.560997 21349 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.513254 21544 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.576730 19218 pending_rounds.cc:107] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:13.577931 19145 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:13.578830 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:13.579329 19218 raft_consensus.cc:2889] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.581892 19069 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:13.571165 21081 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.526648 21648 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.590216 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:13.592094 21665 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.979s	user 0.007s	sys 0.035s
I20260709 13:19:13.571599 21716 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.594240 21719 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:13.594697 21719 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:13.595476 21719 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.596240 21339 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:13.596988 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.574173 21723 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:13.598402 21759 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:13.598243 21723 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.599037 21759 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:13.600099 21759 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.601944 21701 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:13.601997 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:13.603967 21718 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.577970 21700 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.605333 21427 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:13.623564 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.624205 19067 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:13.624337 19063 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:13.606310 21654 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.596621 21719 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.608412 19748 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
W20260709 13:19:13.629410 21754 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 13:19:13.616988 21339 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:13.609134 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:13.610494 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.634876 19218 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:13.611184 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.577497 21666 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.613166 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1476) took 4141 ms. Trace:
I20260709 13:19:13.636217 19069 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:13.612335 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:13.614042 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:13.577387 21561 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.597101 21544 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.641749 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:13.611214 21408 raft_consensus.cc:2764] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:13.584182 21606 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.636261 19068 rpcz_store.cc:276] 0709 13:19:09.472119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.724410 (+1252291us) service_pool.cc:224] Handling call
0709 13:19:11.320291 (+595881us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.356482 (+ 36191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.356528 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:11.379055 (+ 22527us) log.cc:844] Serialized 582 byte log entry
0709 13:19:11.509764 (+130709us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:11.509803 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.509868 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.066188 (+1556320us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:13.447555 (+381367us) raft_consensus.cc:1685] finished
0709 13:19:13.447570 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.612963 (+165393us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400123ed0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:13.613099 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":19877,"spinlock_wait_cycles":1465610240,"thread_start_us":58479,"threads_started":1,"wal-append.queue_time_us":161249}
I20260709 13:19:13.640178 19138 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:13.626003 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:13.605290 21692 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.612306 21716 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.652015 21427 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.653425 21768 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.653652 21339 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.627148 21729 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.585074 21349 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.660382 19714 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:13.591988 21635 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.665580 21427 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.672250 21718 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.679229 21718 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:13.680099 21753 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:19:13.681843 21718 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:13.682390 21521 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:13.682350 21718 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.683085 21718 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:13.687897 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:13.688776 19072 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:13.690486 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:13.691440 21768 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:13.693907 21768 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.669474 21756 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:19:13.665333 21654 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.680953 21523 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:13.697708 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:13.513772 19744 rpcz_store.cc:276] 0709 13:19:11.640284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.663694 (+ 23410us) service_pool.cc:224] Handling call
0709 13:19:11.722776 (+ 59082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.723139 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.723171 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.354375 (+1631204us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b2c000f1058. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:19:13.354915 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.453847 (+ 98932us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:13.460596 (+  6749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.464912 (+  4316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.496004 (+ 31092us) raft_consensus.cc:1685] finished
0709 13:19:13.496033 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.513271 (+ 17238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5583,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":15763328,"thread_start_us":84473,"threads_started":1,"wal-append.queue_time_us":138826}
I20260709 13:19:13.704206 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:13.666049 21726 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:19:13.711012 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 69336.3us
I20260709 13:19:13.711341 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:13.714397 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:13.714787 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:13.700620 21654 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.716845 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:13.718510 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:13.704280 21523 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.708698 21704 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.719432 21514 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:13.710073 21683 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:19:13.738018 21705 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.738479 21349 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.707122 21561 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:13.709240 21756 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:13.727840 21081 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.728278 21423 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:13.729453 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 294) took 1179 ms. Trace:
I20260709 13:19:13.729655 21427 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:13.719439 21191 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:13.747990 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:13.708033 21657 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:14.438169 21657 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.438768 21657 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:13.745986 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.442060 21210 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:13.791220 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.442677 21210 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.444761 21427 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:13.712224 21724 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:13.730187 21686 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:13.746327 21756 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:13.726722 21523 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.725178 21695 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:13.935691 21561 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.995465 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:13.995518 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.931391 21349 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:13.912019 19742 rpcz_store.cc:276] 0709 13:19:12.550114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.551827 (+  1713us) service_pool.cc:224] Handling call
0709 13:19:13.729277 (+1177450us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54004cdbd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:13.729395 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622320512}
I20260709 13:19:13.935271 21576 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.990473 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:14.044210 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.724776 21654 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.997736 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:13.932109 21514 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.766496 21701 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.454188 21561 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.484145 21514 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.486302 21561 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.095361 21212 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:14.489228 21212 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.491816 21212 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.492066 21654 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:14.227954 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.447273 21686 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.080152 21705 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.236194 21770 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:14.237798 21648 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:14.149369 21704 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.194619 21758 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.507s	user 0.001s	sys 0.000s
I20260709 13:19:14.178264 21423 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.229673 21191 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.230285 21718 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.246682 21729 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.262254 21719 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.310847 21771 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:19:14.316838 21676 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:14.357452 21666 consensus_meta.cc:287] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.004s
W20260709 13:19:14.361722 21700 consensus_meta.cc:287] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.003s
W20260709 13:19:14.369737 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.001s	sys 0.000s
I20260709 13:19:14.377894 21081 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:14.316118 21768 consensus_meta.cc:287] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.003s
W20260709 13:19:14.424968 21606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.259s	sys 0.298s
I20260709 13:19:14.428246 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1340) took 2204 ms. Trace:
I20260709 13:19:14.531914 21684 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:14.332698 21544 consensus_meta.cc:287] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.002s
W20260709 13:19:14.452981 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 705009us
I20260709 13:19:14.453189 21672 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.484201 21701 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:13.746677 21329 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:14.486565 21514 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:14.456684 21576 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.456990 19744 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.456727 21523 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.150343 19746 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:14.531881 19748 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.010s	sys 0.011s
W20260709 13:19:14.597052 19748 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.010s	sys 0.011s
I20260709 13:19:14.537302 19749 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:14.537952 19070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.019s	sys 0.033s
I20260709 13:19:14.493573 21686 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.458884 21598 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.447325 21724 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:14.599702 19070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.019s	sys 0.033s
W20260709 13:19:14.530450 21635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.010s	sys 0.008s
W20260709 13:19:14.572978 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.001s	sys 0.000s
W20260709 13:19:14.573118 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 130532us
I20260709 13:19:14.496207 21695 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.447993 21756 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.532109 21561 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.444842 21210 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.577797 19141 rpcz_store.cc:276] 0709 13:19:12.224124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.225943 (+  1819us) service_pool.cc:224] Handling call
0709 13:19:14.414491 (+2188548us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002b84d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:14.428184 (+ 13693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276960640}
I20260709 13:19:14.428570 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 392) took 1408 ms. Trace:
W20260709 13:19:14.556795 21759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.008s	sys 0.038s
I20260709 13:19:14.577281 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1785) took 1168 ms. Trace:
I20260709 13:19:14.598503 21329 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.531872 21780 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.522436 21705 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:14.580122 21606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.259s	sys 0.299s
W20260709 13:19:14.590885 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.572007 21719 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.593955 21654 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.594233 21701 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.594935 21272 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.544528 21191 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.596185 21576 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.605123 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:14.744700 19065 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.746151 21191 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.715147 21780 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:14.605590 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 887078us
I20260709 13:19:14.748217 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:14.597044 21726 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.748850 21780 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.748961 21726 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:14.607339 21635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.011s	sys 0.022s
W20260709 13:19:14.752033 21769 log.cc:927] Time spent T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.626s	user 0.007s	sys 0.006s
I20260709 13:19:14.607291 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:14.455567 21349 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.580328 21081 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:14.754061 21081 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.755175 21349 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.755300 21723 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.539384 21423 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.594652 21523 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.610826 21695 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.575054 21700 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.574856 21666 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.531636 21704 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.609391 21598 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.582875 21672 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:14.797817 19142 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:14.578821 21768 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.607676 21724 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.608918 21676 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.649049 21760 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:14.809312 21676 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.666548 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:14.810765 19066 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:14.811599 21676 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:14.652835 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1368) took 1114 ms. Trace:
I20260709 13:19:14.814985 19214 rpcz_store.cc:276] 0709 13:19:13.538816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.539067 (+   251us) service_pool.cc:224] Handling call
0709 13:19:13.539464 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:13.547230 (+  7766us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:13.658060 (+110830us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.700346 (+ 42286us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:13.701026 (+   680us) log.cc:844] Serialized 52 byte log entry
0709 13:19:13.701319 (+   293us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:13.701365 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.701489 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.652541 (+951052us) raft_consensus.cc:1685] finished
0709 13:19:14.652593 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.652763 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15017,"prepare.queue_time_us":11444,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":9219,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5359,"thread_start_us":132919,"threads_started":2,"wal-append.queue_time_us":342054}
I20260709 13:19:14.817019 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.817742 19214 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:14.817832 19066 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:14.818562 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.819342 19214 raft_consensus.cc:2393] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:14.820221 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:14.765940 21250 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:14.605955 21569 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:14.669581 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:14.579641 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:14.824576 19063 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:14.824957 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 245367us
I20260709 13:19:14.825086 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 227) took 1261 ms. Trace:
I20260709 13:19:14.826148 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:14.676944 19146 rpcz_store.cc:276] 0709 13:19:13.408857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.485799 (+ 76942us) service_pool.cc:224] Handling call
0709 13:19:13.507280 (+ 21481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.507571 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:13.526903 (+ 19332us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.419585 (+892682us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b1800087760. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6106f823c7 00007f61035949a7 00007f61035a40bf 00007f61035a4038
0709 13:19:14.576671 (+157086us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.576900 (+   229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.576948 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:14.577005 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.577092 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.577224 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12370,"prepare.queue_time_us":27734,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1518,"raft.queue_time_us":755,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":10056,"spinlock_wait_cycles":4332288,"thread_start_us":197046,"threads_started":2,"wal-append.queue_time_us":54306}
I20260709 13:19:14.661759 21756 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.608542 21657 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.660485 21716 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.709659 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.709911 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.829574 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1780) took 1393 ms. Trace:
I20260709 13:19:14.829926 19142 rpcz_store.cc:276] 0709 13:19:13.407349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.418440 (+ 11091us) service_pool.cc:224] Handling call
0709 13:19:14.800657 (+1382217us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002d8054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:14.800844 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3102307200}
W20260709 13:19:14.713078 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 107210us
I20260709 13:19:14.650619 21561 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.649286 21784 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
W20260709 13:19:14.699749 21759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.011s	sys 0.039s
I20260709 13:19:14.719992 21272 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.721150 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.849901 19221 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:14.721719 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.726529 21329 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.728000 21705 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.742393 19068 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:14.742617 21719 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:14.742803 19744 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
W20260709 13:19:14.757277 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.757206 19065 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:14.838792 21770 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.759603 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:14.771334 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.757916 21778 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:14.758087 21683 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.583240 21684 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.758385 21635 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:14.830077 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.867343 19220 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:14.712350 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.676605 19743 rpcz_store.cc:276] 0709 13:19:13.020046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.020209 (+   163us) service_pool.cc:224] Handling call
0709 13:19:14.428326 (+1408117us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54005b5754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:14.428484 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164440960}
I20260709 13:19:14.825630 19064 rpcz_store.cc:276] 0709 13:19:13.563926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.564084 (+   158us) service_pool.cc:224] Handling call
0709 13:19:13.574778 (+ 10694us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:13.575040 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:13.654509 (+ 79469us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.719807 (+ 65298us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.719991 (+   184us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:13.720573 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:19:13.720708 (+   135us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:13.720744 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.720811 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.751469 (+1030658us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:14.824678 (+ 73209us) raft_consensus.cc:1685] finished
0709 13:19:14.824711 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.825016 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":93177,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":85,"raft.queue_time_us":283,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":15699,"spinlock_wait_cycles":18600320,"thread_start_us":129379,"threads_started":2,"wal-append.queue_time_us":335668}
I20260709 13:19:14.837965 21716 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.833745 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:14.823650 21672 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.841483 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:14.848560 19063 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:14.850530 19215 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:14.852234 19747 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:14.855238 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:14.897027 19221 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.831257 21408 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:14.861366 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:14.898293 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:14.845912 21789 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.831830 21569 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.873829 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:14.874459 19144 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:14.903179 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:14.903679 19144 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:14.870669 19212 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:14.873317 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:14.875394 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:14.820812 19214 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.862027 21770 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:14.877841 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 118303us
I20260709 13:19:14.907794 19110 leader_election.cc:400] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:14.908144 19110 leader_election.cc:403] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:19:14.908318 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.909245 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:14.909665 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.909860 19064 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.910079 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.878309 21547 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.878531 21695 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:14.880012 21768 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:14.909075 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.880394 21081 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:14.868696 21250 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.881630 21759 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.867358 21778 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.882079 19146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:14.882445 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.882928 21423 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:14.878332 21657 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:14.883697 19147 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:14.888065 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1782) took 1480 ms. Trace:
I20260709 13:19:14.889608 21666 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:14.874763 21514 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.891837 21704 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:14.869988 21696 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:14.901247 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.875734 21635 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:14.911870 19216 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:14.911955 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.870635 21780 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.913245 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 79579us
I20260709 13:19:14.988849 19215 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:14.912590 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:14.913528 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:14.918890 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:14.867455 21683 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.882455 21598 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:14.920789 19214 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:14.995805 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:14.997072 21569 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.992524 21780 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.925303 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:14.998992 21780 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.999167 21606 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:14.921350 21191 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:19:14.925894 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:15.001199 19217 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:15.002125 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:15.003119 21527 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:15.003201 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:15.003746 21527 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:15.004139 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.926674 19221 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:15.005846 21527 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:15.007638 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:14.971855 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.953011 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.909214 21622 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:14.912191 21458 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:14.981010 19145 rpcz_store.cc:276] 0709 13:19:13.408012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.443853 (+ 35841us) service_pool.cc:224] Handling call
0709 13:19:14.887921 (+1444068us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002a8354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:14.888013 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233932160}
I20260709 13:19:14.985900 19219 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:14.912546 21689 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:14.914455 21726 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:14.919044 19212 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:14.913874 21770 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:14.985373 21798 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:14.921315 21408 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:14.994985 19064 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:15.016074 19221 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:15.019637 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 178240us
I20260709 13:19:15.019919 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:14.930763 21250 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:14.920204 21544 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:19:14.985630 21514 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:15.053206 21676 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:15.053649 21676 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.054049 21676 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.049314 19139 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:15.049710 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:15.057610 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.949118 21759 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:15.058832 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 143882us
W20260709 13:19:15.059283 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.059253 19217 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:15.052155 21622 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:15.021944 21684 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:15.023712 21081 raft_consensus.cc:2764] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:15.036898 21606 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:15.049536 21458 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:19:15.073275 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 1.44652e+06us
I20260709 13:19:15.085124 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.044795 21250 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:14.990646 21696 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.043780 21778 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:15.082196 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:15.061487 21408 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:15.098428 19068 raft_consensus.cc:2368] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:15.099193 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.083410 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.099568 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:15.083627 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.100112 19066 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:15.099754 19068 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:15.092109 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 302) took 1097 ms. Trace:
I20260709 13:19:15.101336 19747 rpcz_store.cc:276] 0709 13:19:13.994971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.995142 (+   171us) service_pool.cc:224] Handling call
0709 13:19:15.084815 (+1089673us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54005730d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:15.092034 (+  7219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914647424}
I20260709 13:19:15.093520 21606 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:15.062744 21672 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:15.058131 21514 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:15.019309 21666 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:15.095247 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.100610 19072 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:15.104769 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:15.108011 19065 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:19:15.113219 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 72497.1us
I20260709 13:19:15.114260 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:15.075042 21547 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.074951 21783 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:15.186682 19146 raft_consensus.cc:606] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:15.095707 21594 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.188561 19146 raft_consensus.cc:614] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:15.055769 21686 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:15.188104 19748 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:15.102726 21272 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.211516 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:15.212272 19751 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:14.908805 21789 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:15.217201 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 112512us
I20260709 13:19:15.224463 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:15.214500 21272 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.101089 21191 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:19:15.107440 21408 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:15.379987 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 263753us
I20260709 13:19:15.225278 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:15.236208 19140 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:15.354135 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 396) took 1966 ms. Trace:
I20260709 13:19:15.503254 19749 rpcz_store.cc:276] 0709 13:19:13.387918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.388270 (+   352us) service_pool.cc:224] Handling call
0709 13:19:13.729842 (+341572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.605329 (+875487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.076570 (+471241us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54004cdbd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:15.353840 (+277270us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54004cdbd0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:15.354054 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584034944}
W20260709 13:19:15.242899 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 235321us
I20260709 13:19:15.505937 19145 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:15.507568 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:15.508980 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.208045 21783 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.510469 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:15.510182 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.511561 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.512014 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.509464 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:15.508564 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:15.514890 19141 raft_consensus.cc:2410] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:15.512636 19145 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:15.525940 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.526183 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:15.514850 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:15.526871 19212 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:15.527513 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:15.513410 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:15.528795 19063 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:15.501226 21723 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.002s
I20260709 13:19:15.535509 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:15.548777 19138 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:15.249696 21458 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.231308 21622 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.230334 21606 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.208582 21791 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.323s
I20260709 13:19:15.231899 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:15.242684 21705 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.351s
I20260709 13:19:15.212185 21594 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.524554 19742 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:15.508622 21329 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:15.647585 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.648452 19147 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:15.649602 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.650346 19147 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:15.273777 21635 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:15.384063 21781 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.680s	user 0.000s	sys 0.002s
I20260709 13:19:15.535538 19212 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:15.568188 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:19:15.657073 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 88938.1us
I20260709 13:19:15.658393 19110 leader_election.cc:400] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:15.659382 19110 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:15.592561 21756 consensus_meta.cc:287] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.000s
I20260709 13:19:15.532393 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.539445 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:15.534996 19067 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:15.601550 19219 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:19:15.565663 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.563874 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.679528 21684 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.679998 21684 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:15.589763 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.681242 19064 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:15.512856 21666 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 13:19:15.683158 19212 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:15.574744 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:15.531318 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.573763 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.586301 19221 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.531834 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:15.535321 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.508561 21704 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.514796 21783 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:15.226750 21801 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:15.273087 21759 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:15.571869 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:15.524641 21683 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:15.288386 21686 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:15.588406 21770 consensus_meta.cc:287] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
W20260709 13:19:15.592862 21775 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.933s	user 0.006s	sys 0.000s
I20260709 13:19:15.664492 19063 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:15.668345 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:15.590761 21272 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:15.529996 21768 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:19:15.671439 21635 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:15.565268 21690 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.586056 21408 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:15.568491 21807 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:15.673056 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:15.265156 21676 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.673738 19750 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:15.674823 19141 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:15.547705 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:15.529692 21598 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.536183 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 180615us
I20260709 13:19:15.693048 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:15.575794 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 225) took 2175 ms. Trace:
I20260709 13:19:15.565577 21789 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:15.529723 21804 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.212s
I20260709 13:19:15.569217 21514 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:19:15.584813 21787 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:19:15.569310 21672 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:15.702535 19220 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
W20260709 13:19:16.110471 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 442181us
I20260709 13:19:16.089893 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:16.111284 19147 raft_consensus.cc:606] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:16.111771 19066 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:16.112342 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1552) took 1015 ms. Trace:
I20260709 13:19:16.071388 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:16.113209 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1548) took 1021 ms. Trace:
I20260709 13:19:16.113643 19063 rpcz_store.cc:276] 0709 13:19:15.091697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.513133 (+421436us) service_pool.cc:224] Handling call
0709 13:19:16.113156 (+600023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.114073 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.954507 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.071983 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1354) took 1201 ms. Trace:
I20260709 13:19:15.842561 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:16.118320 19146 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:16.112808 19066 rpcz_store.cc:276] 0709 13:19:15.096847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.511326 (+414479us) service_pool.cc:224] Handling call
0709 13:19:16.089744 (+578418us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:16.112290 (+ 22546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34597248}
I20260709 13:19:15.755098 19221 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:16.068742 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1361) took 1196 ms. Trace:
W20260709 13:19:15.833416 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 297940us
I20260709 13:19:15.955359 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:15.833141 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 274125us
I20260709 13:19:16.118604 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 308) took 1029 ms. Trace:
I20260709 13:19:16.090289 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:16.118824 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.118821 19138 rpcz_store.cc:276] 0709 13:19:14.870281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.873050 (+  2769us) service_pool.cc:224] Handling call
0709 13:19:16.071829 (+1198779us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540010de54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:16.071927 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480801536}
I20260709 13:19:16.086314 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:16.120965 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:15.675148 21778 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:15.948475 21561 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.121860 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:15.947762 21716 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:16.188256 21778 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.169620 21598 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:15.932782 21191 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.736146 21816 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.188772 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1544) took 1100 ms. Trace:
I20260709 13:19:15.893450 21700 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:15.286238 21696 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:16.123276 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.191614 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 66544us
I20260709 13:19:16.202837 19063 rpcz_store.cc:276] 0709 13:19:15.088830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.121656 (+1032826us) service_pool.cc:224] Handling call
0709 13:19:16.188711 (+ 67055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.204115 19065 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:16.204299 19063 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:16.205018 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1542) took 1117 ms. Trace:
I20260709 13:19:16.207147 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:16.207479 19063 rpcz_store.cc:276] 0709 13:19:15.087543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.203724 (+1116181us) service_pool.cc:224] Handling call
0709 13:19:16.204000 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.204781 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.204972 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.208303 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1546) took 1117 ms. Trace:
I20260709 13:19:16.115155 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1554) took 1017 ms. Trace:
I20260709 13:19:16.208679 19072 rpcz_store.cc:276] 0709 13:19:15.090433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.955056 (+864623us) service_pool.cc:224] Handling call
0709 13:19:16.208243 (+253187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.209213 19063 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:16.209115 19067 rpcz_store.cc:276] 0709 13:19:15.097450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.113793 (+1016343us) service_pool.cc:224] Handling call
0709 13:19:16.115092 (+  1299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.209951 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1553) took 1112 ms. Trace:
I20260709 13:19:16.210004 19218 rpcz_store.cc:276] 0709 13:19:15.089554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.177670 (+ 88116us) service_pool.cc:224] Handling call
0709 13:19:15.954317 (+776647us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:16.118547 (+164230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4309376}
I20260709 13:19:16.211485 19214 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:15.765147 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:16.213160 19215 raft_consensus.cc:2393] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:16.221417 19113 connection.cc:256] RPC call timeout handler was delayed by -1.0827143829999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:19:16.211818 19063 rpcz_store.cc:276] 0709 13:19:15.097165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.208710 (+1111545us) service_pool.cc:224] Handling call
0709 13:19:16.209013 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.209738 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.209910 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.173228 21801 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:16.202433 21191 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:16.075459 21805 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 13:19:15.746691 21756 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:16.223248 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 306) took 1134 ms. Trace:
I20260709 13:19:16.119203 21723 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.225153 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.234030 21799 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.230724 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:15.951669 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:16.066207 21808 log.cc:927] Time spent T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:19:16.211272 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:16.250490 21723 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.682576 21701 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:15.871411 21622 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:15.885171 21806 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:16.116057 21810 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:16.202492 21816 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:16.188766 21778 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.721199 21704 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.224515 21635 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:16.296413 21816 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.119668 21690 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.221473 21272 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:16.125408 21783 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.250974 21514 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.117949 21770 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.257823 21799 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.259761 21756 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:16.262240 21723 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.263724 21622 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.264456 21701 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:16.261385 21684 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.291102 21716 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:16.309777 21799 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.299659 21806 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.298943 21810 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:16.330333 21817 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 13:19:16.333410 21783 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:16.333729 21818 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:16.335955 21810 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:16.337711 21806 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:16.340806 21799 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:16.369920 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 146959us
I20260709 13:19:16.373754 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:16.374414 18967 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.379597 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:16.379173 18967 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 5, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 5 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.383977 19064 raft_consensus.cc:2368] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5.
I20260709 13:19:16.117288 19070 rpcz_store.cc:276] 0709 13:19:13.400785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.518065 (+117280us) service_pool.cc:224] Handling call
0709 13:19:13.518337 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.566133 (+ 47796us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:13.702012 (+135879us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.609005 (+906993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.609057 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:14.609102 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.094783 (+485681us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b18002b9120. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240
0709 13:19:15.247123 (+152340us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18002b9120. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db
0709 13:19:15.396844 (+149721us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:15.575590 (+178746us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b54001a9d54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:15.575633 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.575742 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9447,"prepare.queue_time_us":88401,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":482,"raft.queue_time_us":67750,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10605,"spinlock_wait_cycles":129814656,"thread_start_us":1025121,"threads_started":2,"wal-append.queue_time_us":883014}
I20260709 13:19:16.384837 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:16.245916 21672 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:19:16.235185 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:16.432160 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 196875us
I20260709 13:19:16.433451 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:16.434602 21598 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.435096 21696 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.316182 21622 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.435637 21696 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:16.435681 21684 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.436301 21696 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.390686 19214 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 4: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:16.390733 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:16.220209 19139 rpcz_store.cc:276] 0709 13:19:14.872321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.912156 (+ 39835us) service_pool.cc:224] Handling call
0709 13:19:14.912393 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.055263 (+142870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.068490 (+1013227us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400328054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:16.068684 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313874176}
I20260709 13:19:16.393976 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:16.394311 19140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1362) took 1521 ms (client timeout 1680 ms). Trace:
I20260709 13:19:16.258632 21408 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:19:16.396404 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.205580 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 442) took 1107 ms. Trace:
I20260709 13:19:16.232755 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.248481 19221 rpcz_store.cc:276] 0709 13:19:15.088915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.585885 (+496970us) service_pool.cc:224] Handling call
0709 13:19:15.586180 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.222952 (+636772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.223183 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.296007 19745 raft_consensus.cc:2410] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:16.246848 19746 raft_consensus.cc:2393] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:16.403304 19217 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:16.405831 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:16.408166 19219 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:16.409035 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.412350 21081 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:16.261569 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 50380.1us
W20260709 13:19:16.246165 19717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.021s	sys 0.012s
W20260709 13:19:16.500290 19717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.021s	sys 0.012s
W20260709 13:19:16.500937 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 969078us
I20260709 13:19:16.442613 21676 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:16.512979 19069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1550) took 1397 ms (client timeout 1763 ms). Trace:
I20260709 13:19:16.326890 21801 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.514214 21272 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:16.515110 21272 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.517306 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 448) took 1332 ms. Trace:
I20260709 13:19:16.419889 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:16.518234 19748 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:16.518407 21759 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:16.416438 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 446) took 1310 ms. Trace:
I20260709 13:19:16.518941 21759 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:16.456489 19140 rpcz_store.cc:269] 0709 13:19:14.872611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.896475 (+ 23864us) service_pool.cc:224] Handling call
0709 13:19:16.393742 (+1497267us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540018a954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:16.394037 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566294272}
I20260709 13:19:16.421401 19212 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:19:16.422070 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.422698 19750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 452) took 1208 ms (client timeout 1510 ms). Trace:
I20260709 13:19:16.414324 21191 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.211187 19066 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:16.318447 21701 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.320255 21716 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.430596 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1784) took 3021 ms. Trace:
I20260709 13:19:16.432440 21705 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:16.436475 21684 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:16.452682 21683 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:16.452036 21690 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.497253 19743 rpcz_store.cc:276] 0709 13:19:15.098540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.104921 (+  6381us) service_pool.cc:224] Handling call
0709 13:19:16.205515 (+1100594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.499454 21799 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:16.513479 19069 rpcz_store.cc:269] 0709 13:19:15.096262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.389901 (+1293639us) service_pool.cc:224] Handling call
0709 13:19:16.494103 (+104202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:16.310202 21514 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:16.413801 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1579) took 1659 ms (client timeout 2046 ms). Trace:
I20260709 13:19:16.427951 21329 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:16.519191 19747 rpcz_store.cc:276] 0709 13:19:15.105566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.113984 (+  8418us) service_pool.cc:224] Handling call
0709 13:19:15.114256 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.114513 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:15.425420 (+310907us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.414847 (+989427us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.415405 (+   558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.415540 (+   135us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:16.415703 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.415880 (+   177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.416115 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":546659,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":178285,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":24226,"thread_start_us":1226804,"threads_started":4,"wal-append.queue_time_us":800519}
I20260709 13:19:16.518877 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 450) took 1309 ms. Trace:
W20260709 13:19:16.522060 19750 rpcz_store.cc:269] 0709 13:19:15.213670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.225028 (+ 11358us) service_pool.cc:224] Handling call
0709 13:19:16.422239 (+1197211us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400596354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:16.422434 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393069824}
I20260709 13:19:16.540382 19216 raft_consensus.cc:2410] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:16.542698 19213 raft_consensus.cc:2410] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:16.585083 21212 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:16.437819 19142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
W20260709 13:19:16.585307 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 152160us
I20260709 13:19:16.547204 21826 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.586416 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:16.587693 21594 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.589412 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 242) took 1080 ms. Trace:
I20260709 13:19:16.589864 21191 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:16.591727 21349 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:16.573372 21684 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.594089 21349 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:16.517753 19745 rpcz_store.cc:276] 0709 13:19:15.184725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.187958 (+  3233us) service_pool.cc:224] Handling call
0709 13:19:15.951467 (+763509us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:16.517113 (+565646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30687104}
I20260709 13:19:16.557552 21606 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.583916 19748 rpcz_store.cc:276] 0709 13:19:15.209534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.209728 (+   194us) service_pool.cc:224] Handling call
0709 13:19:16.419291 (+1209563us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:16.518810 (+ 99519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6410624}
W20260709 13:19:16.561457 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.561115 21756 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.604957 21806 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:16.605711 21806 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.606830 21514 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.564173 18967 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.586432 21826 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.608273 21806 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:16.582520 19220 rpcz_store.cc:269] 0709 13:19:14.754523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.882203 (+127680us) service_pool.cc:224] Handling call
0709 13:19:16.413343 (+1531140us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540014b4d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:16.413545 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649325952}
I20260709 13:19:16.609462 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:16.610301 21826 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.610980 21826 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.611723 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:16.613095 21598 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.613410 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.615979 19220 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:16.616343 19220 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:16.572369 21683 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:16.617256 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.617807 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.617856 21683 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.618708 19213 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:16.545113 19143 rpcz_store.cc:276] 0709 13:19:13.408563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.444591 (+ 36028us) service_pool.cc:224] Handling call
0709 13:19:14.414668 (+970077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.415159 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.415202 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.415794 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.538812 (+123018us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:14.538861 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.538943 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.383400 (+844457us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:15.836122 (+452722us) raft_consensus.cc:1685] finished
0709 13:19:15.836147 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.430176 (+594029us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54002b84d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:16.430378 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"spinlock_wait_cycles":2257879040,"thread_start_us":122714,"threads_started":1,"wal-append.queue_time_us":244434}
I20260709 13:19:16.619537 21683 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.620241 19220 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.621603 19220 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.579460 21770 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:16.591439 21831 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:16.623711 21831 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:16.624162 21831 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:16.624366 21606 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:16.624902 21606 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.625272 21831 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.626556 21831 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.441461 21635 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:16.585333 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 200878us
I20260709 13:19:16.589879 19067 rpcz_store.cc:276] 0709 13:19:15.509116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.210178 (+701062us) service_pool.cc:224] Handling call
0709 13:19:16.210518 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.210741 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:16.385944 (+175203us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.588528 (+202584us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.588737 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.588809 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:16.588912 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.589024 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.589217 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225298,"prepare.queue_time_us":336280,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":108,"raft.queue_time_us":52667,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":166,"thread_start_us":141804,"threads_started":1}
I20260709 13:19:16.601647 21705 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:16.630048 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:16.631264 21705 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.633114 21212 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:16.634078 21787 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.602406 21686 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.635922 21686 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.636932 21329 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.638370 21686 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:16.638468 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:16.603293 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 197874us
I20260709 13:19:16.639683 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:16.640138 19220 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:19:16.640486 19220 pending_rounds.cc:85] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:16.640704 19220 pending_rounds.cc:107] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:19:16.641180 19220 raft_consensus.cc:2889] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.641731 21704 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.594605 21349 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:16.603835 21716 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:16.603941 19746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 445) took 1482 ms (client timeout 1681 ms). Trace:
W20260709 13:19:16.648227 19746 rpcz_store.cc:269] 0709 13:19:15.099359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.105765 (+  6406us) service_pool.cc:224] Handling call
0709 13:19:16.581535 (+1475770us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400646ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:16.581743 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337069184}
I20260709 13:19:16.603111 21272 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.646637 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.649994 21408 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.650156 19216 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:16.650588 21408 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.647648 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:16.651790 19067 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:16.653888 21723 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.656607 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:16.657454 19140 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:16.659382 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.660432 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:16.649719 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:16.696524 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107772us
W20260709 13:19:16.698158 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.721679 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.660899 21770 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.684890 19747 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:16.729408 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:16.736311 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 64749.4us
I20260709 13:19:16.671774 21408 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:16.738536 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:16.699682 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.747401 21827 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.747908 21827 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.748268 21827 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.619554 21622 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.697381 21826 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:19:16.758358 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:16.750799 21191 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:16.754333 21723 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.685055 21329 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.698721 21594 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 13:19:16.768442 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 462831us
I20260709 13:19:16.769279 19744 raft_consensus.cc:2368] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7.
W20260709 13:19:16.769132 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 112700us
W20260709 13:19:16.769613 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 133029us
I20260709 13:19:16.770630 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:16.770833 19067 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:16.770998 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:16.772019 21081 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.772989 21081 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.773335 21081 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.773672 21081 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.768641 21598 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.772379 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:16.765071 19216 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:16.767474 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.779891 19215 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:16.788121 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:16.788868 19220 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.777338 21598 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.775640 21787 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.777726 21770 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:16.796958 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1557) took 1126 ms. Trace:
I20260709 13:19:16.797434 19069 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:16.798398 19064 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:16.801131 21527 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:16.803269 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:16.804042 21778 consensus_meta.cc:287] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:19:16.794162 21598 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.805449 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1543) took 1601 ms. Trace:
I20260709 13:19:16.815963 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.800253 21684 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.818660 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:16.821998 19219 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:16.795064 21804 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:16.795958 21787 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:16.841342 21829 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:16.850451 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1533) took 1699 ms. Trace:
I20260709 13:19:16.850579 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:16.851194 21576 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:19:16.853027 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 80852.4us
I20260709 13:19:16.853332 21842 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:19:16.853752 21622 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.804862 19072 rpcz_store.cc:276] 0709 13:19:15.625683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.223781 (+598098us) service_pool.cc:224] Handling call
0709 13:19:16.231328 (+  7547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:16.231597 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:16.386809 (+155212us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.586083 (+199274us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:16.586926 (+   843us) log.cc:844] Serialized 52 byte log entry
0709 13:19:16.587137 (+   211us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:16.587418 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.587798 (+   380us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.587986 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.588070 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.728021 (+139951us) raft_consensus.cc:1685] finished
0709 13:19:16.728043 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.752405 (+ 24362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213492,"prepare.queue_time_us":321478,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":127,"raft.queue_time_us":64166,"raft.run_cpu_time_us":473,"raft.run_wall_time_us":5681,"thread_start_us":136451,"threads_started":1,"wal-append.queue_time_us":263382}
I20260709 13:19:16.857440 21701 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.858623 21770 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:16.825317 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.638s (SENT) [suppressed 2 similar messages]
I20260709 13:19:16.818370 19065 rpcz_store.cc:276] 0709 13:19:15.088201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.204751 (+1116550us) service_pool.cc:224] Handling call
0709 13:19:16.383489 (+178738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.384097 (+   608us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:16.384798 (+   701us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.689290 (+304492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.689353 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:16.689412 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.689491 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.689640 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149198,"prepare.queue_time_us":157526,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":68,"raft.queue_time_us":188764,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7050,"thread_start_us":153566,"threads_started":1,"wal-append.queue_time_us":367489}
I20260709 13:19:16.869848 19221 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:16.821103 21696 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.864408 21827 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.869609 21787 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.900538 21684 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:16.871438 21191 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.906139 21329 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.869596 19071 rpcz_store.cc:276] 0709 13:19:15.077130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.077276 (+   146us) service_pool.cc:224] Handling call
0709 13:19:15.077581 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.104186 (+ 26605us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:15.885860 (+781674us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.741756 (+855896us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.765189 (+ 23433us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.765298 (+   109us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:16.765318 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.767401 (+  2083us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.776577 (+  9176us) raft_consensus.cc:1685] finished
0709 13:19:16.776599 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.776719 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236181,"prepare.queue_time_us":1227406,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":187237,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":81860,"thread_start_us":792130,"threads_started":2,"wal-append.queue_time_us":481612}
W20260709 13:19:16.943635 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 62049.3us
I20260709 13:19:16.944767 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:16.829504 21778 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:16.948369 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:16.951876 19216 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:16.953763 21846 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:19:16.956018 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:16.958031 21719 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:16.958554 21719 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.958700 21799 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:16.958946 21719 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.959414 21799 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.961462 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:16.961665 21799 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:16.951643 21842 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:19:16.962667 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:16.963071 21842 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:16.963191 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:16.963413 19141 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 5.
I20260709 13:19:16.963563 21842 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:16.963856 19139 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:16.889734 21514 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:19:16.962334 21799 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:16.957834 21686 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:16.964612 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:16.943120 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:16.961464 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:16.977198 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:16.973508 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:17.004693 19142 raft_consensus.cc:606] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:17.005213 19142 raft_consensus.cc:614] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:16.962037 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:17.010581 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.011579 19220 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:16.941521 21606 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.023114 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.047925 19063 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:17.048580 19745 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:17.051637 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.052412 19220 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:17.053169 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.943984 21716 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.055317 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:17.056165 19143 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:17.046350 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.059744 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:17.062011 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:16.951673 21723 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:17.072486 19213 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:17.075129 19138 raft_consensus.cc:2410] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:17.069756 19144 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:17.072407 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:16.946600 21804 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:16.965402 21829 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.091181 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.086436 19146 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:17.096393 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.098583 19068 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:17.099574 19145 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.101384 21840 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:19:17.109902 19139 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:17.110284 19139 pending_rounds.cc:85] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 2
I20260709 13:19:17.110504 19139 pending_rounds.cc:107] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:17.110702 19139 raft_consensus.cc:2889] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:17.112941 21783 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 13:19:17.114404 21810 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.964633 21842 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.116582 19220 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.024030 21799 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:17.121328 21851 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:19:17.123046 21850 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:17.122838 21787 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.125774 21759 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.126843 21759 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.117486 21081 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.137272 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:17.138078 21816 consensus_meta.cc:287] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.831s	user 0.005s	sys 0.008s
I20260709 13:19:17.139040 19218 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:17.141803 19214 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:17.174162 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:17.142779 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 321584us
W20260709 13:19:17.174872 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.183883 21081 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:17.184335 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.148600 19072 raft_consensus.cc:2368] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:17.182300 21701 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.192492 19218 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.143723 21816 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:17.203317 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 146170us
I20260709 13:19:17.118396 21723 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.148597 21787 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:17.209980 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 260878us
I20260709 13:19:17.165637 21686 consensus_queue.cc:1243] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:17.210791 21695 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.225672 21695 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:17.226248 21695 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.229884 19064 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:17.230218 21514 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:17.230566 21514 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:17.231113 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.231571 21514 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.234990 21799 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.237053 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.237795 19139 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:17.237088 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.216048 21716 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:17.217388 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 701310a5195343c081bea195df509e65: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:17.245880 19184 connection.cc:256] RPC call timeout handler was delayed by -4.73229444000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 13:19:17.245985 21842 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:17.246678 19184 connection.cc:256] RPC call timeout handler was delayed by -3.6075735440001608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:19:17.247033 19184 connection.cc:256] RPC call timeout handler was delayed by -3.5679735440000968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:19:17.247341 19184 connection.cc:256] RPC call timeout handler was delayed by -3.5474945119999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:19:17.247668 19184 connection.cc:256] RPC call timeout handler was delayed by -3.4718945119998352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 13:19:17.247954 19184 connection.cc:256] RPC call timeout handler was delayed by -3.4637945119998221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:19:17.248227 19184 connection.cc:256] RPC call timeout handler was delayed by -3.4340945120000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:19:17.248481 19184 connection.cc:256] RPC call timeout handler was delayed by -3.3269945119998283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:19:17.248745 19184 connection.cc:256] RPC call timeout handler was delayed by -3.1224735440000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 13:19:17.249060 19184 connection.cc:256] RPC call timeout handler was delayed by -3.12089451199995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 13:19:17.208783 21778 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:17.213073 21827 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.221475 21606 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:17.250696 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.221618 21723 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.222883 21804 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:17.222939 21719 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.223690 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.214581 19216 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:17.241786 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:17.243984 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:17.244114 21829 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:17.249487 19184 connection.cc:256] RPC call timeout handler was delayed by -3.0749945119998756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:19:17.253549 19184 connection.cc:256] RPC call timeout handler was delayed by -2.9390945119998833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:19:17.254120 19184 connection.cc:256] RPC call timeout handler was delayed by -2.4962945119998494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27080000000000004s for a response
I20260709 13:19:17.257357 19035 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:17.209146 21696 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.306386 19071 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.268767 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1577) took 2518 ms. Trace:
I20260709 13:19:17.284018 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:17.289430 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.311293 19217 rpcz_store.cc:276] 0709 13:19:14.749956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.072040 (+322084us) service_pool.cc:224] Handling call
0709 13:19:15.093205 (+ 21165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.460557 (+1367352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.268497 (+807940us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400003054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:17.268690 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3011151232}
I20260709 13:19:17.242029 21514 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:17.272186 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.289096 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.269124 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:17.315192 19069 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.317477 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.268040 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.321316 19714 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:17.323626 19220 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:17.324127 19140 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:17.265245 21349 consensus_meta.cc:287] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.004s
W20260709 13:19:17.269912 21857 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:17.331904 21827 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:17.332281 19748 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:19:17.332451 21676 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:17.332942 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:17.333887 19142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "701310a5195343c081bea195df509e65"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:17.334538 19142 raft_consensus.cc:606] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:17.334923 19142 raft_consensus.cc:614] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:17.335686 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:17.336551 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.337664 19212 raft_consensus.cc:2410] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:17.338090 19142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:17.338594 19142 raft_consensus.cc:606] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:17.338907 19142 raft_consensus.cc:614] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:17.340268 19745 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:19:17.340459 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 56649us
W20260709 13:19:17.341063 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 331466us
I20260709 13:19:17.341214 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.341660 21783 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:17.341740 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1556) took 1716 ms. Trace:
I20260709 13:19:17.342423 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.342149 21783 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:17.343468 21783 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.343555 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:17.343811 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.345929 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.347079 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.347667 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:17.347604 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:17.338604 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.342193 19066 rpcz_store.cc:276] 0709 13:19:15.625419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.210508 (+585089us) service_pool.cc:224] Handling call
0709 13:19:16.210785 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.210969 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:16.676985 (+466016us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.090209 (+413224us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.239455 (+149246us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b180030d900. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610745e58f 00007f610049d571 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd
0709 13:19:17.341293 (+101838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:17.341358 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:17.341401 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.341477 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.341588 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266485,"prepare.queue_time_us":26176,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":301744,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12072,"spinlock_wait_cycles":2697088,"thread_start_us":242754,"threads_started":1,"wal-append.queue_time_us":349812}
I20260709 13:19:17.344655 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:17.349084 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:17.342288 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:17.271364 21816 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:17.351851 21696 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:17.352571 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 110737us
I20260709 13:19:17.353176 21427 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.353322 21676 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:17.354729 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.258205 21686 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.355291 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 98042.1us
W20260709 13:19:17.331089 21598 consensus_meta.cc:287] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.001s
I20260709 13:19:17.359212 19110 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:17.366566 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:17.358984 21801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.015s	sys 0.015s
I20260709 13:19:17.371454 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:17.373409 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52230.5us
I20260709 13:19:17.374612 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:17.372828 21081 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:19:17.369784 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.357383 21827 raft_consensus.cc:697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:17.369395 21720 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:17.360262 21802 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:17.378818 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:17.371348 21801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.015s	sys 0.015s
I20260709 13:19:17.330821 21695 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.384202 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.381517 21700 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:17.374361 21458 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:17.386368 19142 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:17.386303 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.349917 21349 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.389403 19067 raft_consensus.cc:2393] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:17.393375 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.375487 21598 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.395624 19065 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:17.395728 21827 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.396553 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.397275 21598 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.397639 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:17.398176 19065 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.399197 21458 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:17.400174 21458 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.407196 19069 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:17.408147 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.375300 21427 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.381443 21676 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:17.417033 19139 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:17.425366 21720 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:17.426999 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.385288 21802 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:17.389812 21700 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:17.430523 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.430192 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.434912 19218 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:17.441059 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:17.441473 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.439101 21802 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.459537 19218 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.442749 21720 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.446635 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:17.449065 21598 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:19:17.453912 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 0d6b40b78ed348b0ad0b2c0f3d648061: Illegal state: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:17.452684 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:17.457202 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 70949.3us
I20260709 13:19:17.458252 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:17.471485 19071 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:17.495741 19069 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:17.494846 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 114607us
W20260709 13:19:17.492652 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 137984us
I20260709 13:19:17.385993 21686 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.460021 21700 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:17.509308 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 118145us
W20260709 13:19:17.511564 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 59028.2us
I20260709 13:19:17.549993 19070 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.428315 21783 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.558736 19218 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:17.567827 21875 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:17.549782 21622 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:17.549279 21701 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:17.577195 19065 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:17.578302 19066 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.586395 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.587026 19220 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.553526 21719 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.592404 19218 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:17.556221 21696 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.596632 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.597304 19218 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:17.597896 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 61d161ec86f94a4eaf383729c1ddbc87: Illegal state: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:17.604909 19220 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:17.606539 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.610487 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.589547 21695 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:17.637799 19142 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:17.639763 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.579120 21701 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:17.640934 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:17.616751 18967 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 4, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 4 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.643373 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.597174 21622 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:17.644865 19138 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:17.646449 21701 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.654498 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.655093 19145 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:17.656668 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:17.657490 21622 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.658120 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:17.660179 19216 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:17.615809 21804 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.663005 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:17.663848 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 67277.4us
I20260709 13:19:17.602348 21759 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:19:17.663250 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.648741 19218 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.680516 19218 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:17.646792 19744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 443) took 2514 ms (client timeout 1606 ms). Trace:
I20260709 13:19:17.679636 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.683696 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.694563 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.695322 19144 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:17.650614 21696 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.678829 21427 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:17.682716 21349 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:17.704514 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.705515 19143 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:17.709165 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.692376 21864 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:17.684898 21827 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:19:17.715890 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 52986.2us
W20260709 13:19:17.724310 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.737433 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.738343 19144 raft_consensus.cc:2410] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:17.739506 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:17.740767 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:19:17.758658 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.684892 19744 rpcz_store.cc:269] 0709 13:19:15.098827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.105720 (+  6893us) service_pool.cc:224] Handling call
0709 13:19:15.672900 (+567180us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:17.573514 (+1900614us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54005fc154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:17.613655 (+ 40141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499883648}
I20260709 13:19:17.714636 21676 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:17.742515 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69747.5us
I20260709 13:19:17.747512 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:17.753206 21879 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 13:19:17.757313 21877 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:19:17.752480 21704 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:17.861308 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.741138 21864 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:17.888475 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.793536 19217 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.903118 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.834242 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.907505 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:17.910293 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:17.746380 21783 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.834913 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:17.838069 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.872085 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.745715 21686 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:17.888984 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.922313 19220 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:17.742468 21696 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:17.914619 19139 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
W20260709 13:19:17.858719 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 85579.9us
I20260709 13:19:17.866180 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.786365 21778 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.910692 21864 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:17.919806 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:17.921059 19063 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:17.912715 21704 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:17.905051 21690 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:17.860041 21842 consensus_meta.cc:287] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.004s
I20260709 13:19:17.927347 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:17.925096 19069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:19:17.930421 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.915829 21576 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.934588 19213 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:17.962184 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:17.930619 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:17.912456 21349 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:17.933533 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:17.976109 19216 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:17.934455 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:17.974560 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.932989 19744 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:17.979002 19213 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:19:17.979511 19220 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.976589 19069 raft_consensus.cc:606] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:17.980705 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:17.981824 21704 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:17.983080 21594 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.935755 21690 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:17.979439 19213 pending_rounds.cc:85] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:17.934121 21778 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.988678 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:17.980144 21622 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:17.995082 19069 raft_consensus.cc:614] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:17.987452 21822 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:18.039865 19213 pending_rounds.cc:107] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:19:18.051884 19213 raft_consensus.cc:2889] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:17.933467 21816 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:18.040936 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 54167.8us
W20260709 13:19:18.053236 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 233845us
I20260709 13:19:17.990403 19143 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:18.039635 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:18.054383 19144 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:17.934057 21864 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.925355 21701 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:17.936009 21783 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:18.039427 21874 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:18.057595 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 124004us
I20260709 13:19:18.059674 19146 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
W20260709 13:19:18.060829 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 188817us
I20260709 13:19:18.044059 21778 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.071933 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.045985 21622 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:18.054728 21704 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.076568 19141 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:18.075337 19217 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:17.990828 21349 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.041795 21594 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.058807 21822 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:18.058338 21874 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:18.087713 19110 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.077404 21622 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.093627 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:18.096568 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.101651 19220 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:18.107817 21822 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.112149 21576 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.082412 21783 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:18.095752 21700 consensus_meta.cc:287] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.003s
I20260709 13:19:18.118597 21527 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:18.119716 19068 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:18.119855 19113 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.092972 21875 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.120847 21686 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:19:18.105057 21690 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:18.123742 21891 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:18.124217 19215 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:18.124442 21890 log.cc:927] Time spent T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:19:18.125360 21894 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:19:18.125243 21874 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.127240 21349 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:18.130546 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.173892 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.174679 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.175050 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.175307 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.141918 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.145412 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1597) took 1012 ms. Trace:
I20260709 13:19:18.145550 19144 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:18.105046 21816 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.101888 21895 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:18.146328 19714 leader_election.cc:336] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.668s (SENT)
I20260709 13:19:18.177687 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:18.116277 21883 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:18.185925 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 106451us
I20260709 13:19:18.176937 19215 rpcz_store.cc:276] 0709 13:19:17.133467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.123529 (+990062us) service_pool.cc:224] Handling call
0709 13:19:18.123954 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.145133 (+ 21179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.145332 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:18.186631 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 111997us
I20260709 13:19:18.190037 19035 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.197331 19144 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.141764 21787 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:18.198963 19065 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:18.197793 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:18.201553 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.173147 21212 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.216189 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:18.216666 19221 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:18.189144 21696 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:18.222225 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1606) took 1014 ms. Trace:
I20260709 13:19:18.224085 19220 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:18.225154 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.226302 21810 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.226639 21635 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:18.227012 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.221635 21212 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:18.227543 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.228243 19068 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:18.229130 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:18.229220 19035 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.222867 19214 rpcz_store.cc:276] 0709 13:19:17.207671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.172538 (+964867us) service_pool.cc:224] Handling call
0709 13:19:18.222158 (+ 49620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:18.192948 21895 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:18.226683 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:18.202292 21690 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.223182 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.214067 21874 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:18.237082 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.141283 21700 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.213954 21875 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:18.240962 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 94644.9us
W20260709 13:19:18.246428 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.237301 21686 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:18.236159 21895 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.256526 19035 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.239596 21635 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.258988 21635 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.259577 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.259474 21635 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.261055 21527 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.261438 21527 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:18.261627 21635 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:18.261823 21527 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.264003 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:18.264016 21810 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:18.265462 21810 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:18.265978 21810 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.268921 19065 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.245855 21822 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.234442 21787 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.245697 21598 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:18.252239 21701 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:18.280683 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.283267 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.257498 21686 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.229825 21783 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.289000 19144 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:18.293967 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:18.281597 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 139735us
W20260709 13:19:18.282688 21802 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.786s	user 0.007s	sys 0.004s
I20260709 13:19:18.275331 21822 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.301204 21081 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.254762 21458 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:19:18.296221 21888 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:19:18.309230 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:18.310169 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.296697 21686 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.298144 21719 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.306568 21802 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.304965 21822 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.334510 21081 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.325680 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.296772 21759 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:18.339036 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:18.340504 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:18.341064 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.348523 21719 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.351423 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:18.352594 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:18.357471 19143 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:18.361465 21700 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:18.338559 21716 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:18.362532 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1607) took 1120 ms. Trace:
I20260709 13:19:18.362939 19212 rpcz_store.cc:276] 0709 13:19:17.242008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.394324 (+152316us) service_pool.cc:224] Handling call
0709 13:19:17.394621 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.420311 (+ 25690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.420354 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.433924 (+ 13570us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.122291 (+688367us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b1800355180. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:19:18.246833 (+124542us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:18.246874 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.246926 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.362246 (+115320us) raft_consensus.cc:1685] finished
0709 13:19:18.362267 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.362474 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25186,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9473,"spinlock_wait_cycles":14690176,"thread_start_us":124349,"threads_started":1,"wal-append.queue_time_us":860306}
I20260709 13:19:18.363826 19143 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:18.307083 21635 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:19:18.369513 21896 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:19:18.372357 21802 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:18.375924 19218 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:18.375321 19212 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:18.377032 19221 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:18.377650 19215 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:18.378027 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:18.383149 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1800) took 1178 ms. Trace:
I20260709 13:19:18.383545 19146 rpcz_store.cc:276] 0709 13:19:17.206440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.206580 (+   140us) service_pool.cc:224] Handling call
0709 13:19:18.382953 (+1176373us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54002b89d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:18.383091 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667314048}
W20260709 13:19:18.387460 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.386273 21527 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.340329 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:18.400136 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.401844 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:18.401741 21802 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:18.402592 21719 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:18.403343 21719 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:18.404783 21883 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:18.404466 21719 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.408455 21878 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:18.335135 21696 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:18.415642 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 73254.8us
W20260709 13:19:18.417531 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 82060.7us
I20260709 13:19:18.362710 21716 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:18.420799 21081 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.409448 21802 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:18.429001 21802 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:18.429895 21802 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.430876 21802 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.433336 21696 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.434870 21594 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:18.436942 21816 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.440145 21272 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:18.440510 21272 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:18.441291 21272 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.443487 21716 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.447201 19220 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:18.449294 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:18.449688 18967 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 4, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 4 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:18.450923 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 121560us
I20260709 13:19:18.451721 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:18.453743 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:18.454527 19220 raft_consensus.cc:2410] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 9 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:19:18.456774 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 160113us
I20260709 13:19:18.458637 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:18.457131 21622 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.463795 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:18.472723 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 56231.6us
I20260709 13:19:18.460624 18967 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 4, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 4 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:18.480340 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 257251us
W20260709 13:19:18.466141 21906 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.186s	user 0.000s	sys 0.003s
I20260709 13:19:18.418754 21883 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:19:18.462206 21816 raft_consensus.cc:2764] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:18.418637 21895 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.460601 21827 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:19:18.464496 21911 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:18.500495 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:18.497676 21915 raft_consensus.cc:2764] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:18.502367 21527 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:18.481025 21875 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.422221 21864 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.504088 19140 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:18.505082 21864 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:18.500734 21622 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:18.498020 18967 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:18.509096 18968 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60514 (request call id 219) took 31790 ms (client timeout 15000 ms). Trace:
I20260709 13:19:18.463214 21594 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:19:18.514358 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54057.8us
I20260709 13:19:18.516630 19144 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:18.521585 19072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1791) took 1634 ms (client timeout 1961 ms). Trace:
I20260709 13:19:18.515722 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.522430 21514 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:18.522850 21514 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:18.522908 21922 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:18.523391 19064 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:18.523788 21514 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:18.525017 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.522166 19072 rpcz_store.cc:269] 0709 13:19:16.887653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.976587 (+ 88934us) service_pool.cc:224] Handling call
0709 13:19:18.521250 (+1544663us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b540024b654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:18.521469 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214809344}
I20260709 13:19:18.462905 21778 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.531209 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.529959 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:18.586977 21816 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.587402 21816 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:18.587765 21816 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.591848 21212 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:18.597525 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 81141.3us
I20260709 13:19:18.532213 18967 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 2 to 3, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 3 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.484714 21801 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:18.543911 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 231) took 1539 ms. Trace:
I20260709 13:19:18.541378 21787 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:18.542768 21842 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.552963 21822 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.554162 21778 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:18.554286 21514 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:18.511407 18968 rpcz_store.cc:269] 0709 13:18:46.666367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.671932 (+  5565us) service_pool.cc:224] Handling call
0709 13:19:18.448860 (+31776928us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:06.531823 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:06.576564 (+ 44741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:06.576617 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:19:06.576634 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:06.650156 (+ 73522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:06.658362 (+  8206us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:06.669528 (+ 11166us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:06.684846 (+ 15318us) tablet.cc:701] Row locks acquired
0709 13:19:06.688925 (+  4079us) write_op.cc:260] PREPARE: finished
0709 13:19:06.689099 (+   174us) write_op.cc:270] Start()
0709 13:19:06.689257 (+   158us) write_op.cc:276] Timestamp: P: 1783603146689042 usec, L: 0
0709 13:19:06.689280 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:06.716404 (+ 27124us) log.cc:844] Serialized 2064 byte log entry
0709 13:19:07.583501 (+867097us) op_driver.cc:464] REPLICATION: finished
0709 13:19:07.834588 (+251087us) write_op.cc:301] APPLY: starting
0709 13:19:07.896631 (+ 62043us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:08.343672 (+447041us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:08.380024 (+ 36352us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:08.464481 (+ 84457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:08.464774 (+   293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:19:08.464824 (+    50us) write_op.cc:312] APPLY: finished
0709 13:19:08.465146 (+   322us) log.cc:844] Serialized 47 byte log entry
0709 13:19:08.602193 (+137047us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.697836 (+ 95643us) write_op.cc:454] Released schema lock
0709 13:19:08.697909 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:08.702542 (+  4633us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.702586 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":520498,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":136986,"apply.run_cpu_time_us":27723,"apply.run_wall_time_us":959415,"num_ops":5,"prepare.queue_time_us":105846,"prepare.run_cpu_time_us":63883,"prepare.run_wall_time_us":555775,"raft.queue_time_us":327142,"raft.run_cpu_time_us":20716,"raft.run_wall_time_us":61463,"replication_time_us":894061,"thread_start_us":513660,"threads_started":5,"wal-append.queue_time_us":590713,"wal-append.run_cpu_time_us":35105,"wal-append.run_wall_time_us":2478394}]]}
W20260709 13:19:18.557181 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 56811.2us
I20260709 13:19:18.560482 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1567) took 1186 ms. Trace:
I20260709 13:19:18.514297 21576 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:19:18.642900 19110 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.531762 21810 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.645131 21810 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:18.563422 21918 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.563927 21911 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:18.649128 21911 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:18.564374 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48768.6us
I20260709 13:19:18.564791 21895 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:18.564980 21690 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.571786 21272 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.577952 19144 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:18.579389 21686 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:18.582522 21912 log.cc:927] Time spent T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:19:18.584589 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:18.660815 18967 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 4, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 4 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.516839 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:18.601886 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:18.624308 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.667863 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.629757 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.639786 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:18.668967 19214 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:18.639380 19066 rpcz_store.cc:276] 0709 13:19:17.373768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.442470 (+ 68702us) service_pool.cc:224] Handling call
0709 13:19:17.442776 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.578964 (+136188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.560247 (+981283us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540025ce54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:18.560424 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311374592}
I20260709 13:19:18.653209 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.598572 19147 rpcz_store.cc:276] 0709 13:19:16.960434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.964656 (+  4222us) service_pool.cc:224] Handling call
0709 13:19:16.965198 (+   542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:17.164890 (+199692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.164922 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:17.211550 (+ 46628us) log.cc:844] Serialized 52 byte log entry
0709 13:19:17.320242 (+108692us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:18.112182 (+791940us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18003591a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6106f823c7 00007f61035949a7 00007f61035a40bf 00007f61035a4038
0709 13:19:18.217862 (+105680us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.236916 (+ 19054us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.451864 (+214948us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18003591a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287 00007f61035a5208
0709 13:19:18.498797 (+ 46933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.498867 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.498914 (+    47us) raft_consensus.cc:1685] finished
0709 13:19:18.498928 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.500038 (+  1110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196267,"prepare.queue_time_us":794350,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":574047,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":42806,"spinlock_wait_cycles":9402368,"thread_start_us":350822,"threads_started":4,"wal-append.queue_time_us":149385}
I20260709 13:19:18.636159 21598 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:19:18.676458 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.667155 19213 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
W20260709 13:19:18.667155 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 150371us
I20260709 13:19:18.682349 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:18.657040 21690 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.683431 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:18.640854 21594 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:18.690416 19217 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:18.691234 19140 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:18.643038 21827 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:18.692317 19216 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:18.694031 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:18.706529 19214 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:18.706526 21081 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.707633 21081 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.707995 21081 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:18.708282 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 234889us
I20260709 13:19:18.694897 21927 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:18.697400 21922 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.686692 21778 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:19:18.682144 21918 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.699513 21686 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:18.700003 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57214.3us
I20260709 13:19:18.701071 18967 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.687080 21690 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.701987 21822 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:18.696561 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:18.718160 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.718333 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:18.719385 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:18.685763 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:18.713799 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:18.686733 21801 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.711772 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:18.721555 19217 raft_consensus.cc:2368] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:18.724603 19213 raft_consensus.cc:2368] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7.
I20260709 13:19:18.704298 21704 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.706835 21598 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:18.736752 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.730183 19214 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:18.739351 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:18.740417 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:18.695883 21759 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:19:18.715749 21918 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.744644 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:18.745218 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.725483 21915 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:18.732118 21927 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:18.748026 21700 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:18.717521 21922 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.748068 18967 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:19:18.750916 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:18.751410 21696 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.726157 21594 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:18.725733 21676 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:19:18.733749 21598 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:18.771983 21081 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.753983 21897 raft_consensus.cc:3055] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:18.758212 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.758255 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 72572.1us
W20260709 13:19:18.760361 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.777437 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.762511 19113 leader_election.cc:400] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:18.778172 19113 leader_election.cc:403] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:18.731361 21874 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:18.767976 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.761246 21635 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.753604 21863 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:18.773600 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:18.757678 21883 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.783280 21081 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:18.784152 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:18.785112 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.759889 21918 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.765229 21915 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:18.742161 21704 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.760664 21701 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:19:18.763475 21878 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:19:18.780221 21897 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:18.785970 21635 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:18.787885 21883 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:18.789710 21932 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:18.796187 21915 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:18.820338 21081 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:18.800854 21863 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:18.812893 21635 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.811774 21883 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.790902 21720 consensus_queue.cc:1059] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:19:18.889083 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 152378us
I20260709 13:19:18.804637 21874 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:19:18.895171 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.896204 21719 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:18.896646 21719 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:18.898265 21929 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:19:18.900385 21922 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:18.904174 21883 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.855351 21917 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:18.897712 21719 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.848232 21759 consensus_queue.cc:1243] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:18.814939 21816 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.919569 19213 pending_rounds.cc:85] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:18.905434 21917 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:18.851507 21801 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:19:18.927207 21935 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:18.926966 21917 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.928471 21917 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:18.930371 21924 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:18.919888 19213 pending_rounds.cc:107] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:19:18.934244 19213 raft_consensus.cc:2889] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:18.923840 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.924284 21759 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:18.946285 19218 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:18.948753 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:18.847699 21932 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.945055 21719 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.936419 21878 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:18.961827 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:18.936806 21759 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:18.969790 21210 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:18.963645 21863 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.970355 21210 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:18.954442 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:18.896569 21927 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:18.985245 21945 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:18.908763 21897 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:18.985570 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.087036 21527 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.971465 21759 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.025632 19066 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:19.017053 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:19.079461 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.093631 19069 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
W20260709 13:19:19.093783 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.026212 19068 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.095036 19035 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:19.107281 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 187793us
I20260709 13:19:19.090286 21527 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.110559 19747 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.110863 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:18.986014 21931 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:19:19.117017 21942 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:19.117656 21942 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.118685 21942 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.120487 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:19.121089 19746 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.122280 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:19.123601 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.129122 21676 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:19.129613 21676 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.130913 21676 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.132431 21676 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.133280 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:19.134776 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.136605 21787 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:19.137004 21787 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:19.137343 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:19.137764 21787 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.139004 21787 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.141448 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 249) took 1246 ms. Trace:
I20260709 13:19:19.141919 19071 rpcz_store.cc:276] 0709 13:19:17.894707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.894835 (+   128us) service_pool.cc:224] Handling call
0709 13:19:17.910470 (+ 15635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.105738 (+195268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:18.284250 (+178512us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.457906 (+173656us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:18.457992 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:18.458083 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.714097 (+256014us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b1800279b20. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419
0709 13:19:19.141194 (+427097us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54001b9c54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:19.141249 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.141383 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312064,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":124,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4523,"spinlock_wait_cycles":424214656,"thread_start_us":282426,"threads_started":2,"wal-append.queue_time_us":202685}
I20260709 13:19:19.145283 21926 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:19.145478 21946 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:19.145720 21926 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:19.146629 21926 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.147785 21926 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.986395 21951 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:19.149194 21951 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.088451 21210 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.150868 21946 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:19.151563 21897 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.151978 21946 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:18.991479 21878 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.152467 21946 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.153342 21946 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.153947 21878 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.154378 21946 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.154503 21878 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.153355 21883 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.152053 21527 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.121065 19750 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.129693 19743 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:19.160705 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 45780.4us
I20260709 13:19:19.015188 21704 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.066794 21822 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:19.181322 21081 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:19.184693 21081 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:19.184257 21822 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:19.185757 21945 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.203797 21944 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:19.204207 21952 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:19.204327 21944 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.205066 21952 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:19.205431 21952 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.205610 21941 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:19:19.205905 21081 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.206389 21941 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:19.206219 21952 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.206765 21941 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.206961 21081 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.207418 21952 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.207566 21941 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.190614 21917 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:19.234897 19068 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:19.197778 21816 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.240770 21951 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.241284 21917 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.241492 21822 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.243088 21822 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:19.208779 21941 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:19.248687 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48628.6us
I20260709 13:19:19.285712 21932 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.171748 21918 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.250600 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:19.210510 21954 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:19.340509 19714 leader_election.cc:336] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.638s (SENT)
I20260709 13:19:19.341557 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1391) took 1203 ms. Trace:
I20260709 13:19:19.332386 21945 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.357687 19146 rpcz_store.cc:276] 0709 13:19:18.138466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.384539 (+246073us) service_pool.cc:224] Handling call
0709 13:19:18.391801 (+  7262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.492026 (+100225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.492057 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.509671 (+ 17614us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.663287 (+153616us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:18.695664 (+ 32377us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.714439 (+ 18775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.714507 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.320904 (+606397us) raft_consensus.cc:1685] finished
0709 13:19:19.320926 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.341481 (+ 20555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104814,"prepare.queue_time_us":32150,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":105592,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8320,"thread_start_us":145156,"threads_started":1,"wal-append.queue_time_us":239422}
I20260709 13:19:19.288460 19744 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:19.380205 21925 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.568s	user 0.004s	sys 0.000s
W20260709 13:19:19.381918 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.452379 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 240553us
I20260709 13:19:19.360620 21210 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:19.452343 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 111869us
W20260709 13:19:19.452781 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.386925 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.459147 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.457949 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 207427us
W20260709 13:19:19.459668 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.459685 21081 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:19.460381 21081 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.465461 19750 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
W20260709 13:19:19.471469 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.471951 19069 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:19.473186 21514 consensus_meta.cc:287] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.000s
I20260709 13:19:19.474198 21598 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.475354 21598 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.477375 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:19.478021 21816 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.478494 21816 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.479144 19749 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:19.480450 21816 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.481148 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:19.481770 19071 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:19.482970 21915 consensus_meta.cc:287] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.015s
I20260709 13:19:19.483381 21915 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.484895 21081 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.485000 21878 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:19.486851 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 732443us
W20260709 13:19:19.487432 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.487277 21878 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.487718 19113 leader_election.cc:400] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7.
W20260709 13:19:19.487890 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.488104 19113 leader_election.cc:403] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:19:19.488272 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.488647 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.489071 21696 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.490732 19143 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:19.491072 19143 pending_rounds.cc:85] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 3
I20260709 13:19:19.491276 19143 pending_rounds.cc:107] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:19:19.486570 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 735658us
I20260709 13:19:19.486652 21842 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:19.486678 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1384) took 1521 ms. Trace:
I20260709 13:19:19.373917 21951 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.491483 19143 raft_consensus.cc:2889] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:19.493840 19749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 313) took 1624 ms (client timeout 1646 ms). Trace:
I20260709 13:19:19.496500 19063 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:19.510272 21081 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:19.509964 19749 rpcz_store.cc:269] 0709 13:19:17.869020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.910283 (+ 41263us) service_pool.cc:224] Handling call
0709 13:19:18.584313 (+674030us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:19.480805 (+896492us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400685454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:19.493773 (+ 12968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044259072}
I20260709 13:19:19.512624 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:19.513751 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 44317.9us
I20260709 13:19:19.515491 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:19.522043 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:19.523294 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:19.527585 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.528056 19144 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:19.528406 21915 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.524179 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:19.531703 19141 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:19.521426 21959 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:19.533270 21959 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:19.534555 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.534922 19141 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:19.535718 21922 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7.
I20260709 13:19:19.538151 19141 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:19.540104 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.545262 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:19.546036 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 203441us
I20260709 13:19:19.549099 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.550801 19145 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:19.496795 21917 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.554811 19147 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:19.556039 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:19.509941 21842 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.510564 19142 rpcz_store.cc:276] 0709 13:19:17.964815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.353884 (+389069us) service_pool.cc:224] Handling call
0709 13:19:18.354238 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.464322 (+110084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.464353 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.464989 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.734431 (+269442us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:18.766231 (+ 31800us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.486055 (+719824us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b180013ada0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287 00007f61035a5208
0709 13:19:19.486245 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.486326 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.486377 (+    51us) raft_consensus.cc:1685] finished
0709 13:19:19.486486 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.486619 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110271,"prepare.queue_time_us":32143,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3037,"raft.queue_time_us":869969,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":150,"spinlock_wait_cycles":11937664,"thread_start_us":269089,"threads_started":1,"wal-append.queue_time_us":347346}
I20260709 13:19:19.559238 21081 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.562124 21081 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.571017 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:19.573392 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:19.574035 19071 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:19.575345 19216 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:19.577605 19217 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:19.556916 21911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.039s
I20260709 13:19:19.554908 21915 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.555464 21863 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.580045 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.521785 21951 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.390844 21954 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.585045 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:19.560470 21810 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.564836 21842 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:19.590126 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.573251 21943 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:19.573534 21816 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:19.582067 21911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.013s	sys 0.039s
W20260709 13:19:19.596560 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.605643 19110 leader_election.cc:400] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5.
I20260709 13:19:19.613230 19110 leader_election.cc:403] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:19:19.593677 21810 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.595016 21895 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:19:19.625932 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.587934 21863 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.632555 21954 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.633288 21863 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.638317 21951 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.596096 21943 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:19.639452 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:19.641368 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.643437 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:19.643994 19138 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:19.645573 21960 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.311s	user 0.002s	sys 0.001s
I20260709 13:19:19.646103 19184 leader_election.cc:400] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:19.646416 19184 leader_election.cc:403] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:19.646799 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.647621 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:19.613351 21915 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:19.654498 21635 consensus_meta.cc:287] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.745s	user 0.015s	sys 0.000s
W20260709 13:19:19.648042 21759 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.005s
W20260709 13:19:19.656780 21690 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.918s	user 0.012s	sys 0.010s
I20260709 13:19:19.658051 21944 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:19.658565 21942 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.659034 21810 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:19.661284 19068 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:19.623323 21704 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5.
I20260709 13:19:19.655683 19141 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:19.679654 21949 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:19.682762 21897 consensus_meta.cc:287] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
W20260709 13:19:19.672827 21926 consensus_meta.cc:287] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.524s	user 0.018s	sys 0.003s
I20260709 13:19:19.670847 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:19.677155 21696 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:19.668231 21635 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.672680 21690 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.664934 21941 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:19.679955 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.722738 19141 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:19.667872 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:19.651484 21943 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.651672 21895 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:19.687196 21946 consensus_meta.cc:287] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.009s
I20260709 13:19:19.720997 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:19.723894 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 56124.1us
I20260709 13:19:19.798297 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:19.729748 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 59510.3us
I20260709 13:19:19.735102 19138 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:19.743705 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.747774 21842 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:19.715602 21719 consensus_meta.cc:287] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.746s	user 0.039s	sys 0.046s
I20260709 13:19:19.750392 21942 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:19.752188 21635 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.753291 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.809604 19142 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:19.807821 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:19.754159 19146 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:19.750442 21690 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.760380 19140 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:19.668524 21759 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:19.722491 21941 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.762425 19215 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:19.764981 21081 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.823005 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.767599 21878 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.821851 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:19.825079 19064 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:19.771189 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:19.773186 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:19.781208 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.826436 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:19.826730 19066 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:19.827085 19063 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
W20260709 13:19:19.788019 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.788565 21349 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:19.789045 21952 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:19.806403 21983 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:19.807264 19069 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.807729 21842 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:19.808849 19141 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:19.833647 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:19.812439 19139 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:19.766517 21918 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:19.834280 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.825184 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 329335us
I20260709 13:19:19.822002 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.808537 21932 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.829993 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.811385 21783 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:19.770412 19212 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:19.835528 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:19.817504 21922 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:19.836025 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:19.836722 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.837018 19214 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:19.837347 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:19.840193 19714 leader_election.cc:336] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.934s (SENT)
I20260709 13:19:19.844182 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.822525 21941 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.849805 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:19.852322 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet ddcb71ca04ee449ba3db37be4900a2cd: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:19.848048 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:19.861713 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:19.830583 21349 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:19.862350 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:19.870910 19213 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:19.819873 21883 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:19:19.866705 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.865311 21635 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:19:19.874552 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:19.874714 21982 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260709 13:19:19.878571 19213 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:19.845418 21922 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:19.878750 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:19.848078 21983 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.903059 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:19.894456 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.907442 19220 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.906701 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:19.882779 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.889812 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:19.937803 19143 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:19.934746 19141 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:19.868851 21915 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:19.945066 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:19.945581 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52054.9us
W20260709 13:19:19.877208 21957 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.110s	user 0.000s	sys 0.006s
I20260709 13:19:19.946949 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:19.866259 21874 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:19.955152 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:19.881186 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.957358 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:19.914247 21816 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:19:19.879766 21917 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.859115 21918 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:19:19.848249 21932 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:19.926187 21759 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:19.932327 21895 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:19.901429 21951 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.900059 21635 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:19.966331 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:19.865672 21949 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:19:19.987181 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:19.880679 21942 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:19:19.963490 21926 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.903290 21676 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:19:19.921950 21946 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:19:19.960146 21874 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:19.993196 19143 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.997080 19747 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:19.969614 21690 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:19.963749 21622 consensus_queue.cc:1059] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:20.003813 19213 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:19:20.002061 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57052.4us
I20260709 13:19:20.011499 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:20.012399 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:20.012213 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.730s (SENT)
I20260709 13:19:20.013083 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:20.013275 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.013821 19749 raft_consensus.cc:2376] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8. Re-sending same reply.
I20260709 13:19:20.014881 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:19.990986 21635 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:20.000101 21917 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:20.027081 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:20.001155 21696 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.038969 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.039983 19146 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.018687 21951 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:19.969731 21349 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.006361 21945 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:20.028070 21917 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:20.029556 21878 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.037014 21974 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.048307 21992 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:20.024520 21598 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:20.036366 21704 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.036218 21985 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:20.052296 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.084645 19143 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:20.053315 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.085626 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.030107 21978 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:20.080734 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.068928 19035 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:20.056058 19714 leader_election.cc:336] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.783s (SENT)
I20260709 13:19:20.093878 19750 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:20.061493 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.094916 19146 raft_consensus.cc:2410] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:20.072389 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.098313 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.099277 19067 raft_consensus.cc:2393] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:20.100026 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:19.999058 21922 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.081611 21992 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:20.066658 21976 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:20.058689 21349 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.107112 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:20.107906 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 51883.8us
I20260709 13:19:20.057539 21951 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:20.122872 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.124362 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.062775 21917 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.109781 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.127563 19071 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.049018 21816 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:19:20.053870 21926 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.112244 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.036829 21959 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.112721 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.062074 21932 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.113734 19067 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:20.105710 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.108119 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.056625 21941 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.060685 21945 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:20.129163 19748 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:20.130915 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 119485us
I20260709 13:19:20.131665 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:20.155795 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.101719 21883 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.025988 21915 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.132090 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.133786 19070 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:20.089047 21985 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.131542 21822 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:20.064658 21895 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:20.139925 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.125327 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.110767 21212 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.150354 19071 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:20.183148 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.183599 19216 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:20.183761 19071 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:20.102849 21978 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.065362 21878 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.063265 21943 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.088048 21704 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.121904 21801 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:20.029345 21983 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.127836 21974 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:19:20.171871 19144 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:20.169371 19749 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
W20260709 13:19:20.174113 19714 leader_election.cc:336] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.635s (SENT)
I20260709 13:19:20.179296 21822 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:20.175050 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.233911 21822 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.148350 21875 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:20.181335 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.234774 19065 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:20.234900 19145 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:20.235713 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.236480 19065 raft_consensus.cc:2410] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:20.237265 19138 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:20.169348 19035 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.176225 21954 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:20.204921 19714 leader_election.cc:336] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.701s (SENT)
I20260709 13:19:20.247124 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:20.113857 21958 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:19:20.201390 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.182190 21676 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:20.202275 19744 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 8: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:20.207221 21999 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:20.208602 21978 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.209501 19144 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:20.209117 21951 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.210291 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:20.213564 21990 log.cc:927] Time spent T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:19:20.175757 21985 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.217025 21622 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.219270 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.219569 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1439) took 1091 ms. Trace:
I20260709 13:19:20.220403 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1438) took 1092 ms. Trace:
I20260709 13:19:20.221865 21952 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:20.224694 21959 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.253633 21696 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.179548 21883 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.166877 21945 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:20.233863 19143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:20.242399 19067 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
W20260709 13:19:20.198375 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.251376 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 98253.9us
I20260709 13:19:20.252295 19064 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
W20260709 13:19:20.253062 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.254830 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49943.4us
I20260709 13:19:20.320111 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.256495 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.320843 19064 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:19:20.261797 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 92525.2us
I20260709 13:19:20.261852 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.274574 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.291458 19214 rpcz_store.cc:276] 0709 13:19:19.128244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.172885 (+ 44641us) service_pool.cc:224] Handling call
0709 13:19:19.187621 (+ 14736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.837590 (+649969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.219330 (+381740us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b540029de54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:20.219489 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487566208}
I20260709 13:19:20.323114 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.292811 19215 rpcz_store.cc:276] 0709 13:19:19.127952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.138088 (+ 10136us) service_pool.cc:224] Handling call
0709 13:19:19.138387 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.820178 (+681791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.220189 (+400011us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540035b6d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:20.220348 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434532608}
I20260709 13:19:20.227216 21994 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:20.248143 21576 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.313024 19143 raft_consensus.cc:606] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.337999 19143 raft_consensus.cc:614] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.323015 19070 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:20.314670 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:20.342170 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:20.343588 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:20.405537 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 59447.4us
W20260709 13:19:20.435596 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.261157 21897 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:20.406688 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:20.316323 19219 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.302915 19071 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
W20260709 13:19:20.318246 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.324733 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:20.460009 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 135391us
I20260709 13:19:20.306644 21952 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.460950 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.308205 21927 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.335299 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.468616 19067 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.280380 21875 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:20.336077 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.479656 19067 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:20.294461 22000 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:20.457993 19215 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:19:20.261348 21816 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:20.442281 21926 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.464418 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.434963 21210 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.336588 21994 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:20.445580 21942 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:20.434943 21720 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.488310 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.321944 21696 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.462455 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:20.521384 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 59024.5us
I20260709 13:19:20.522176 19035 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.464752 21759 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.460888 21944 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:20.500447 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 93878us
I20260709 13:19:20.472746 21863 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.310777 21622 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.477011 21801 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.489835 21915 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:20.511157 21998 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:19:20.511656 21986 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:20.506692 21942 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:20.490836 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.544926 19144 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.523157 19139 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.508064 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.546759 19071 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:20.525738 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.492105 21875 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:20.456862 21576 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.534168 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.479914 21927 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.280534 21999 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.205834 21992 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.524487 21810 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.501215 21816 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.506351 21926 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.534647 21958 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.551592 19066 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:20.563661 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.545531 21986 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.548133 21942 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.565287 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.537272 21941 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.523211 21720 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.586669 19144 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
W20260709 13:19:20.587795 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.500015 22000 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.500669 21945 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.556059 21801 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:20.601487 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.602289 19147 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.534865 21759 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.552353 21704 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.575896 19066 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:20.577250 22003 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:19:20.577428 22001 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
W20260709 13:19:20.578097 22007 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:20.567068 21943 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:20.575541 21878 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.558665 22011 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:20.549396 21911 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.560312 21783 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:20.588325 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.593138 21210 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:20.595669 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1807) took 1105 ms. Trace:
I20260709 13:19:20.598449 21720 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:20.599589 22009 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:20.600231 19070 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:20.573235 21986 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.612291 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.667532 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.725216 19147 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.725613 19138 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.605597 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.591406 21810 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.668241 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.730381 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:20.708791 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.674407 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.717442 19140 rpcz_store.cc:276] 0709 13:19:19.490031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.517550 (+ 27519us) service_pool.cc:224] Handling call
0709 13:19:20.595471 (+1077921us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400179dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:20.595594 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462234496}
I20260709 13:19:20.686221 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.716835 19144 raft_consensus.cc:2410] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:20.721383 19072 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:20.683789 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.736497 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.734987 19142 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:20.737962 19140 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.738574 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.665846 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:20.627033 21576 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.742439 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.742509 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.743427 19144 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.743703 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.743537 21952 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.744359 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.639323 21759 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.637480 21987 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:20.745540 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.745684 21952 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.745443 21987 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.746483 19144 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.746994 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1405) took 1083 ms. Trace:
I20260709 13:19:20.750370 19146 rpcz_store.cc:276] 0709 13:19:19.663683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.115015 (+451332us) service_pool.cc:224] Handling call
0709 13:19:20.118993 (+  3978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.119218 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.119239 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.126496 (+  7257us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.184229 (+ 57733us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:20.184264 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.184325 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.746809 (+562484us) raft_consensus.cc:1685] finished
0709 13:19:20.746829 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.746938 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":57455,"threads_started":1,"wal-append.queue_time_us":209024}
I20260709 13:19:20.752187 19146 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.752735 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1416) took 1062 ms. Trace:
I20260709 13:19:20.727425 22011 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.753204 19146 rpcz_store.cc:276] 0709 13:19:19.690284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.751762 (+1061478us) service_pool.cc:224] Handling call
0709 13:19:20.752023 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.752501 (+   478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.752663 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:20.646459 21926 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.754372 19146 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:20.754902 22011 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:20.755501 19146 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:20.676682 21875 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.755867 19146 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:20.755446 19140 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:20.756569 19146 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:20.758297 21954 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.001s
I20260709 13:19:20.760541 21926 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:20.665136 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:20.624975 21696 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:20.614331 21874 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.791356 21874 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:20.792922 22000 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.799482 21081 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:20.800206 21081 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:20.635042 21917 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.758220 19140 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.747541 21987 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.622550 21992 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.726379 21911 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.747761 19138 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:20.800860 21081 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:19:20.801222 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.747867 21863 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.762776 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:20.623970 21622 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.649118 21822 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.810060 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:20.625640 21816 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:20.774711 19714 leader_election.cc:336] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.940s (SENT)
I20260709 13:19:20.774109 21959 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.786026 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:20.829900 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 67214.7us
I20260709 13:19:20.758872 21954 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.767935 21878 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:20.767740 19147 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:20.791127 21985 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.790328 21922 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.803999 19140 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.902886 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:20.807129 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:20.810495 19749 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:20.770256 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.904378 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:20.904587 19143 raft_consensus.cc:2376] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6. Re-sending same reply.
I20260709 13:19:20.837522 19068 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:20.815725 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.817770 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:20.802937 21917 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.818279 19218 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:20.909873 19065 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:20.809962 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:20.801018 21349 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:20.812284 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:20.813478 19146 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.633281 21927 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.827045 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:20.672861 21635 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.833986 19141 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.768188 21958 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.831619 21918 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.805128 21943 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:20.806299 21883 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.815388 21911 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:20.803232 21949 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.817862 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:20.808580 21676 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:20.908609 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:20.908947 19139 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.909597 21954 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:20.780017 19142 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:20.964284 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.964849 19142 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:20.816851 21942 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:20.931121 21863 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.911514 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:20.912351 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.969280 19147 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:20.825675 21915 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:20.803123 21952 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:20.901317 21878 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.918884 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:20.930250 21635 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.930385 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:20.976200 19748 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:20.964576 21943 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.834467 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:20.978928 21943 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:20.767318 21810 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.932365 21973 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.982334 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.982887 19068 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.932736 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.933743 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.985442 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.985994 19064 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:20.986445 21942 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:20.986954 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.987393 19069 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:20.987623 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.934840 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:20.988993 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.989151 19220 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:20.989542 19069 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:20.990157 19220 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:20.990326 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:20.935606 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 160900us
I20260709 13:19:20.993420 21917 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:20.994347 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.995795 21992 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.936153 21272 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.834053 21842 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:19:20.942178 19140 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:20.835099 21959 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.942456 19146 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:20.945273 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:21.003324 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1423) took 1007 ms. Trace:
I20260709 13:19:21.003474 19065 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:20.946445 19071 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:20.947875 21719 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:20.802685 22011 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.965706 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:20.809707 21986 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:20.967031 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 58511.8us
I20260709 13:19:20.916298 22015 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:20.914377 21349 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:20.958752 21951 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.986774 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:20.936815 21964 raft_consensus.cc:3055] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:20.997203 19139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:21.024165 19139 raft_consensus.cc:606] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.024511 19139 raft_consensus.cc:614] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:20.997435 19214 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:19:20.999219 19714 leader_election.cc:336] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 2.882s (SENT)
I20260709 13:19:21.000229 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:20.930846 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.003717 19146 rpcz_store.cc:276] 0709 13:19:19.995672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.755146 (+759474us) service_pool.cc:224] Handling call
0709 13:19:20.755403 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.813080 (+ 57677us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b58004b8cd0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61034e60aa 00007f6103568447 00007f6103580fe7 00007f61035827de 00007f610358cb49 00007f610358d416 00007f6103589d8f 00007f610358983e 00007f610854e419 00007f6101ac5bd4
0709 13:19:21.003120 (+190040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.003277 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120190720}
I20260709 13:19:20.966374 21676 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.029055 22015 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.029548 22015 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.029961 22015 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:21.009291 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.033232 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.034118 21986 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.035048 19139 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:21.036264 19139 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:20.955780 21958 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.025480 21917 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:19:21.038380 21917 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:21.038450 21958 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.005311 21719 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:21.038794 21917 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:21.019623 22011 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.039582 21719 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.040954 21719 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.042193 21878 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.044198 21959 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.045077 21915 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.045676 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:21.046429 19745 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:21.047847 19145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.109s	sys 0.168s
I20260709 13:19:21.016211 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.048604 19063 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:21.048735 19219 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:21.020749 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:21.015689 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 425474us
I20260709 13:19:21.022907 19066 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.973035 21926 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.026000 19141 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:21.011078 21690 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:19:20.996269 21992 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:20.976315 21863 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.001483 21942 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.023422 21598 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:19:21.023694 21964 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:21.026126 21951 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.039664 21917 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:21.017110 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.021744 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:21.049775 19145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.109s	sys 0.168s
W20260709 13:19:21.087803 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 66191us
I20260709 13:19:21.088549 19110 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.050519 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:20.990849 19069 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:21.089792 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:20.971539 21954 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.053942 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.026859 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:21.094218 19064 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 7: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:21.094717 19068 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:21.095043 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.095597 19064 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:21.095793 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.096351 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.005743 21945 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.063227 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.099262 19063 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:20.976310 21952 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.070767 19146 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:21.037966 21985 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.071856 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:21.100867 19141 raft_consensus.cc:606] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:21.101238 19141 raft_consensus.cc:614] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:21.101395 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1413) took 1433 ms. Trace:
I20260709 13:19:21.028623 21918 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:19:21.078301 21878 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:20.968305 21949 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.090705 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.091280 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.096905 19064 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:21.071918 22011 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:21.093529 19065 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:21.100340 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.114451 19146 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.114859 19063 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:21.063869 19139 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:19:21.072669 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 73459.2us
I20260709 13:19:21.116472 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.116812 21959 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.117749 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.119303 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.121906 21992 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.122255 21999 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.125988 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1636) took 1070 ms. Trace:
I20260709 13:19:21.126349 19214 rpcz_store.cc:276] 0709 13:19:20.055641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.324034 (+268393us) service_pool.cc:224] Handling call
0709 13:19:20.324417 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.025228 (+700811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.125603 (+100375us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540014b4d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:21.125921 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547243776}
I20260709 13:19:21.127203 19215 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:21.127472 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.128670 19139 pending_rounds.cc:85] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 6
I20260709 13:19:21.129055 19139 pending_rounds.cc:107] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:21.129369 19139 raft_consensus.cc:2889] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.130669 19139 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:21.101408 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1579) took 1010 ms. Trace:
I20260709 13:19:21.100867 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.085230 21863 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.092617 21926 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.105680 19220 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:21.137702 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.101756 19145 rpcz_store.cc:276] 0709 13:19:19.667565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.235779 (+568214us) service_pool.cc:224] Handling call
0709 13:19:20.236118 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.236375 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:20.469215 (+232840us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.091090 (+621875us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.101107 (+ 10017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.101154 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:21.101194 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.101250 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.101347 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9785,"prepare.queue_time_us":334713,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":5125,"raft.queue_time_us":41308,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":853762,"threads_started":3,"wal-append.queue_time_us":112698}
I20260709 13:19:21.105269 19070 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
W20260709 13:19:21.109117 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 58681.2us
I20260709 13:19:21.131659 19072 rpcz_store.cc:276] 0709 13:19:20.090530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.092390 (+  1860us) service_pool.cc:224] Handling call
0709 13:19:21.101270 (+1008880us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:21.101361 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079675264}
I20260709 13:19:21.127465 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.141023 19214 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:21.104676 22025 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.110525 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.151306 19068 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:21.145099 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:21.106698 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 294366us
I20260709 13:19:21.132088 19066 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:21.132949 19217 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:21.081103 21942 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.134660 19139 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:21.093043 21986 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:21.104548 21927 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.105414 21917 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.144133 19145 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:21.139024 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:21.144394 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43601.7us
I20260709 13:19:21.162550 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.164111 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.164274 19144 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:21.146361 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.138278 19220 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:21.165431 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:21.166133 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.166596 19220 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.155791 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.110451 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.146919 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.148489 19146 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:21.170346 21883 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.170687 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.170869 21883 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.148312 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.171277 21883 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.171278 19146 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:21.172358 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.172904 19146 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:21.173625 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.173941 21932 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:21.174309 21932 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.174459 19146 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:21.174645 21932 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.175221 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.176213 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.177158 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.177927 19146 raft_consensus.cc:2410] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:21.179246 21883 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.107707 21822 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.136209 19063 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:21.180408 21272 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:21.171276 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.181907 21822 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.182255 21822 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.182331 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.182673 21822 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.183126 21081 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.137394 21810 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.186650 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:21.187248 19746 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:21.169399 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:21.190377 21081 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:21.168417 19139 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:21.157160 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.198486 19217 raft_consensus.cc:2410] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:19:21.207695 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43601.6us
I20260709 13:19:21.208397 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:21.211522 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.215655 19214 raft_consensus.cc:2410] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:21.216686 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.216955 22023 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:19:21.217245 21996 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.217103 21994 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.217793 21996 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:21.218168 21994 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.161199 21973 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:21.084810 21964 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.163733 21875 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.165167 21696 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.226897 21081 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:21.227098 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.229416 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.188619 21622 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:21.108943 21878 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.164835 22018 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.164342 21598 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.230746 19070 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:21.194408 21922 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.267115 22019 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:21.273768 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.274768 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.275734 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.234910 19068 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.246819 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.109095 21349 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.278956 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:21.165380 21986 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.285339 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1459) took 1265 ms. Trace:
I20260709 13:19:21.259543 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.194176 21927 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.261533 21802 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:21.246853 21943 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:21.258045 21999 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:21.229600 21875 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.165030 22011 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:19:21.284400 19069 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:21.287634 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 287440us
I20260709 13:19:21.232097 21696 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.248523 21918 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.285827 19216 rpcz_store.cc:276] 0709 13:19:20.019906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.238881 (+218975us) service_pool.cc:224] Handling call
0709 13:19:20.240073 (+  1192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.252139 (+ 12066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.252182 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.689812 (+437630us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b2c0003e7c8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:19:20.690311 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.008775 (+318464us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:21.008832 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.008923 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.268935 (+260012us) raft_consensus.cc:1685] finished
0709 13:19:21.268960 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.285275 (+ 16315us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5245,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":4610,"spinlock_wait_cycles":14714752,"thread_start_us":318028,"threads_started":1,"wal-append.queue_time_us":514672}
I20260709 13:19:21.276796 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:21.226665 19139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "701310a5195343c081bea195df509e65"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:21.310087 19139 raft_consensus.cc:606] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.310424 19139 raft_consensus.cc:614] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:21.269738 21964 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.186551 22025 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:21.299909 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.258553 21622 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.298579 19070 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.301571 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.279942 22019 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.312971 19069 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:21.292786 22000 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:21.293321 21922 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.321447 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.305054 21973 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:21.304643 21875 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.296646 21802 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.292536 22021 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.298254 21959 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:21.364032 21959 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.363900 22019 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.332705 19217 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.341548 19139 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.339708 21816 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:19:21.349213 21842 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:21.337121 22000 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:21.368582 22000 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:21.340384 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.369518 21922 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:21.369983 21922 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.370854 21922 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.371645 21932 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.372987 21985 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.297866 21992 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.308516 21696 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.308694 21349 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.293094 21822 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.361070 19068 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:19:21.361492 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.218653 21996 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.308430 21918 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.364502 21959 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:21.338814 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 62093.9us
I20260709 13:19:21.373721 21802 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:21.325472 21926 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.377648 19139 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
W20260709 13:19:21.381374 19714 leader_election.cc:336] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 2.082s (SENT)
I20260709 13:19:21.339865 21951 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:21.324491 21622 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.390863 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.399771 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.400858 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.373464 21985 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:21.406651 19751 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:19:21.411049 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1593) took 1210 ms. Trace:
I20260709 13:19:21.388170 21952 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.396325 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.391309 21918 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.410933 19751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 467) took 1202 ms. Trace:
I20260709 13:19:21.388532 21949 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:21.416430 19751 rpcz_store.cc:276] 0709 13:19:20.208610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.208808 (+   198us) service_pool.cc:224] Handling call
0709 13:19:21.395559 (+1186751us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:21.398504 (+  2945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.407035 (+  8531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.410850 (+  3815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16577792}
I20260709 13:19:21.420730 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:21.396130 19139 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.424595 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:21.422621 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.406852 21943 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.427541 19139 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.404171 21914 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.407639 22011 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:21.404233 21942 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.421437 19745 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:21.407310 21915 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.447319 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.405062 21895 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:19:21.403957 21926 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.428216 21719 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:21.407158 21999 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:19:21.387976 21927 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.469031 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:21.469789 19072 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.470227 19139 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:19:21.459755 22026 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:19:21.457012 21915 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.466367 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.450968 22011 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:21.472527 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.473903 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.404808 22015 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:21.475795 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.449860 21943 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:21.458698 21914 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.487490 19065 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:21.507776 19145 raft_consensus.cc:2368] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7.
I20260709 13:19:21.487958 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:21.507876 19139 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:21.509069 21943 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:21.507136 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 205636us
I20260709 13:19:21.509184 22015 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.510560 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.514811 19744 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:21.515430 22043 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:21.515254 21914 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:21.516381 22035 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:21.517714 21822 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:21.518646 22038 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:19:21.508030 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.521468 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.522030 19143 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.525779 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.527068 19142 raft_consensus.cc:2410] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:19:21.527803 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.528436 19142 raft_consensus.cc:2376] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6. Re-sending same reply.
I20260709 13:19:21.529405 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.530660 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.531862 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.532359 19072 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:21.532794 19142 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:21.483335 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.523267 19065 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:19:21.541253 22037 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:19:21.543342 19143 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:21.544255 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.544865 21987 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:21.545292 21987 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:21.546070 21987 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.547214 21987 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.514146 21878 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:21.483294 21915 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.478143 21719 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:21.484202 21999 consensus_queue.cc:1243] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:21.485760 22011 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.553592 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.552037 19035 leader_election.cc:400] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7.
I20260709 13:19:21.562530 19070 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.565033 19035 leader_election.cc:403] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.563051 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.566181 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:21.566428 19110 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.566704 19069 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.567203 19142 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.567516 19110 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.570343 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.568842 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.573648 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.575575 19069 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
W20260709 13:19:21.550380 22036 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:21.580463 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.534729 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:21.585281 19072 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.533495 21986 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:21.535054 21635 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
I20260709 13:19:21.589557 19069 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:21.562369 21576 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.533922 22019 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:21.600175 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 226658us
I20260709 13:19:21.563900 21932 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.577189 21878 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.609504 19142 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:21.611254 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:21.483012 21985 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.561973 22031 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:19:21.597380 21690 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.536234 21676 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.629411 19142 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:21.603174 22015 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.610267 22040 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:21.589838 21943 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.629788 19072 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:21.610443 21598 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:21.602232 22019 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.602157 22025 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:21.640300 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 66721us
I20260709 13:19:21.625334 21842 raft_consensus.cc:2764] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:21.638216 19216 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:21.642935 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:21.650597 19142 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:21.651275 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:21.682909 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.689287 22049 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:21.689742 21926 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.689864 22049 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.690346 22049 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.692000 21954 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:21.694054 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:21.695015 21974 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:21.695420 21974 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.696177 21974 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.700659 21974 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:21.706079 22044 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:19:21.706544 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 412) took 1386 ms. Trace:
W20260709 13:19:21.707165 22055 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:19:21.709877 22048 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:19:21.732107 21842 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.643257 21598 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:21.738399 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 87236.5us
I20260709 13:19:21.739233 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.637713 21719 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.706089 21958 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.638985 22040 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.753495 19744 raft_consensus.cc:2410] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:19:21.756304 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.756669 21598 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.757246 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1824) took 1271 ms. Trace:
I20260709 13:19:21.752220 21958 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.757592 19071 rpcz_store.cc:276] 0709 13:19:20.485783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.568769 (+ 82986us) service_pool.cc:224] Handling call
0709 13:19:20.946220 (+377451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.003978 (+ 57758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.757063 (+753085us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54002cbd50. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:21.757189 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849899904}
I20260709 13:19:21.759037 21958 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.707103 19742 rpcz_store.cc:276] 0709 13:19:20.209675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.217272 (+  7597us) service_pool.cc:224] Handling call
0709 13:19:20.217592 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.218055 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:20.218337 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.454314 (+1235977us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18001aa1c0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:19:21.467039 (+ 12725us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.537871 (+ 70832us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.538068 (+   197us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:21.538139 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.538252 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.563055 (+ 24803us) raft_consensus.cc:1685] finished
0709 13:19:21.570454 (+  7399us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.591936 (+ 21482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4780,"prepare.queue_time_us":28000,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":9866,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3883,"spinlock_wait_cycles":5081472,"thread_start_us":87828,"threads_started":1,"wal-append.queue_time_us":280963}
I20260709 13:19:21.760795 21842 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:21.761225 21842 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:21.761581 21842 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:21.761623 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:21.765312 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:21.765419 22056 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.766918 19066 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:19:21.767310 19071 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:19:21.768158 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.773420 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.774410 19220 raft_consensus.cc:2410] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:21.775596 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.766728 22056 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.780570 22016 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:21.781440 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:21.798264 19221 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.783885 21696 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.748826 22052 raft_consensus.cc:2764] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:21.785857 19220 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:21.787487 21576 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:21.788559 21676 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.788990 21964 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:21.789578 21992 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.791733 19213 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:21.792608 21945 consensus_meta.cc:287] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.000s
I20260709 13:19:21.746269 21926 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:21.829759 21875 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.831959 22056 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:21.832336 22061 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:21.833022 22056 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:21.834013 22056 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:21.834544 22056 consensus_queue.cc:1243] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:21.836007 22056 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:21.836340 22056 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.798466 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.831909 21875 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.788522 21802 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.821394 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.844695 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:21.766700 21690 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.826545 22000 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.826958 21992 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.828536 21943 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.841343 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1415) took 2151 ms. Trace:
I20260709 13:19:21.797909 21598 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:21.845197 19139 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:21.822781 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.849476 19144 rpcz_store.cc:276] 0709 13:19:19.689995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.750690 (+1060695us) service_pool.cc:224] Handling call
0709 13:19:20.750952 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.164620 (+413668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.841126 (+676506us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000ff5d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:21.841288 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949858048}
I20260709 13:19:21.852185 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.855103 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.847707 21802 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.848580 21932 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:21.858902 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:21.851656 19220 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:21.859201 21696 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:21.859048 21932 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.860036 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.856922 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.861948 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.868345 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.851194 21272 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:21.812016 21959 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.905093 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:21.847609 22052 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.859998 21992 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:21.847560 22061 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:21.867771 19038 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.868302 19212 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:21.816838 22016 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.903262 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:21.867591 19072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:19:21.911623 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:21.868448 19218 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:21.924177 19071 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.860073 21932 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:21.917902 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 71803us
I20260709 13:19:21.924263 19072 raft_consensus.cc:606] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:21.924589 19218 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:21.928597 19072 raft_consensus.cc:614] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:21.867574 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:21.926241 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 58548.7us
I20260709 13:19:21.928597 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:21.862917 21994 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.003s
I20260709 13:19:21.931135 19220 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
W20260709 13:19:21.870657 21917 consensus_meta.cc:287] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.000s
W20260709 13:19:21.937040 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.946285 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.936818 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:21.941395 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:21.947391 19212 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:21.853865 21842 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:21.942073 19218 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:21.943178 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:21.983966 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:21.984437 19146 raft_consensus.cc:2368] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8.
W20260709 13:19:21.943746 22051 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:21.978250 19221 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:21.949618 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:21.905838 21696 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:21.985282 19143 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
W20260709 13:19:21.953769 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.923339 21272 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:21.935950 22025 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:22.030855 19071 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:21.866969 21802 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:21.941422 21997 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:21.989877 19213 pending_rounds.cc:85] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 3
I20260709 13:19:22.045324 19213 pending_rounds.cc:107] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:21.910815 21622 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.037014 19144 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:21.862221 22056 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.038249 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:22.038012 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 54118us
I20260709 13:19:21.937932 21918 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.040795 21917 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:22.045631 19213 raft_consensus.cc:2889] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.864367 22065 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.179s
W20260709 13:19:22.043068 22063 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:19:22.050225 19146 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.050501 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:22.041744 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:22.037920 21810 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.086983 19746 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:21.946293 22049 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.045147 21997 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:22.054054 21622 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.041183 21696 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.057276 21272 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.068806 21922 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:22.084378 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.086221 19714 leader_election.cc:400] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8.
W20260709 13:19:22.100517 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 156338us
W20260709 13:19:22.104935 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 63265.5us
I20260709 13:19:22.106995 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.088460 22072 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:22.118696 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.098452 22025 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.121971 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 265) took 1123 ms. Trace:
I20260709 13:19:22.124004 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1468) took 1205 ms. Trace:
I20260709 13:19:22.122846 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:22.129390 22066 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:22.124465 19068 rpcz_store.cc:276] 0709 13:19:20.998342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.300184 (+301842us) service_pool.cc:224] Handling call
0709 13:19:21.320255 (+ 20071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.379891 (+ 59636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.121741 (+741850us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b540020a654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:22.121917 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93375744}
I20260709 13:19:22.130029 22066 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:22.131284 22049 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.131222 22066 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.133510 21922 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:22.134032 21922 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:22.134403 21932 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.135036 21922 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:22.137687 22064 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.002s
I20260709 13:19:22.138255 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:22.138831 19141 raft_consensus.cc:2376] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6. Re-sending same reply.
I20260709 13:19:22.139348 21696 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.139671 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:22.101351 22061 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.140204 19141 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:19:22.140686 22071 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:19:22.119421 21987 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.141467 21987 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.138255 21997 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.142707 22018 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:22.143127 22018 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:22.144147 21987 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.144001 22018 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.142726 21997 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.125403 19219 rpcz_store.cc:276] 0709 13:19:20.918419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.918615 (+   196us) service_pool.cc:224] Handling call
0709 13:19:22.123776 (+1205161us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b540034ce54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:22.123934 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112836352}
I20260709 13:19:22.100752 21958 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:22.150611 19066 raft_consensus.cc:2368] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
W20260709 13:19:22.150611 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46411.8us
I20260709 13:19:22.152346 19146 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:22.153909 19146 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:22.148970 21932 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:22.158963 21622 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.159473 21622 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.154532 21922 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.162333 21622 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.163280 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:22.171581 21349 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.787s	user 0.006s	sys 0.002s
I20260709 13:19:22.172045 22073 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:22.172194 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:22.121902 22056 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.172608 22073 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:22.167901 22018 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:22.165843 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.168344 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.183041 19066 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.169059 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:22.169806 19714 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.171288 19146 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:22.174844 19072 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:22.176153 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:21.411628 19067 rpcz_store.cc:276] 0709 13:19:20.205396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.480725 (+275329us) service_pool.cc:224] Handling call
0709 13:19:21.065498 (+584773us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:21.065667 (+   169us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:21.066023 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.066050 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:21.066513 (+   463us) log.cc:844] Serialized 52 byte log entry
0709 13:19:21.153384 (+ 86871us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:21.397096 (+243712us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.404837 (+  7741us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.405045 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.405115 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.410841 (+  5726us) raft_consensus.cc:1685] finished
0709 13:19:21.410862 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.410994 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44167,"raft.queue_time_us":10814,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":17538,"spinlock_wait_cycles":67091968,"thread_start_us":237731,"threads_started":2,"wal-append.queue_time_us":288120}
I20260709 13:19:22.173583 22073 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.177363 19216 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:22.178344 21210 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:22.097167 21810 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.174401 22025 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.193429 21810 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.194159 22025 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.060767 21915 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.181087 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:22.187216 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 237682us
I20260709 13:19:22.121343 22040 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:22.188369 19110 leader_election.cc:400] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:22.201984 19110 leader_election.cc:403] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:22.188498 22072 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:22.172444 21959 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.120671 22000 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:22.176911 21878 consensus_meta.cc:287] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.002s
I20260709 13:19:22.213306 19065 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:22.218051 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:22.227115 19066 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:22.228907 19110 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.237376 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:22.199713 21210 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:22.191466 21974 consensus_queue.cc:1059] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:19:22.189337 21875 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:22.190834 21954 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:19:22.208370 21696 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:19:22.209648 22025 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:22.213531 21911 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.236404 22049 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:22.217167 21878 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7.
I20260709 13:19:22.290786 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:22.231166 22072 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:22.270958 19141 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
W20260709 13:19:22.248647 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.264009 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.260481 22011 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.670s	user 0.013s	sys 0.000s
I20260709 13:19:22.230870 22040 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:19:22.238531 21927 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:19:22.299129 21883 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.296980 22080 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.322273 22080 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.324389 22080 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.325497 21915 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:22.329186 22067 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:19:22.338652 19069 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:22.343514 22019 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.300830 22025 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:22.345553 22025 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.353018 21272 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:22.353544 21272 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:22.354447 19212 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
W20260709 13:19:22.355538 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.355919 21622 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.354621 21272 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.356503 21622 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.357573 21272 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.358603 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:22.358870 21622 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.361137 21210 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.315330 22011 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.364146 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:22.364991 19742 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:22.366160 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:22.366362 22011 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:22.307765 22049 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:22.367439 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:22.353236 22072 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.369614 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1442) took 1064 ms. Trace:
I20260709 13:19:22.369988 19145 rpcz_store.cc:276] 0709 13:19:21.305157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.571034 (+265877us) service_pool.cc:224] Handling call
0709 13:19:21.582821 (+ 11787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.596101 (+ 13280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.596144 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.596650 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.947560 (+350910us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:22.035392 (+ 87832us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.035577 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.035652 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.180188 (+144536us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b18000ce9e0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:19:22.330886 (+150698us) raft_consensus.cc:1685] finished
0709 13:19:22.369430 (+ 38544us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.369560 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32598,"prepare.queue_time_us":88062,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":123768,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3961,"spinlock_wait_cycles":22836864,"thread_start_us":322332,"threads_started":1,"wal-append.queue_time_us":452205}
I20260709 13:19:22.371501 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:22.372187 19220 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:22.373767 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 1e32daa1d5e3443eaaf7b1e03100b270: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:22.377825 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.367486 22049 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.385247 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1645) took 1455 ms. Trace:
I20260709 13:19:22.385627 19215 rpcz_store.cc:276] 0709 13:19:20.929419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.975987 (+ 46568us) service_pool.cc:224] Handling call
0709 13:19:21.127020 (+151033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.132735 (+  5715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.385070 (+1252335us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000749d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:22.385193 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274659712}
I20260709 13:19:22.387349 19746 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:22.389446 21875 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.389964 21875 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.391796 21875 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.392197 21875 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.392573 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 270) took 1380 ms. Trace:
I20260709 13:19:22.393005 21875 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.393083 19070 rpcz_store.cc:276] 0709 13:19:21.012707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.375214 (+362507us) service_pool.cc:224] Handling call
0709 13:19:21.554166 (+178952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.565421 (+ 11255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.392340 (+826919us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002cc250. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:22.392504 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376900480}
I20260709 13:19:22.395171 21875 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.395346 19218 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.398159 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:19:22.403244 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet c1b4ebbb026847c7a47a03402902ca2a: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:22.418499 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 217138us
I20260709 13:19:22.420092 19220 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:22.426597 19218 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:22.419736 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:22.428632 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:22.430202 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:22.431011 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.432049 19072 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:22.429744 21954 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.434360 21954 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:22.430939 19746 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:22.352681 22016 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.435458 19745 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:22.437521 19717 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.415416 21272 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:22.459465 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:22.434898 21944 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:19:22.463835 22077 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:22.465870 22016 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:22.466341 21883 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.421525 22066 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:19:22.466864 21883 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.421475 21895 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:22.434898 22056 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.471227 22056 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.461093 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:22.463299 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.453148 21875 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:22.453430 21954 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.475899 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.460779 21272 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:22.481777 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:22.487265 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:22.475301 22077 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:22.497097 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:22.498126 19066 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:22.494234 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54895.5us
I20260709 13:19:22.500041 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:22.502897 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:22.504638 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:22.482427 21973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.020s	sys 0.002s
I20260709 13:19:22.507969 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:22.482502 21895 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:22.505880 19147 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:22.476150 21883 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:22.508348 21973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.021s	sys 0.003s
I20260709 13:19:22.511369 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:22.505491 19142 raft_consensus.cc:2368] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:22.516530 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.487061 21272 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.515681 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.516222 19067 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:22.511619 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:22.513634 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:22.517222 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.512480 22011 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:22.586997 22011 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.588984 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.590080 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:22.590708 19751 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:22.508090 21690 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.590126 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.591894 19066 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.592496 19145 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:22.488173 22016 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:22.592692 19143 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:22.594372 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 84917.5us
I20260709 13:19:22.595368 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.514600 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:22.541335 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.597805 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:22.598179 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 83695us
I20260709 13:19:22.598475 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:22.518031 19142 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:22.606129 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:22.600107 19147 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:22.607404 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:22.608191 19064 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:22.509678 21997 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.620710 19066 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:22.653787 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:22.654572 19145 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.497457 22049 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:19:22.522876 21911 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:22.593931 22077 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:22.518625 21973 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:22.669224 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:22.632443 22080 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.512732 21210 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:22.668673 21997 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.514045 21895 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.512353 22000 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.595709 21883 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:22.630366 21987 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:22.600518 21875 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:22.515513 21915 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:22.748550 21210 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.788815 21210 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.791009 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.792025 19066 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:22.780905 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:22.795151 19141 raft_consensus.cc:606] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.795599 19141 raft_consensus.cc:614] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:22.797902 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:22.779280 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:22.799753 19070 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:22.800493 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.787039 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:22.803244 19072 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:22.601279 22011 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:22.600411 21949 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:22.706404 22088 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:22.630795 21958 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.837378 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:22.837965 19212 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:22.753597 21973 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.629801 21816 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:19:22.807993 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:22.745187 19068 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 6: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:22.758163 22080 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:22.813262 22070 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.769s	user 0.010s	sys 0.005s
I20260709 13:19:22.852092 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:22.746953 22066 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.807724 21915 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:22.816373 22086 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:22.793998 21895 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.876961 21816 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:22.877457 21816 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:22.878477 21816 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.879954 21816 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.882530 21915 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.793166 21883 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:22.885085 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.819373 21997 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:22.819824 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 335) took 1209 ms. Trace:
I20260709 13:19:22.779807 22077 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.822115 22011 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:22.757776 22025 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.822777 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1609) took 1063 ms. Trace:
I20260709 13:19:22.907631 19069 rpcz_store.cc:276] 0709 13:19:21.759392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.761356 (+  1964us) service_pool.cc:224] Handling call
0709 13:19:22.822563 (+1061207us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54001ba654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:22.822705 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276247424}
I20260709 13:19:22.807781 22000 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.833051 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:22.910022 19218 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.834295 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:22.653339 21878 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:19:22.837212 21958 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:22.746456 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 93137.9us
I20260709 13:19:22.843533 19145 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:22.913264 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 79081.3us
I20260709 13:19:22.844655 19066 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:22.914794 19066 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:22.915056 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:22.852761 19214 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:22.853961 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:22.917081 19714 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:22.784478 21926 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:22.806757 21949 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.859084 19212 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:22.866724 19217 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:22.872429 22054 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.242s	user 0.005s	sys 0.008s
I20260709 13:19:22.873248 21918 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:22.873944 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.886031 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:22.887732 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:22.891999 19744 rpcz_store.cc:276] 0709 13:19:21.610136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.610977 (+   841us) service_pool.cc:224] Handling call
0709 13:19:22.819554 (+1208577us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54005b5754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:22.819752 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320362880}
W20260709 13:19:22.892905 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.927270 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:22.844941 22088 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.943413 19217 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:22.944038 19221 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:22.944859 19069 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:22.944923 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.946051 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:22.946051 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:22.964533 19212 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:22.974069 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:22.904026 22011 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:22.960167 19217 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.864257 22066 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:22.985131 19217 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.940773 21926 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.940596 21932 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:22.941777 21949 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.943272 22000 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:22.954814 22078 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:22.941385 22072 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:22.938769 21958 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:22.943629 22018 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:22.954459 21875 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:22.983220 21719 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:23.004339 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 396951us
I20260709 13:19:22.958717 21911 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:19:22.983920 21878 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.943459 22025 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:22.932264 19218 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
W20260709 13:19:23.018366 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.985773 22011 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.025496 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:23.034061 19145 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:23.034943 19217 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:23.035319 19217 pending_rounds.cc:85] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:19:23.035564 19217 pending_rounds.cc:107] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:23.035840 19217 raft_consensus.cc:2889] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.039036 22000 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:23.040405 22000 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:19:23.042550 22053 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.101s	user 0.000s	sys 0.004s
I20260709 13:19:23.043342 21915 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:23.043738 21915 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:23.044082 21915 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.039253 21875 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:23.045706 21875 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.005947 22078 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.015709 21987 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:23.013865 22018 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.008242 21622 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:23.054383 19072 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:23.033569 21878 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.060561 21622 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.052044 22078 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.054234 22018 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.019047 22072 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.037405 21997 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:23.066655 21878 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:23.110474 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.966s (SENT) [suppressed 17 similar messages]
I20260709 13:19:23.083638 21883 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.122117 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 266) took 1009 ms. Trace:
I20260709 13:19:23.122538 19140 rpcz_store.cc:276] 0709 13:19:22.113026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.122521 (+  9495us) service_pool.cc:224] Handling call
0709 13:19:23.121915 (+999394us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400221854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:23.122053 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984315776}
I20260709 13:19:23.124840 21974 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:23.125378 21974 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.127168 21974 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.130528 22072 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:23.141237 21987 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.145747 22066 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:23.128788 19070 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:23.154220 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 261) took 1380 ms. Trace:
I20260709 13:19:23.154624 19144 rpcz_store.cc:276] 0709 13:19:21.774032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.867284 (+ 93252us) service_pool.cc:224] Handling call
0709 13:19:23.154073 (+1286789us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000ff0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:23.154166 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246745856}
I20260709 13:19:23.160559 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:23.162608 19218 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:19:23.163846 19218 pending_rounds.cc:85] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:23.164122 19218 pending_rounds.cc:107] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:19:23.164413 19218 raft_consensus.cc:2889] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:23.168162 21272 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:19:23.168593 21272 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.173619 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:23.092669 21210 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.183627 21272 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:23.118269 21911 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:23.183308 19751 raft_consensus.cc:2410] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:19:23.169507 22096 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:19:23.184700 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 146973us
I20260709 13:19:23.166379 21883 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:23.196374 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:23.205189 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:23.208887 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.188479 21927 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.218555 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:23.231393 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 120936us
I20260709 13:19:23.231742 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.232468 19214 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:23.233189 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.197891 22088 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.242914 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.243422 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.183835 22077 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:19:23.192711 21911 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.236826 22100 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:23.237265 21997 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:23.258869 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 90576.4us
I20260709 13:19:23.214685 21883 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.262724 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:23.264585 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.246629 21719 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.235545 21927 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.277648 22018 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.278718 21927 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.261207 22025 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.279907 22018 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.280923 21883 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:23.283504 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.283843 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:23.284471 19221 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.289716 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:23.290342 19144 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:23.291368 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 83476.5us
W20260709 13:19:23.291936 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 60871.2us
I20260709 13:19:23.268010 21719 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.293948 19220 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:23.295326 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.261360 22088 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:19:23.295969 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:23.271294 21918 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.298632 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:23.295506 19184 leader_election.cc:400] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:23.269755 22100 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:23.299369 19184 leader_election.cc:403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:23.283865 21842 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:23.287360 21622 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.291989 21927 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:23.307380 21927 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.308959 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:23.264465 22107 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:23.295260 21719 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.302752 19751 raft_consensus.cc:2368] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:23.317936 21895 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.318796 21927 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.320006 21895 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:23.320941 22100 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.325273 19139 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:23.327271 19110 leader_election.cc:400] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:23.327077 19745 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:23.327049 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:23.328581 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:23.329533 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:23.329959 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.330221 19067 raft_consensus.cc:2368] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:23.330034 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:23.330829 19750 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:23.331840 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:23.332397 19070 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:23.335541 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:23.354933 19063 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:23.355834 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:23.356577 19749 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.359113 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:23.360054 19746 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:23.383622 19144 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:23.308032 22114 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:23.496676 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:23.366518 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.639025 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.643998 19218 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:23.301520 22124 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.367029 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:23.440505 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.638554 21878 consensus_meta.cc:287] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
W20260709 13:19:23.511251 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 177725us
W20260709 13:19:23.705734 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.367337 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:23.382316 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 89403.6us
I20260709 13:19:23.438223 19140 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:23.706916 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:23.587376 21911 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:23.497005 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 154151us
I20260709 13:19:23.687084 19067 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.383343 19221 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:23.366779 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.505007 19749 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:23.689592 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:23.711308 19219 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.711709 19744 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:23.693923 19218 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:23.713353 19717 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:23.361119 21210 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.697567 19214 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.334769 21927 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.367s
I20260709 13:19:23.697809 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.650403 19215 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:23.721698 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.520519 21719 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.701913 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:23.593564 22011 consensus_meta.cc:287] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.544s	user 0.003s	sys 0.006s
W20260709 13:19:23.639803 22078 consensus_meta.cc:287] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:19:23.416741 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.707077 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:23.726279 19141 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:23.472432 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:23.600891 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 90025.3us
I20260709 13:19:23.727963 19140 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:23.709290 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:23.716241 19213 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.697182 22019 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.697680 21787 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.640264 21816 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.001s
I20260709 13:19:23.697491 21690 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.696733 21974 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.719647 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.741675 19218 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:23.586434 21954 consensus_meta.cc:287] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.101s	user 0.006s	sys 0.006s
I20260709 13:19:23.724483 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:23.680248 21958 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:19:23.538511 21576 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.193s
I20260709 13:19:23.722121 19215 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:23.727734 19146 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:23.727347 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.751243 19138 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:23.730001 19219 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:23.729224 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 388849us
I20260709 13:19:23.751717 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.727123 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.713001 21932 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.713768 21985 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:23.734350 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:23.738924 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:23.740531 19140 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:23.709587 21878 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.752131 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:23.757440 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.758097 19110 leader_election.cc:400] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:23.758361 19110 leader_election.cc:403] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:23.758459 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.744196 19217 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:19:23.760226 19217 pending_rounds.cc:85] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:19:23.760537 19217 pending_rounds.cc:107] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:19:23.744922 19071 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:23.717779 22107 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:23.746942 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.766639 19141 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:23.747330 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:23.768615 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:23.769121 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:23.760821 19217 raft_consensus.cc:2889] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.714387 22114 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:23.745018 19067 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:23.738111 21883 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:23.775625 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.746201 22040 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:23.725541 22127 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:19:23.755815 21816 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.750090 22018 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:23.738070 22078 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.738173 22116 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:19:23.738204 22011 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.774956 21985 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:23.809168 22100 raft_consensus.cc:2764] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:23.750283 21954 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.745985 21690 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.743661 21787 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:23.812264 21915 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.000s
I20260709 13:19:23.877038 21915 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.877934 21878 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.764966 21932 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.878921 21915 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:23.879755 19144 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:23.879846 22065 raft_consensus.cc:3055] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:23.880282 22065 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:23.836535 21927 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:23.881102 21927 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:23.817261 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 130489us
I20260709 13:19:23.881349 22065 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.882504 22065 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.883188 21927 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.884048 21954 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:23.884361 19113 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:23.884706 22073 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:23.766976 21349 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:23.885123 22073 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.885211 21349 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:23.885548 22073 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:23.885627 21349 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.889508 19220 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.893792 21927 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:23.895403 21927 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:23.900625 22078 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.900771 21696 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:23.901243 22078 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:23.903786 22011 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:23.903940 19215 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:23.905064 19216 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:23.750836 21974 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.904832 19215 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.910873 21974 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:23.911458 19065 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:23.915825 19145 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:23.917105 19213 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:23.919150 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 205855us
I20260709 13:19:23.861666 21944 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:23.835489 22018 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:23.871382 22130 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:23.829506 22040 raft_consensus.cc:697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:23.873055 21690 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:23.873853 22129 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:23.873898 21985 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:23.836151 21926 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.002s
I20260709 13:19:23.876469 21787 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.880321 21932 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.809549 21883 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.869812 19138 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:23.934232 21944 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:23.964067 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 222271us
I20260709 13:19:23.988809 22131 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:23.995715 22132 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:19:23.985860 21883 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.045634 22056 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:23.988463 21944 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:24.045591 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 287601us
W20260709 13:19:24.055022 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 285966us
I20260709 13:19:23.965232 21926 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.059037 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:24.040216 22131 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:24.068400 19744 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:24.068787 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:24.070299 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:24.071406 19749 raft_consensus.cc:2410] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:24.051203 22124 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.076507 19141 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:24.063998 21949 consensus_meta.cc:287] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.049s	user 0.008s	sys 0.003s
I20260709 13:19:24.077747 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:24.078794 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:24.078934 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:24.090469 19212 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:24.079792 19215 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:24.079910 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:24.081624 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:24.082412 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:24.047528 21719 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.096947 19215 pending_rounds.cc:85] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:19:24.097522 19215 pending_rounds.cc:107] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:24.097841 19215 raft_consensus.cc:2889] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.096659 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:24.099885 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:24.102986 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:24.103114 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:24.105479 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:24.091995 21987 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:24.111485 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:24.111714 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:24.112911 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:24.115559 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:24.091981 21690 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:19:24.050690 22040 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.095674 22011 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.106562 22100 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.104377 21997 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:24.125272 21914 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:24.104509 21915 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:19:24.126379 21878 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.106361 21822 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.120318 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:24.106422 22114 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:24.095146 21949 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.119336 21810 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.152695 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:24.154260 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:24.158749 21949 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:24.155632 21822 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:24.123422 21576 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:19:24.164510 22145 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.165158 22140 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.165474 21576 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.165786 22140 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:24.166064 21576 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.166371 22140 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.137285 21914 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.120049 22095 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:19:24.161216 22018 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:24.139871 22127 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:24.185140 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:24.191376 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 75894us
I20260709 13:19:24.192240 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:24.162103 21878 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.200663 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:24.213639 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1666) took 1384 ms. Trace:
I20260709 13:19:24.214075 19216 rpcz_store.cc:276] 0709 13:19:22.829434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.832127 (+  2693us) service_pool.cc:224] Handling call
0709 13:19:22.832528 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.905421 (+1072893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.213354 (+307933us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540034d354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:24.213562 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2466112256}
I20260709 13:19:24.215471 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:24.217198 21210 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:24.217640 21210 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.218029 21210 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.143579 21349 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.174100 21810 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:24.176051 21914 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.221778 19216 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:24.221796 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:24.176770 21997 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:24.199872 21927 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.238514 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet ddcb71ca04ee449ba3db37be4900a2cd: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:24.239095 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.202378 22139 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.230378 22148 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:24.230535 21810 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.211289 21987 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:24.212129 21696 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.237195 22100 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:24.242552 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:24.243228 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:24.247016 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 46441.5us
I20260709 13:19:24.219345 22147 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:24.220428 22142 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.231536 22138 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:24.221988 22078 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.225698 22144 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.225167 22065 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:24.223901 21926 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:24.305593 19744 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:24.342520 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:24.129746 22131 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.308099 19746 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:24.228538 22145 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.239063 21915 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:24.312206 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 120786us
I20260709 13:19:24.244251 21949 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:24.333972 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:24.338244 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:24.293382 22107 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:24.202947 22127 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.227396 22056 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:19:24.372012 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:24.358896 19745 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.219197 21822 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.307144 22147 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:24.292049 21944 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.289507 21927 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.382663 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:24.385274 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 47178.3us
I20260709 13:19:24.387274 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:24.356508 22149 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:24.303177 21696 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.357887 22131 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.388756 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:24.391237 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:24.393266 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:24.398084 19144 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.329066 22078 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.291615 22139 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.404611 22127 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:24.380569 21926 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:24.406991 22152 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:19:24.380264 22095 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.373438 21915 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:24.348246 22116 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:19:24.422883 19214 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:24.405711 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:24.432575 19144 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
W20260709 13:19:24.429922 22019 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.000s
I20260709 13:19:24.396194 22100 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.454296 22147 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.393785 22148 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:24.392441 22025 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.380827 22073 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.373895 21949 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.466742 19143 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:24.332170 22142 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.429992 22141 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:24.347491 22144 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.371492 22107 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.373467 21997 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.464143 22156 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:24.448956 22161 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:24.510807 22148 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.463956 22160 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:24.519716 21349 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:24.542609 19147 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:24.526932 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:24.493603 21576 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.392181 21987 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.449884 22127 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:19:24.527541 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 116800us
I20260709 13:19:24.530650 19146 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:24.448868 21926 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.493147 22100 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.518352 22031 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.546288 19138 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:24.548931 21690 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.525449 22147 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.564446 19749 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:24.529472 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:24.532195 22156 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.526976 22025 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:24.567991 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.575122 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:24.578521 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:24.580121 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 50732.1us
I20260709 13:19:24.460373 22095 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:24.571357 22151 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:19:24.582502 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:24.559916 21349 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:24.541805 21914 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.583515 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:24.588754 19146 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.586297 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:24.574990 21985 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.575873 22156 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.585281 21810 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:24.557550 22160 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.575605 21690 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.560251 21915 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.542555 22161 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.528383 22141 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.651036 19745 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:24.580682 22025 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.528843 22065 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:24.779140 19146 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:24.646780 22163 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.811813 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:24.813704 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 452115us
I20260709 13:19:24.814098 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:24.815040 19146 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:24.816361 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:24.644420 21985 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.651556 21944 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:24.644824 21349 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.820675 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1460) took 1490 ms. Trace:
I20260709 13:19:24.832564 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:24.833892 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:24.709879 22179 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:24.812518 22178 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.002s
I20260709 13:19:24.574332 22031 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.810624 22127 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:24.838963 22166 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.286s	user 0.001s	sys 0.001s
W20260709 13:19:24.839326 22153 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.355s	user 0.000s	sys 0.002s
I20260709 13:19:24.831318 19140 rpcz_store.cc:276] 0709 13:19:23.330436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.759255 (+428819us) service_pool.cc:224] Handling call
0709 13:19:23.759548 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.963145 (+203597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.964860 (+  1715us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.989834 (+ 24974us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.168493 (+178659us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:24.168565 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.168692 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.820411 (+651719us) raft_consensus.cc:1685] finished
0709 13:19:24.820441 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.820607 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123822,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":334538,"threads_started":2,"wal-append.queue_time_us":190855}
I20260709 13:19:24.881398 19140 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:24.861527 21914 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.884047 19140 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:24.884219 22142 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.850562 22065 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:24.652539 22165 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.372s
I20260709 13:19:24.886430 22165 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:24.858338 22168 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:24.859359 22160 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.860460 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:24.652316 22164 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.345s
I20260709 13:19:24.819458 21927 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.830505 22078 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.923338 19142 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:24.887854 22179 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:24.857718 21926 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.848177 22139 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:24.819351 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 233127us
I20260709 13:19:24.821359 22163 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.945449 19142 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:25.221794 22184 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 13:19:25.308063 22175 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:25.231117 21690 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.308677 22175 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.211244 22100 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:25.310640 19142 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:25.311065 22175 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.312256 19142 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:24.987936 21883 consensus_meta.cc:287] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.945s	user 0.009s	sys 0.002s
I20260709 13:19:25.079723 21810 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:24.999866 21878 consensus_meta.cc:287] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.000s
W20260709 13:19:25.334311 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 405412us
I20260709 13:19:25.315107 21349 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.315244 22187 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.315383 22078 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.093075 21210 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.007s
I20260709 13:19:25.063832 22144 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:25.124977 22140 consensus_meta.cc:287] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.941s	user 0.011s	sys 0.000s
I20260709 13:19:25.342113 22140 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:24.991940 22025 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.344617 22140 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.989742 22107 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:25.091810 19215 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.016s
I20260709 13:19:25.327049 22176 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.346232 22078 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.351596 22176 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.353335 22078 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.353590 22176 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.356453 22073 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:25.358004 22147 consensus_meta.cc:287] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.000s
I20260709 13:19:25.060792 22141 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.989107 22148 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:25.321044 19715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.005s	sys 0.005s
W20260709 13:19:25.360004 19715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.005s	sys 0.005s
W20260709 13:19:25.322419 22131 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.002s
W20260709 13:19:25.362651 22156 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.003s
I20260709 13:19:24.892648 22165 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:25.336242 21878 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:24.989497 22095 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:25.349606 19215 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.000s	sys 0.024s
W20260709 13:19:25.378213 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 64638.7us
I20260709 13:19:25.358824 22163 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:24.888172 22127 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.364595 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:25.317836 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:25.385147 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 412698us
W20260709 13:19:25.390502 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 72727.5us
I20260709 13:19:25.393867 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:25.396728 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:25.335311 21883 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.347096 22186 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:19:25.397256 22148 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:25.405046 22080 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.383450 21985 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:25.405551 18967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 113) took 29575 ms (client timeout 15000 ms). Trace:
I20260709 13:19:25.407383 22147 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.363085 22156 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.346776 21210 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.415078 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 376) took 1167 ms. Trace:
W20260709 13:19:25.418776 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet e7fd9d26dc9f47ba92b818f308617d95: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:25.419849 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.409677 22179 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.417595 19215 rpcz_store.cc:276] 0709 13:19:24.247925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.456532 (+208607us) service_pool.cc:224] Handling call
0709 13:19:24.456923 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.457189 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:25.384277 (+927088us) log.cc:844] Serialized 14 byte log entry
0709 13:19:25.414661 (+ 30384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.414709 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:25.414752 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.414921 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.415025 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5260,"prepare.queue_time_us":899949,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":8652,"thread_start_us":917245,"threads_started":2}
W20260709 13:19:25.406144 18967 rpcz_store.cc:269] 0709 13:18:55.829908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.830217 (+   309us) service_pool.cc:224] Handling call
0709 13:19:25.405461 (+29575244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:19.185228 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:19.294475 (+109247us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:19.294544 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:19:19.294571 (+    27us) tablet.cc:662] Decoding operations
0709 13:19:19.296034 (+  1463us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:19.296129 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:19.296167 (+    38us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:19.629667 (+333500us) tablet.cc:701] Row locks acquired
0709 13:19:19.629737 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:19:19.629953 (+   216us) write_op.cc:270] Start()
0709 13:19:19.630109 (+   156us) write_op.cc:276] Timestamp: P: 1783603159629876 usec, L: 0
0709 13:19:19.630127 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:19.630860 (+   733us) log.cc:844] Serialized 4392 byte log entry
0709 13:19:20.435251 (+804391us) op_driver.cc:464] REPLICATION: finished
0709 13:19:21.290863 (+855612us) write_op.cc:301] APPLY: starting
0709 13:19:21.303230 (+ 12367us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:21.386420 (+ 83190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:21.413707 (+ 27287us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:21.760763 (+347056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:21.761221 (+   458us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:19:21.761290 (+    69us) write_op.cc:312] APPLY: finished
0709 13:19:21.761805 (+   515us) log.cc:844] Serialized 83 byte log entry
0709 13:19:21.861845 (+100040us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:21.904831 (+ 42986us) write_op.cc:454] Released schema lock
0709 13:19:21.921803 (+ 16972us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:22.048204 (+126401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.050130 (+  1926us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2712581,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":782026,"apply.run_cpu_time_us":13896,"apply.run_wall_time_us":729625,"num_ops":11,"prepare.queue_time_us":181267,"prepare.run_cpu_time_us":14985,"prepare.run_wall_time_us":588207,"raft.queue_time_us":162138,"raft.run_cpu_time_us":48738,"raft.run_wall_time_us":760950,"replication_time_us":663966,"thread_start_us":752217,"threads_started":5,"wal-append.queue_time_us":276156,"wal-append.run_cpu_time_us":30964,"wal-append.run_wall_time_us":2589021}]]}
I20260709 13:19:25.417579 21985 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:19:25.426611 21985 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:25.426903 21985 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:25.427526 21985 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.428027 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:25.428586 21985 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.428902 22191 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:25.441764 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1855) took 2939 ms. Trace:
I20260709 13:19:25.442006 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1470) took 1739 ms. Trace:
I20260709 13:19:25.400012 21959 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:25.340052 22187 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:25.421523 22125 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.715s	user 0.002s	sys 0.044s
I20260709 13:19:25.442726 19141 rpcz_store.cc:276] 0709 13:19:23.702891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.810311 (+107420us) service_pool.cc:224] Handling call
0709 13:19:23.834467 (+ 24156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.077299 (+242832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.441802 (+1364503us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54002b8ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:25.441954 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556218752}
I20260709 13:19:25.442198 19139 rpcz_store.cc:276] 0709 13:19:22.502069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.510643 (+  8574us) service_pool.cc:224] Handling call
0709 13:19:22.510961 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.325730 (+814769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.441510 (+2115780us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400179dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:25.441689 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871372032}
I20260709 13:19:25.414901 22170 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.454696 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.456424 19139 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:25.423334 22100 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:25.424822 22186 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.461302 22147 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.418330 21997 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:19:25.448021 22163 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.446573 22140 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:25.452627 22080 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.455775 22025 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.478564 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.459539 22107 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.481556 19141 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:25.481791 21210 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.468631 22148 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:25.482908 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.483348 22148 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.484246 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:25.470243 22147 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.485311 22192 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:25.486016 22192 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.487145 22147 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:25.487368 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.487715 22147 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:25.488044 22147 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:25.488386 22147 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.488466 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:25.501590 21958 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:25.502074 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.468425 22186 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.459705 21816 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:25.481657 22107 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.491909 21883 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.493045 22127 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:25.499665 21949 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.478660 22080 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.416666 21810 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.507551 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.514083 19141 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:25.527594 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.527000 19144 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:25.528173 19141 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:25.448547 22191 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:19:25.465507 21576 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.488674 22192 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.425477 22165 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.502112 21958 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:25.471657 22163 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.529696 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:25.547946 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:25.465278 22100 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.520684 22162 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:25.479919 22140 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.513535 22025 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.528641 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:25.522656 21875 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.553194 19144 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.520299 21816 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.557713 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.561412 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1857) took 2969 ms. Trace:
I20260709 13:19:25.561760 19072 rpcz_store.cc:276] 0709 13:19:22.586971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.841883 (+254912us) service_pool.cc:224] Handling call
0709 13:19:22.857135 (+ 15252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.054750 (+197615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.555812 (+2501062us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540025dd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:25.555977 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452880256}
I20260709 13:19:25.554585 21949 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:25.558986 21987 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:25.554199 22162 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.541661 21576 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.571246 19144 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:25.573141 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:25.574249 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.574952 19144 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:25.575383 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.575665 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.577445 19070 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:25.576552 19066 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:25.576048 19069 raft_consensus.cc:2368] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:25.582178 19067 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:25.575799 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.573382 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:25.563952 22031 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.584059 19144 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:25.586241 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.597433 19063 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:25.598322 19066 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:25.598764 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.569995 21949 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.583911 22192 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:25.585696 22205 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.602608 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.603493 21816 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.605321 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:25.635504 19745 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.606326 19749 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:25.606431 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:25.572206 22193 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.562289 21875 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.570914 21987 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:25.555107 22199 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:25.729049 21987 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.632902 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:25.609655 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.730423 19141 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:25.730264 22191 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:25.573963 22202 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:25.731127 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.571980 21997 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:19:25.593629 21958 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.731277 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.732713 19144 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:25.731062 22191 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.737900 21958 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:25.698568 22100 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.686832 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.740963 19070 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:25.641088 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:25.667750 22200 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:19:25.686406 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:25.650969 22196 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:19:25.729473 22163 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.731588 22202 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.696745 21816 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:19:25.735266 19745 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:25.741351 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:25.750579 19184 leader_election.cc:400] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:25.757090 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.957222 19066 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:25.619282 21949 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.957645 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.958328 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.959167 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:25.640110 22192 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.589430 22127 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:25.961216 22127 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:25.962386 22192 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.962287 22127 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.963567 19072 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:25.818960 22100 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:25.965551 22100 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.955673 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:25.841490 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 242582us
I20260709 13:19:25.757267 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:25.891531 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.968914 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.972826 19144 raft_consensus.cc:2410] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:25.974336 22100 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.704685 22080 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.975185 21816 consensus_queue.cc:1243] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:25.975716 21816 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:25.976027 21816 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:25.976616 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.976842 21816 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.978237 21816 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.678835 22162 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:25.697654 22107 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:25.665458 21576 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.981349 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1865) took 3394 ms. Trace:
I20260709 13:19:25.743655 22147 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.981902 19143 rpcz_store.cc:276] 0709 13:19:22.586704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.600098 (+ 13394us) service_pool.cc:224] Handling call
0709 13:19:22.605419 (+  5321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.515996 (+1910577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.981047 (+1465051us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540010e854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:25.981274 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4279618944}
I20260709 13:19:25.666882 22186 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.694474 21895 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.990098 19067 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:25.667025 22193 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:25.984452 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:25.990873 19072 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:25.762907 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:25.641189 22205 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:25.986513 22176 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.987426 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1483) took 1398 ms. Trace:
I20260709 13:19:25.997682 19068 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:25.821861 22191 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.989118 22080 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:25.989289 22100 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:25.667135 22187 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.996999 19142 rpcz_store.cc:276] 0709 13:19:24.589435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.335084 (+745649us) service_pool.cc:224] Handling call
0709 13:19:25.335619 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.335958 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.335991 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.338552 (+  2561us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.443584 (+105032us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:25.443626 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.443690 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:25.987254 (+543564us) raft_consensus.cc:1685] finished
0709 13:19:25.987271 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:25.987379 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":1969,"thread_start_us":82227,"threads_started":1,"wal-append.queue_time_us":117968}
I20260709 13:19:25.999737 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:25.988173 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.001539 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.001761 19068 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:25.983472 22147 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:25.998893 19143 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:25.999292 19144 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:26.003523 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.003955 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.007851 22193 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.007977 22202 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.009321 22080 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:26.009443 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:26.010659 22080 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:26.011112 22080 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:26.011899 22080 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.014765 21949 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.015553 21987 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.002869 22145 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:26.017546 22145 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.018887 22161 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.019869 22145 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:26.020963 19747 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:26.021991 22205 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:25.954834 21875 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.023016 19066 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:26.025305 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.026772 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:26.029873 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:26.030539 19745 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:26.027915 19144 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:26.031493 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.032121 19218 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:26.032836 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:26.032428 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.032069 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 347) took 2269 ms. Trace:
I20260709 13:19:26.016695 21949 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:26.034960 19748 rpcz_store.cc:276] 0709 13:19:23.756545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.756673 (+   128us) service_pool.cc:224] Handling call
0709 13:19:23.777966 (+ 21293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.967677 (+189711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.967718 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.967771 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:23.967810 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.026133 (+2058323us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400685454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:26.026173 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.026277 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435729664}
I20260709 13:19:26.041407 19218 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
W20260709 13:19:26.036773 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.043378 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:26.042804 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.045073 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.047761 19218 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:26.048444 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:26.050055 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:26.050729 19070 raft_consensus.cc:2376] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8. Re-sending same reply.
I20260709 13:19:26.050871 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.051687 19218 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.001035 22176 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.055543 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.055792 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.056330 19144 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:26.033030 22148 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.032729 22145 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.057659 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:26.058034 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.058267 19745 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:26.029328 22147 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:26.057371 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.029031 22124 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:26.001351 21895 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.065902 22124 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.063870 22192 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.067250 22192 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.067968 22124 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:26.070566 19141 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:26.072566 21895 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.006078 22100 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.064783 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:26.089720 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:26.101236 19745 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:26.078313 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.078922 19218 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:26.107486 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.108732 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.109335 19218 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.118360 19218 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:26.121901 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.206053 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.213788 21895 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:26.214484 21895 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.217015 21895 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.220633 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.221733 19144 raft_consensus.cc:2410] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:26.224596 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.225762 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.081284 21822 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:26.229350 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.230597 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.210784 22202 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:26.232508 19063 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:26.237165 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:26.237984 19144 raft_consensus.cc:2410] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:26.075807 22145 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.076591 22147 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.075914 22148 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.243782 19140 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:19:26.246385 19145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1461) took 2911 ms (client timeout 1716 ms). Trace:
W20260709 13:19:26.246748 19145 rpcz_store.cc:269] 0709 13:19:23.331733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.521349 (+189616us) service_pool.cc:224] Handling call
0709 13:19:26.243300 (+2721951us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54000ffad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:26.243436 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522175360}
I20260709 13:19:26.209216 22179 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:26.241101 22202 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.266788 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1682) took 2186 ms. Trace:
I20260709 13:19:26.267318 19214 rpcz_store.cc:276] 0709 13:19:24.080804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.080980 (+   176us) service_pool.cc:224] Handling call
0709 13:19:24.081347 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.457970 (+376623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.266526 (+1808556us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400161054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:26.266734 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784896896}
I20260709 13:19:26.268708 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.276203 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.250594 21987 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:26.254295 21822 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.281484 19214 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:26.259025 22202 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.285933 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.292009 19214 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:26.293292 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.294417 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.294935 19214 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:26.295749 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.297735 22147 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:26.299371 22145 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:26.283955 22211 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:19:26.325418 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.326267 19212 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:19:26.343113 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1475) took 1956 ms (client timeout 2054 ms). Trace:
W20260709 13:19:26.343660 19147 rpcz_store.cc:269] 0709 13:19:24.386794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.386959 (+   165us) service_pool.cc:224] Handling call
0709 13:19:26.342902 (+1955943us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400189054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:26.343030 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355585280}
I20260709 13:19:26.348390 19066 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:26.350539 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.351563 19217 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:26.352353 19147 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:26.292416 21822 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.355448 19147 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:26.355751 19217 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:26.356993 19147 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.375159 19212 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:26.379799 21822 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.359884 22100 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.387115 22148 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:26.390583 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:26.399811 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 90245.8us
I20260709 13:19:26.409006 19066 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.412036 19066 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:26.414487 19066 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:26.417133 19066 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:26.425034 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.430205 22215 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:19:26.434363 19747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 343) took 3112 ms (client timeout 1570 ms). Trace:
W20260709 13:19:26.434752 19747 rpcz_store.cc:269] 0709 13:19:23.322328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.337230 (+ 14902us) service_pool.cc:224] Handling call
0709 13:19:26.434204 (+3096974us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54000e6ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:26.434301 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5272369024}
I20260709 13:19:26.435662 21895 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:26.435967 19751 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:26.437428 19751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 482) took 2385 ms. Trace:
I20260709 13:19:26.437924 21895 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:26.442795 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.443074 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.443799 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.445328 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.446331 19217 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:26.442171 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.447356 19219 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:26.437741 19751 rpcz_store.cc:276] 0709 13:19:24.052101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.052285 (+   184us) service_pool.cc:224] Handling call
0709 13:19:26.435672 (+2383387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.436312 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.437246 (+   934us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54000e6ad0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:26.437376 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5474925312}
I20260709 13:19:26.448068 19215 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:26.450156 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.451198 19219 raft_consensus.cc:2410] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:26.452989 22136 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:26.455209 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:26.456197 19748 raft_consensus.cc:2410] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:26.457464 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1687) took 2344 ms. Trace:
I20260709 13:19:26.457726 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.458592 19214 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:26.457957 19216 rpcz_store.cc:276] 0709 13:19:24.113399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.244607 (+131208us) service_pool.cc:224] Handling call
0709 13:19:24.303510 (+ 58903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:24.303831 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:24.303856 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.313082 (+  9226us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.360220 (+ 47138us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:24.360260 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.360340 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.452287 (+2091947us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b24001df018. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003239c4 00007f6100321acb 00007f61004dcdc9 00007f61004dca55 00007f61004dbfb0 00007f6103152488 00007f6103152be8 00007f610312a398 00007f610312576a 00007f6103124bb6
0709 13:19:26.454025 (+  1738us) raft_consensus.cc:1685] finished
0709 13:19:26.454054 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.457381 (+  3327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10543,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":18290944,"thread_start_us":46830,"threads_started":1,"wal-append.queue_time_us":145043}
I20260709 13:19:26.466601 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.467603 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.468624 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.487564 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.711848 19219 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:26.710280 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1640) took 1018 ms. Trace:
W20260709 13:19:26.712585 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.712893 19069 rpcz_store.cc:276] 0709 13:19:25.692007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.324158 (+632151us) service_pool.cc:224] Handling call
0709 13:19:26.324541 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:26.335945 (+ 11404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.335989 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:26.339694 (+  3705us) log.cc:844] Serialized 52 byte log entry
0709 13:19:26.459660 (+119966us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:26.459693 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.459753 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.473498 (+ 13745us) raft_consensus.cc:1685] finished
0709 13:19:26.473520 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.710221 (+236701us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6911,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":74512,"threads_started":1,"wal-append.queue_time_us":102373}
I20260709 13:19:26.711251 19214 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
W20260709 13:19:26.593273 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.501051 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 280) took 3847 ms. Trace:
I20260709 13:19:26.504930 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1503) took 3209 ms. Trace:
I20260709 13:19:26.715991 19184 leader_election.cc:403] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.717072 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:26.727962 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 977482us
W20260709 13:19:26.513191 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.729468 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.718020 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.724505 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.731081 19215 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:26.724789 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.732142 19217 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:26.731081 19214 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:26.722680 19220 rpcz_store.cc:276] 0709 13:19:23.295048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.296287 (+  1239us) service_pool.cc:224] Handling call
0709 13:19:23.296542 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.889887 (+593345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.504632 (+2614745us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400100254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:26.504851 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363198720}
I20260709 13:19:26.734333 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.735205 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.736052 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.736490 19220 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:26.722251 19065 rpcz_store.cc:276] 0709 13:19:22.653441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.871548 (+218107us) service_pool.cc:224] Handling call
0709 13:19:22.871825 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.911832 (+1040007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.500793 (+2588961us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001b9c54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:26.500988 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390479232}
I20260709 13:19:26.740129 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.741165 19212 raft_consensus.cc:2410] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:26.741947 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:26.742880 19212 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:26.746008 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.747239 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.748415 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.749833 19217 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:26.751510 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.752776 19217 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:26.732589 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:26.763028 19220 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:26.770323 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.771725 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:26.772486 19219 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:26.775729 19216 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:26.701841 22161 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.728667 21895 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.739151 21974 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.728504 22148 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:26.765731 21918 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.802639 21918 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.766012 22175 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:26.805192 22175 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.807648 22175 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.793633 22066 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:26.810122 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.811079 19145 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:26.708374 22202 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.811780 22066 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:26.809963 21974 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.793150 22161 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.809451 21895 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.819635 21918 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.835543 21696 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.822125 22066 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.849450 22066 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.865517 22202 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.866633 22176 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.867372 22161 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.867703 22140 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.868934 22156 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:26.869623 21974 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.873013 22056 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:26.873502 22056 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:26.874461 22056 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:26.875826 22056 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.868928 21895 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.879474 21958 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:26.880003 21958 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:26.880237 22025 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:26.881052 21958 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:26.891505 22192 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:26.898892 22234 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:19:26.956269 19064 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:26.974613 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:26.975083 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 242463us
I20260709 13:19:26.976531 19145 raft_consensus.cc:2410] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:26.974695 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:26.978084 19143 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
W20260709 13:19:26.988418 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.984772 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:26.992853 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:26.994980 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.004562 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:27.005488 19746 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.016227 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.021938 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.022332 21696 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:27.023125 19216 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:27.026922 22061 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:27.027719 22061 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.028239 22061 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.030826 21895 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:27.034539 22138 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.673s	user 0.016s	sys 0.020s
W20260709 13:19:27.035254 22138 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.679s	user 0.017s	sys 0.020s
I20260709 13:19:27.035429 21918 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.035676 22138 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:27.035964 21918 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.036450 21918 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.034487 22066 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.034473 21974 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.041152 21974 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:27.041261 22165 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.041878 21974 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.046063 22138 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.057683 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1869) took 1468 ms. Trace:
I20260709 13:19:27.064095 19746 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:27.059634 19067 rpcz_store.cc:276] 0709 13:19:25.589635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.589764 (+   129us) service_pool.cc:224] Handling call
0709 13:19:27.057199 (+1467435us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001a8e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:27.057442 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825160576}
I20260709 13:19:27.080768 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.098129 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.098366 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:27.100330 22192 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:27.100955 22192 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:27.102432 22192 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.103502 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:27.104569 19145 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:27.104709 22156 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.105324 22156 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.108036 22156 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:27.114277 22199 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:19:27.114796 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 475) took 4633 ms. Trace:
I20260709 13:19:27.116668 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1509) took 1073 ms. Trace:
I20260709 13:19:27.109196 22243 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.117673 22243 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.120265 22243 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:27.110131 21997 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:19:27.123057 22018 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:27.123878 22018 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.125159 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:27.121285 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.128332 22018 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:27.129953 21915 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:27.130738 21915 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.131660 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.133208 22011 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.133291 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.133648 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 288) took 1111 ms. Trace:
I20260709 13:19:27.134184 19217 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:27.134064 19064 rpcz_store.cc:276] 0709 13:19:26.022128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.224285 (+202157us) service_pool.cc:224] Handling call
0709 13:19:27.133375 (+909090us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002cc254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:27.133580 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678612352}
I20260709 13:19:27.136909 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.133975 22011 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.140331 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1633) took 3815 ms. Trace:
I20260709 13:19:27.141072 22011 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:27.140749 19071 rpcz_store.cc:276] 0709 13:19:23.324630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.324759 (+   129us) service_pool.cc:224] Handling call
0709 13:19:23.325076 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.762862 (+437786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.139687 (+3376825us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:27.140097 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964942720}
I20260709 13:19:27.108582 22156 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:27.153417 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:27.154358 19145 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:27.162302 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:27.165051 22148 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:27.117137 19221 rpcz_store.cc:276] 0709 13:19:26.035875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.036051 (+   176us) service_pool.cc:224] Handling call
0709 13:19:26.036340 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.259744 (+223404us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:26.259786 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.260340 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.354966 (+ 94626us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:26.355018 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.108287 (+753269us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54002698d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:27.108366 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.108458 (+    92us) raft_consensus.cc:1685] finished
0709 13:19:27.108472 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.108795 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7013,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":512676224,"thread_start_us":94267,"threads_started":1,"wal-append.queue_time_us":124693}
I20260709 13:19:27.165519 22148 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.165992 22148 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.165844 21997 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:27.169037 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1515) took 1092 ms. Trace:
I20260709 13:19:27.169433 19218 rpcz_store.cc:276] 0709 13:19:26.076427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.120480 (+ 44053us) service_pool.cc:224] Handling call
0709 13:19:26.120763 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.255002 (+134239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.255048 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.255105 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:26.255154 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.168547 (+913393us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540036d154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:27.168617 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.168834 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308152064}
I20260709 13:19:27.170205 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:27.171653 19213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 373) took 3061 ms (client timeout 2093 ms). Trace:
W20260709 13:19:27.172084 19213 rpcz_store.cc:269] 0709 13:19:24.110092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.135996 (+ 25904us) service_pool.cc:224] Handling call
0709 13:19:27.171172 (+3035176us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54000758d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:27.171443 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3148155136}
I20260709 13:19:27.178205 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.108820 22066 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:27.192909 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.194034 19216 raft_consensus.cc:2410] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:27.194964 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:27.195719 19221 raft_consensus.cc:2376] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10. Re-sending same reply.
I20260709 13:19:27.196547 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.197383 19221 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:27.198053 19217 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:27.198442 19217 pending_rounds.cc:85] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:19:27.198293 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.198841 19217 pending_rounds.cc:107] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:27.199211 19217 raft_consensus.cc:2889] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.199681 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.200433 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.215577 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.216084 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.216332 19070 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:27.189978 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.217219 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.217602 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.200975 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:27.202160 19219 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:27.219200 22122 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.203984 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:27.204963 22018 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.219734 22156 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.204559 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.216348 19217 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:27.167502 21997 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:27.214955 21974 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.222698 19071 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:27.115258 19742 rpcz_store.cc:276] 0709 13:19:22.481318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.482408 (+  1090us) service_pool.cc:224] Handling call
0709 13:19:22.512770 (+ 30362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.674689 (+161919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.692675 (+ 17986us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.705513 (+ 12838us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.890624 (+1185111us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b18000b4d00. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:19:24.108017 (+217393us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:24.225201 (+117184us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.112126 (+2886925us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b18000b4d00. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287
0709 13:19:27.112420 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.114353 (+  1933us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.114425 (+    72us) raft_consensus.cc:1685] finished
0709 13:19:27.114439 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.114587 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23928,"prepare.queue_time_us":129436,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":73,"raft.queue_time_us":119206,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":20975,"spinlock_wait_cycles":22828800,"thread_start_us":398719,"threads_started":3,"wal-append.queue_time_us":1453683,"wal-append.run_cpu_time_us":3088,"wal-append.run_wall_time_us":1251524}
I20260709 13:19:27.223232 22156 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:27.219532 22148 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.224135 21974 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:27.225473 22148 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:27.206845 22061 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.228065 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1478) took 2840 ms. Trace:
I20260709 13:19:27.228436 19138 rpcz_store.cc:276] 0709 13:19:24.387634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.421708 (+ 34074us) service_pool.cc:224] Handling call
0709 13:19:24.455869 (+ 34161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:24.567493 (+111624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.227591 (+2660098us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b540017c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:27.227868 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207216896}
I20260709 13:19:27.232221 19146 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:27.233639 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1872) took 2682 ms. Trace:
I20260709 13:19:27.233984 19146 rpcz_store.cc:276] 0709 13:19:24.550920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.908791 (+357871us) service_pool.cc:224] Handling call
0709 13:19:27.231710 (+2322919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.232707 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.233434 (+   727us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540017c0d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:27.233582 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4413083904}
I20260709 13:19:27.236231 22061 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:27.237356 22136 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:27.237522 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:27.237862 22136 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:27.238628 19066 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:27.239117 22136 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.241096 19213 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:27.219385 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47600.5us
I20260709 13:19:27.241117 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.241475 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.241828 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:27.242684 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:27.250564 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 85688us
I20260709 13:19:27.252125 19113 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:27.242044 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.243224 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1874) took 2691 ms. Trace:
I20260709 13:19:27.242367 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.250402 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.242635 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1489) took 1844 ms. Trace:
I20260709 13:19:27.255362 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.249017 21997 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:27.255779 19717 connection.cc:256] RPC call timeout handler was delayed by -1.4415919769999164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 13:19:27.291464 21997 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:27.293742 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.272655 19141 rpcz_store.cc:276] 0709 13:19:25.398164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.992000 (+593836us) service_pool.cc:224] Handling call
0709 13:19:25.992185 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.071009 (+ 78824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.242151 (+1171142us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54000ff0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:27.242430 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172642688}
I20260709 13:19:27.243578 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.244570 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.266747 19140 rpcz_store.cc:276] 0709 13:19:24.551472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.942036 (+390564us) service_pool.cc:224] Handling call
0709 13:19:26.243543 (+1301507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.245789 (+  2246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.242841 (+997052us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000ffad0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:27.243036 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936235264}
I20260709 13:19:27.240661 22136 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.294176 22018 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:19:27.308849 19070 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:27.308977 21875 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:27.309654 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54537.3us
I20260709 13:19:27.310773 19071 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:27.310699 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.311443 19065 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:27.311797 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.312117 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.252314 21915 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:27.250101 22100 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:27.341099 19066 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:27.292654 21997 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.313071 19067 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:27.246677 21958 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.314040 22180 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:27.319255 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.319185 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.319478 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.347419 19219 raft_consensus.cc:2410] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:27.320323 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.322317 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.348304 19064 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:27.322558 22137 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:27.324569 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:27.326694 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:27.341738 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 150749us
I20260709 13:19:27.344244 19068 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:27.350440 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.351171 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.352254 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.352726 22061 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:27.353032 19714 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:27.356032 21997 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.347704 19750 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:27.361042 19217 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.366178 19213 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:27.328737 21918 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.367015 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.371722 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:27.364951 22061 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:27.366601 22180 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:27.378777 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.378821 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.379559 19070 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:27.368847 22100 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.407075 19220 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:27.381477 19744 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:27.376653 22061 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.376807 19743 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:19:27.411875 22080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.019s	sys 0.021s
I20260709 13:19:27.412143 21918 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:27.417492 22066 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:27.417899 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 46332.5us
I20260709 13:19:27.419723 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:27.420262 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 58467us
I20260709 13:19:27.377476 22183 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:19:27.421111 22080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.019s	sys 0.022s
I20260709 13:19:27.377137 22180 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:27.423326 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 72998.2us
I20260709 13:19:27.424472 19069 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.425004 19067 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:19:27.421941 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 102893us
I20260709 13:19:27.429476 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:27.434316 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.434804 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:27.435431 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:27.436062 21915 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:27.436544 21915 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:27.437261 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:27.444078 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.445290 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.449918 19069 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:27.451550 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:27.453550 22205 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:27.454336 22186 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:27.381479 21878 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.454878 21874 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:27.454938 22186 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:27.455477 21874 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:27.456274 22186 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.456583 21874 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.457576 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.457882 21874 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.451519 19717 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.465524 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.455077 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.437232 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:27.467836 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.470467 19067 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:27.458750 22180 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.474467 22100 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:27.474447 19035 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:27.475093 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.475221 22100 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:27.476109 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.476521 22100 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.477197 22018 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:27.477686 22018 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:27.478822 22156 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.478983 22018 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.476543 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:27.437212 21915 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.480577 22018 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:27.516289 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.495790 19113 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:27.527010 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.518293 22148 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:27.529910 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 62642.2us
I20260709 13:19:27.480805 21974 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:27.519554 22183 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:27.552506 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 101039us
I20260709 13:19:27.527103 22137 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.529192 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:27.558878 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 82892.6us
I20260709 13:19:27.531684 22148 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:27.553839 19717 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.587831 21690 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:27.587623 22175 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:27.588243 21690 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.588662 21690 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.590121 22138 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.590847 22138 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.592964 21822 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:27.593416 21822 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.593819 21822 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.594694 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.597163 22164 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.597352 22072 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.558261 22080 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.599530 22138 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:27.600505 19072 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:27.605486 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 78545.6us
I20260709 13:19:27.606573 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:27.607887 21958 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:27.552495 22254 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.122s	user 0.004s	sys 0.000s
I20260709 13:19:27.608374 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.639171 19064 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:27.633477 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:27.627646 21842 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:27.651564 21842 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:27.652711 21842 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.654386 21842 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:27.626389 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46228.6us
W20260709 13:19:27.629191 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 152764us
I20260709 13:19:27.608445 21958 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:27.660462 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:27.618669 22258 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:27.649212 22148 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:27.668962 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.666569 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:27.670913 21895 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:27.673977 21895 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:27.674204 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:27.673650 19220 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.674610 22049 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:27.675715 19215 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:19:27.668457 21958 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.696329 19215 pending_rounds.cc:85] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:27.702308 19215 pending_rounds.cc:107] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:27.702605 19215 raft_consensus.cc:2889] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.669824 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:27.656479 21822 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:27.704030 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 95851.7us
W20260709 13:19:27.713191 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 79961.5us
I20260709 13:19:27.817224 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:27.750437 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 88613.7us
I20260709 13:19:27.692760 21895 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.793159 19213 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.633848 22248 consensus_queue.cc:1059] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:19:27.666672 21874 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:27.824056 22183 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.824566 22183 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:27.825055 22183 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:27.856009 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 186071us
I20260709 13:19:27.860134 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:27.860970 22136 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.861506 22127 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.862003 22127 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:27.862438 22127 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.864230 21690 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:27.867102 21690 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:27.869033 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.869221 22025 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:19:27.870129 22182 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:27.871984 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:27.875262 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1644) took 2182 ms. Trace:
I20260709 13:19:27.875669 19072 rpcz_store.cc:276] 0709 13:19:25.693234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.346532 (+653298us) service_pool.cc:224] Handling call
0709 13:19:26.346862 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.600977 (+1254115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.874969 (+273992us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400036e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:27.875188 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2715419008}
I20260709 13:19:27.888983 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:27.891589 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.892977 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.896435 22025 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:27.897158 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:27.897104 22243 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:27.898252 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.856671 22066 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:27.814000 22049 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:27.913022 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 95894.5us
I20260709 13:19:27.914265 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.850517 22061 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:27.923477 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.925482 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.915840 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:27.926600 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.933876 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:27.910820 22025 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.942804 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:27.946879 19145 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:27.946642 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:27.948194 19138 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:27.950254 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:27.950963 19145 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 4.
I20260709 13:19:27.952032 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:27.952664 19138 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.953857 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.971146 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:27.971760 19145 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:27.973168 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:27.978570 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 121354us
I20260709 13:19:27.983711 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:27.984587 19139 raft_consensus.cc:2410] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:19:27.985031 22267 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:19:27.985417 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 68024.4us
I20260709 13:19:27.986142 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.968950 21690 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.987566 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:27.988691 21690 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:27.991175 19143 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:27.988459 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:27.994161 21915 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.995976 22072 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:27.936185 22066 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:27.997411 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 350) took 3602 ms. Trace:
I20260709 13:19:27.997776 19744 rpcz_store.cc:276] 0709 13:19:24.394780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.394905 (+   125us) service_pool.cc:224] Handling call
0709 13:19:24.395196 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.431814 (+3036618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.997133 (+565319us) spinlock_profiling.cc:243] Waited 2.97 s on lock 0x7b54005b4ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:27.997334 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6826857216}
I20260709 13:19:27.999086 22066 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:27.999878 22066 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:28.000784 19140 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:28.001611 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:28.002379 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.002786 22049 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:28.003387 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.004411 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.004839 22061 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:28.005385 19072 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.007961 22148 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.012578 19219 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:28.013548 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.014503 19747 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:28.016539 22127 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.005270 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:28.021200 19142 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:28.022104 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.022807 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:28.023448 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.024191 19743 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:28.024572 22136 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.024698 21958 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:28.026446 22180 consensus_meta.cc:287] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.003s
I20260709 13:19:27.992552 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.028364 19213 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:28.031615 19146 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:28.033885 22264 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:19:28.036466 19220 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:28.043927 19072 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:28.044392 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:28.047514 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.051681 19138 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:28.055248 19750 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:28.056720 19070 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:28.052731 19142 pending_rounds.cc:85] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 4
W20260709 13:19:28.059458 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.065939 19142 pending_rounds.cc:107] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:28.066322 19142 raft_consensus.cc:2889] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:28.067735 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 45749.7us
I20260709 13:19:28.071810 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:28.071493 22100 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.073292 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:28.074239 19068 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.973918 22183 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.054749 21915 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:28.076776 19066 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:28.077201 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:28.075762 19071 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:28.078358 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.080807 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.081614 19216 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.083455 19064 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:28.083653 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:28.064256 21696 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.067036 22080 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:28.085079 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 264259us
I20260709 13:19:28.085080 21822 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:28.084502 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 189910us
I20260709 13:19:28.080094 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.087759 19215 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.088100 19146 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:28.079926 22100 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.092386 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.089828 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.091312 19063 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:19:28.098042 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.094655 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:28.144586 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 63408.6us
I20260709 13:19:28.144593 19072 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:28.065356 22180 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.146682 19070 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:28.148149 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56991.5us
I20260709 13:19:28.093593 22061 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:28.090075 22136 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:28.156975 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 164496us
I20260709 13:19:28.085037 21842 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:19:28.157881 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.175450 22246 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:28.154644 21690 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:28.177739 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:28.184021 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:28.186618 19142 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.188074 21918 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.190002 19745 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:28.193375 22148 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:28.193120 22246 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:28.194804 22271 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:19:28.196795 22127 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:28.198895 22100 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:28.201462 21958 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:28.164523 22175 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:28.209379 22175 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.211738 19215 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:28.212277 22175 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.213061 21690 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:28.214015 21690 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.214551 22180 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.218379 22183 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.219662 19142 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:28.223886 22148 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.224434 22148 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.168759 22061 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:28.226402 22148 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:28.226125 22061 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.227176 22056 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:28.227574 22056 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:28.229171 19147 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
W20260709 13:19:28.229830 22256 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.263s	user 0.003s	sys 0.001s
I20260709 13:19:28.228335 22056 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.231082 22056 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:28.233045 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 75303.3us
W20260709 13:19:28.233718 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 72294.3us
I20260709 13:19:28.234789 19110 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.234854 19038 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.235737 21842 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.237406 19110 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.187409 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:28.238817 22243 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:28.238994 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69521.1us
I20260709 13:19:28.239478 22243 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.239703 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:28.240263 18966 catalog_manager.cc:5697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 6, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.242844 22187 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:28.243122 21895 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.244503 22187 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.244896 22187 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:28.245271 19140 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:28.245798 22187 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.237323 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:28.248512 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:28.250099 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.252365 21895 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.252574 19214 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:28.242857 18966 catalog_manager.cc:5697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.256409 18966 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 5, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 5 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:28.196594 22246 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:28.277941 19214 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:28.265064 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.268447 22018 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:28.279215 22018 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:28.279673 22018 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:28.280678 22018 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.281967 22018 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.247041 22187 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.226966 22148 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.285308 22148 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.286666 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.288182 19113 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:28.289188 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:28.289937 19212 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:28.290534 22148 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:28.291268 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.292065 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:28.292397 18966 catalog_manager.cc:5697] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 4, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 4 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:28.294812 18966 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:28.297693 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:28.299891 19144 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:28.301870 21842 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:28.302595 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 65266.8us
I20260709 13:19:28.303715 22175 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:28.303921 22049 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:28.305016 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:28.307118 19216 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:28.315364 19065 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:28.323058 19068 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:28.324561 19141 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:28.340581 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 283901us
W20260709 13:19:28.345391 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.340831 19110 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.342474 22080 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.346174 22080 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:28.346560 22080 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.346378 18966 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.346918 22243 raft_consensus.cc:2764] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:28.348026 18966 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.344969 21874 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:19:28.350302 22049 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:28.350662 22049 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:28.349453 18966 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:28.351577 22049 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.351810 18966 catalog_manager.cc:5697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.345062 21822 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.353204 21822 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:28.353688 21822 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.350605 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:28.355471 22011 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.355870 22011 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:28.356246 22011 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.352654 22049 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.358016 22100 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:28.362165 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 70156.1us
W20260709 13:19:28.341977 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 91062.5us
I20260709 13:19:28.367115 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.360494 19140 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
W20260709 13:19:28.361049 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56102.1us
I20260709 13:19:28.353232 18966 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.372382 19113 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:28.376529 22275 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:28.380569 22275 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.381002 22275 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:28.382386 22011 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.383935 22080 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.384950 22011 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:28.388144 22275 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:28.389037 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48291.9us
I20260709 13:19:28.369634 22175 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:28.391532 21974 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.405300 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.389511 21895 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:28.412211 22282 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:19:28.412319 22287 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:19:28.413254 22175 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.377130 21690 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.423077 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:28.425019 18966 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.429522 19138 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:28.432811 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 57277.3us
I20260709 13:19:28.433354 19144 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:28.377405 22243 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:19:28.415194 21974 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:28.446784 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.455819 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:28.463027 19142 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:28.463320 22080 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.464135 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:28.464628 22080 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:28.455796 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:28.453169 21954 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:28.467258 21954 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:28.378136 22148 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:19:28.468211 21954 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.470299 22275 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:28.472405 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 67190.1us
W20260709 13:19:28.437124 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 70132.2us
I20260709 13:19:28.436339 19141 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:28.436645 18966 catalog_manager.cc:5697] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:28.479635 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:28.470860 21954 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.429697 21690 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:28.488344 21690 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.488235 21915 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:28.436854 21878 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:19:28.459407 22141 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:28.491657 22100 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:28.477778 21974 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.478048 22011 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:19:28.497037 21696 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.498406 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:28.483392 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:28.499244 19138 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:28.483870 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.432789 21895 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:28.485462 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:28.487035 21822 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.482656 22148 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.434916 21918 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:28.497319 19714 leader_election.cc:336] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 2.093s (SENT)
I20260709 13:19:28.518544 18966 catalog_manager.cc:5697] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.507912 21696 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.521661 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.522893 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.522959 21696 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.520345 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.529593 19138 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:19:28.530465 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56607.7us
I20260709 13:19:28.532282 19038 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.508390 22148 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:28.532991 22056 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.533399 22056 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:28.533754 22056 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.533836 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.533577 22148 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.534953 22148 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.535579 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.536665 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:28.537482 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.538221 22066 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:28.538606 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.538934 22066 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:28.538938 22248 raft_consensus.cc:2764] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:28.539639 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.539898 22248 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:28.540195 22289 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:28.540575 22248 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.541450 21895 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.542758 21690 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.530586 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:28.531541 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:28.546070 22025 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.546842 22025 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:28.547631 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.548295 22080 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.548597 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.548549 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:28.549024 21878 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:28.550130 22080 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.549319 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:28.550592 21878 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:28.549152 22141 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:28.551157 21878 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:28.552772 21874 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:28.553382 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.553716 21958 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:28.553960 19064 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:28.554144 21958 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:28.555222 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.555045 21958 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.556367 21958 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.552112 21878 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.566839 19144 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:28.569396 18966 catalog_manager.cc:5697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:28.568122 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 48827.3us
I20260709 13:19:28.572103 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:28.481055 22275 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:19:28.530117 21918 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.586488 19067 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:28.594326 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.541476 22248 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.585640 18966 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 4, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 4 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:28.597815 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 100531us
I20260709 13:19:28.599428 19142 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:28.602872 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:28.584479 22290 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:28.582984 22011 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:28.608564 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 67843.8us
I20260709 13:19:28.591758 22018 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:28.616981 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:28.645828 19067 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:28.595973 21918 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.650187 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.651683 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:28.652673 19217 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:28.585414 22187 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:28.659799 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.660349 19216 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.661759 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.607492 22175 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.608196 22127 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.584797 22025 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:19:28.662250 19212 raft_consensus.cc:2376] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6. Re-sending same reply.
I20260709 13:19:28.677224 19146 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:28.668381 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.615649 21915 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:28.646799 22011 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:28.613972 18966 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 5 to 8, now has a pending config: VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1), VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2), VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3), VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:28.685418 18966 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 4 to 5, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:28.673624 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:28.669191 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:28.687150 19216 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:28.680645 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.647032 21690 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.657493 22295 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:28.659538 22072 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:28.699047 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.704360 19216 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:28.669971 22127 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:28.707402 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:28.712044 18966 catalog_manager.cc:5697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 6, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.713552 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.714300 19220 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:28.682909 21915 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:28.691817 22011 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.664788 22187 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.719008 19213 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:28.728334 19212 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:28.733042 19213 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:28.729058 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.729835 18966 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 4 to 6, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 6 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:28.715430 21690 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.735234 21690 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.735699 21690 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:28.738216 22286 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 13:19:28.740563 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:28.715505 22127 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.730451 21915 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.704037 22180 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:19:28.751238 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 70633.6us
I20260709 13:19:28.751070 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.753554 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:28.756750 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.739818 22018 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.758630 19220 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:28.760914 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:28.765019 21822 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:28.765637 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:28.766260 18966 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 5, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 5 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.713917 22295 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.710605 22072 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:28.769455 22288 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:19:28.809952 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 151684us
I20260709 13:19:28.836208 18966 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 3, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 3 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.758226 21842 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.849968 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:28.829573 21958 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.773478 22018 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:28.859041 22018 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.859665 22180 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.829438 22300 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:28.865535 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:28.869863 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.833277 22138 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.829799 22243 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:28.871830 19142 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:28.860200 22180 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.882490 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:28.869309 22061 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:28.899119 22180 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:28.901492 22297 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:19:28.905588 22187 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:28.913524 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 167766us
I20260709 13:19:28.916641 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:28.920166 22275 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:28.920728 22275 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:28.921684 22275 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.922483 22056 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.925035 22072 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:28.925575 22192 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:28.925971 22192 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:28.926725 22192 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:28.927670 22192 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.861115 21842 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:28.949697 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 196194us
I20260709 13:19:28.885905 22243 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:28.924716 22056 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:28.955252 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 87080.2us
I20260709 13:19:28.883368 22138 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:28.929486 22080 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:28.988782 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 72199.2us
I20260709 13:19:28.989652 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:28.958778 21875 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:29.009549 19141 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:29.005605 19147 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:29.019558 19749 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:29.022866 19035 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:29.024423 19218 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:19:29.024760 19218 pending_rounds.cc:85] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 8
I20260709 13:19:29.024997 19218 pending_rounds.cc:107] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:19:29.024856 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.025269 19218 raft_consensus.cc:2889] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.025497 19141 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
W20260709 13:19:29.026384 21954 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
W20260709 13:19:29.026607 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.026841 22310 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:19:29.029224 22310 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:29.029726 22310 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:29.030606 22310 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.032415 22246 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:29.033005 22246 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:29.034125 22246 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.017015 21875 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.041703 22100 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:29.042096 22100 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:29.042330 19143 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:29.042784 21875 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.042920 22100 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.043919 22100 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.044337 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.044849 19071 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.045220 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.045648 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.046195 19064 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.046449 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.046669 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.047152 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.047480 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.048038 19141 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:29.048224 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.043303 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:29.077283 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 54465.5us
W20260709 13:19:29.023542 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.783s (SENT) [suppressed 29 similar messages]
I20260709 13:19:29.079603 19071 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:29.120678 19070 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:29.120997 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:29.004705 22308 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:29.020228 22056 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:29.127933 19214 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:29.127988 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:29.130548 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 109825us
I20260709 13:19:29.139984 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:29.141310 19217 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:28.998421 22127 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.141983 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:29.130079 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:29.143568 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:29.092619 22080 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:29.146328 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 304404us
I20260709 13:19:29.158437 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:29.162000 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.163652 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.122423 22061 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:29.168242 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 327961us
I20260709 13:19:29.171227 19214 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.174525 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:29.145543 22205 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:29.180193 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:29.157403 22295 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:29.183414 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.164746 21878 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:29.191157 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.167517 22056 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:29.202522 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.203567 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 63931us
I20260709 13:19:29.202524 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:29.204766 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:29.211858 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 127259us
I20260709 13:19:29.172340 22080 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:29.217476 19038 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:29.221174 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 197635us
I20260709 13:19:29.186177 22148 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:29.221911 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:29.232558 19221 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:29.232636 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.229760 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:29.234412 21842 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:29.237483 22320 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.237277 22056 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:29.237825 21690 consensus_meta.cc:287] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.003s
W20260709 13:19:29.238399 22309 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:19:29.238505 22321 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.296814 21690 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.238854 22330 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:29.298215 22330 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.298696 22330 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.239488 22315 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:29.240957 21974 consensus_meta.cc:287] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.000s
I20260709 13:19:29.301443 21974 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.303992 21974 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.241619 22326 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:29.241707 22018 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.195055 22295 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:29.244669 21915 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.247180 22333 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:29.249841 22138 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:29.250855 22011 consensus_meta.cc:287] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.002s
W20260709 13:19:29.250900 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.252337 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 2653a1baca71467dbf9167aede923a9c: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:29.262187 19747 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:29.158799 22243 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.196512 21895 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:19:29.268015 21954 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:29.186836 22205 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.157217 22308 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:29.308789 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 78990.2us
W20260709 13:19:29.319259 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 87115.4us
I20260709 13:19:29.349807 19110 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:29.335320 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.339174 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.340670 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.342730 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.343545 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.344236 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.347584 19220 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.295794 22192 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:29.308853 22148 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:29.351126 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 133701us
I20260709 13:19:29.257073 22137 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:19:29.350008 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.366120 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:29.338672 22175 consensus_meta.cc:287] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.000s
I20260709 13:19:29.351626 19069 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.350744 19066 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:29.317683 22186 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:29.351152 19067 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:29.371892 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:29.322319 22025 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:19:29.367957 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:29.341146 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:29.361158 22320 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.372804 22138 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:29.414912 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.369877 21690 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.420162 19070 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.415607 19217 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
W20260709 13:19:29.420441 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54386.8us
I20260709 13:19:29.338429 22011 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.421406 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:29.419028 19743 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:29.373394 22186 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:29.424015 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 52213.7us
I20260709 13:19:29.387076 22175 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:29.321588 22061 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.434221 19714 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:29.350284 22335 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:19:29.449178 19069 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:29.449929 19219 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:29.429108 22137 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:29.458314 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 95655.5us
I20260709 13:19:29.435097 22127 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:29.461992 22327 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:29.463074 22316 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 13:19:29.464613 22338 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:29.464944 22317 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:29.465934 22329 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:19:29.466495 22011 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:29.467087 22334 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:29.467767 22148 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.469834 22018 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:29.470064 22299 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.717s	user 0.008s	sys 0.010s
I20260709 13:19:29.449517 22072 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.487876 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1529) took 1064 ms. Trace:
I20260709 13:19:29.387287 22080 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.460032 22192 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:29.474287 22137 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.490309 19139 rpcz_store.cc:276] 0709 13:19:28.423646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.425745 (+  2099us) service_pool.cc:224] Handling call
0709 13:19:28.428024 (+  2279us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:28.473156 (+ 45132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.473195 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:28.509670 (+ 36475us) log.cc:844] Serialized 52 byte log entry
0709 13:19:28.674191 (+164521us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:28.870067 (+195876us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.914388 (+ 44321us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.929820 (+ 15432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.929916 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.469343 (+539427us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:29.487628 (+ 18285us) raft_consensus.cc:1685] finished
0709 13:19:29.487656 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.487817 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17297,"prepare.queue_time_us":91832,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":290474,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":14200,"spinlock_wait_cycles":11667328,"thread_start_us":287950,"threads_started":3,"wal-append.queue_time_us":183418}
I20260709 13:19:29.428799 22315 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:19:29.514726 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 55584.4us
I20260709 13:19:29.514945 19070 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:29.476671 22138 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:19:29.526543 21918 consensus_meta.cc:287] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.848s	user 0.007s	sys 0.002s
I20260709 13:19:29.501909 21878 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:29.511871 22137 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:29.532269 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 85728.1us
I20260709 13:19:29.451452 22340 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:19:29.572119 22344 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:19:29.575280 22205 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:29.579509 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.560104 21915 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:29.533399 22138 consensus_queue.cc:1243] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:29.558632 21918 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.617843 22025 consensus_queue.cc:1243] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:29.618304 21954 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.618530 22328 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:29.637740 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.639075 19139 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:29.640594 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:29.634090 21875 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:19:29.641290 22308 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:29.638257 21954 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.644958 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:29.648054 22138 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:29.675352 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1560) took 1016 ms. Trace:
W20260709 13:19:29.672091 22100 consensus_meta.cc:287] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.005s
I20260709 13:19:29.703191 22138 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:29.703850 22138 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.703239 19218 rpcz_store.cc:276] 0709 13:19:28.659278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.659403 (+   125us) service_pool.cc:224] Handling call
0709 13:19:28.673283 (+ 13880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.025747 (+352464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.670711 (+644964us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54000758d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:29.675306 (+  4595us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806586240}
I20260709 13:19:29.683535 22336 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:29.683851 22337 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:19:29.685590 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.686452 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.686847 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.687258 22344 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.691114 22295 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:29.721724 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.641577 22328 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.627036 22192 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.649531 22341 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.692267 22327 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:29.757102 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.740010 22080 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:29.723067 22295 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:29.769611 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 420121us
I20260709 13:19:29.721344 22336 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.770740 22346 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:29.771750 22346 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:29.772123 22346 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:29.762923 22295 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.744306 22137 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.774852 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:29.781157 22327 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:29.784724 22345 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:19:29.775740 22100 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:19:29.786908 22100 consensus_queue.cc:1243] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:29.773233 21918 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.789656 21954 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.755788 22330 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.792855 22330 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:29.794391 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.809186 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:29.723254 22344 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.813318 19070 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:29.813717 19070 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:29.837793 19750 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:29.837843 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:29.839964 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.840690 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.762832 22080 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.800887 21690 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.842788 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.843063 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.842469 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.844974 19070 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:29.837106 22365 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:19:29.847010 19139 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:29.847141 19142 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:29.850124 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.854468 19140 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:29.852799 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:29.847069 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:29.855032 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.774622 22346 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.852293 19143 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:29.875367 19110 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:29.876574 19070 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.876677 19141 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:29.877821 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.880488 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.881786 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.883055 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:29.864076 22371 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:19:29.883311 19140 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:29.847188 22330 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:29.849865 22320 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:29.846390 22336 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:29.884228 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.864189 22355 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.874104 22137 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.892302 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:29.881371 22326 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:29.897301 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.900899 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:29.901008 22354 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:29.902776 19144 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:29.903282 19141 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.903327 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.874264 22344 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:29.900691 22322 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.908368 22328 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:29.863834 21918 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:19:29.857498 21875 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:29.887311 22320 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.888517 22346 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.889032 22335 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.886518 22327 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.912580 22308 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:29.915246 22327 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.914237 22335 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.915717 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1565) took 1233 ms. Trace:
I20260709 13:19:29.917294 19219 rpcz_store.cc:276] 0709 13:19:28.681804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.713038 (+ 31234us) service_pool.cc:224] Handling call
0709 13:19:28.739578 (+ 26540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.451783 (+712205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.915510 (+463727us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540024c554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:29.915660 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607342336}
I20260709 13:19:29.917706 22335 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:29.920292 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:29.921315 22327 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:29.925065 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:29.925293 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:29.927426 19070 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:29.913883 19141 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:29.927767 19070 pending_rounds.cc:85] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 4
I20260709 13:19:29.928138 19070 pending_rounds.cc:107] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:29.928952 19070 raft_consensus.cc:2889] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.929368 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:29.908486 22322 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:29.936779 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:29.931128 22347 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.932340 19743 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.922324 22354 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:29.931150 21696 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:29.909116 22330 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:29.941422 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:29.942109 19744 raft_consensus.cc:2368] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9.
I20260709 13:19:29.941877 22330 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.942958 19749 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:19:29.912971 22326 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:29.940735 21696 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.950407 22138 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:29.944244 21822 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:29.951103 22326 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.951508 19750 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:29.951438 21822 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.945501 22080 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.954134 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.922585 22320 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:29.939831 22322 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.948531 22056 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:29.949085 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.949240 21690 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:29.970256 19141 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:29.950817 21696 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.956135 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:29.957012 19142 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:29.971124 19070 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.939443 22332 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:29.960481 19138 pending_rounds.cc:85] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 6
I20260709 13:19:29.977948 19138 pending_rounds.cc:107] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:19:29.978245 19138 raft_consensus.cc:2889] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.945436 22347 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.961133 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.962675 21822 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:29.963986 22333 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:29.964573 22246 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.964632 22049 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.949105 22353 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:19:29.972000 19142 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:29.961453 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.981071 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:29.982146 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:29.993352 19065 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:29.982225 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:29.995153 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:30.007524 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:30.009595 22333 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.902544 22355 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.011269 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:30.011757 22333 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.012077 22355 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.012408 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:30.016073 19069 raft_consensus.cc:2410] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:30.016970 19751 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:30.020890 21875 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.021027 22141 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.021426 22360 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.257s	user 0.003s	sys 0.000s
I20260709 13:19:30.021559 21875 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.023223 22295 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.023620 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:30.023993 21875 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.024693 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:30.024922 19748 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:30.025305 19068 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:30.026134 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:30.029075 19070 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:30.032338 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:30.033473 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:30.033784 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:30.037849 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:30.043329 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.021628 22141 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.030259 22370 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:30.034897 22355 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:29.986868 22137 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:19:30.013446 22332 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:30.083915 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.085563 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.087322 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:30.041615 22072 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.045711 22018 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.046370 22310 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:30.007843 22049 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:29.949172 22354 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.134048 22248 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:30.072991 21958 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:19:30.039330 22319 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.111301 19068 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.083912 22333 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.145825 19063 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:30.146190 22333 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.146855 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:30.147161 19063 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:30.147606 19744 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:30.077927 22327 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.135556 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.158941 19747 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
W20260709 13:19:30.108805 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 101345us
I20260709 13:19:30.107128 22275 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:30.136503 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 380) took 1674 ms. Trace:
I20260709 13:19:30.137514 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.138581 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.180109 19142 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:30.109265 19069 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:30.115420 22332 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.184396 19214 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:30.185094 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.145565 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:30.114180 22295 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:30.188273 19141 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:30.148370 22333 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.154062 22138 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.154986 21958 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:30.160933 19218 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:30.232468 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.233175 19215 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:30.046072 22080 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:19:30.110898 22355 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.135210 22323 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:19:30.173357 22310 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:30.399195 22312 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.193336 22327 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:30.410311 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.327198 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:30.411727 19069 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:30.411947 19071 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:30.412201 22327 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:30.406744 22312 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.349291 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.408262 22355 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:30.155894 21690 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.439954 21690 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:30.440424 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:30.440817 21690 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.442046 21690 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.406422 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:30.264269 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.445421 19212 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:30.193536 22275 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.183450 22248 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.226s
I20260709 13:19:30.443740 22312 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.448328 22275 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:30.406386 22310 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.299461 22056 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.126s
W20260709 13:19:30.395991 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 234709us
I20260709 13:19:30.413556 19069 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:30.231630 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.450269 19220 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:30.450378 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:30.236954 19213 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:30.415571 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.177299 19746 rpcz_store.cc:276] 0709 13:19:28.454133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.478841 (+ 24708us) service_pool.cc:224] Handling call
0709 13:19:28.606047 (+127206us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800004598. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:28.606266 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.747828 (+141562us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:28.937298 (+189470us) log.cc:844] Serialized 14 byte log entry
0709 13:19:29.149474 (+212176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:29.149578 (+   104us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:29.149653 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.128005 (+978352us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540039b2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:30.128059 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.128175 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10252,"prepare.queue_time_us":256071,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":123,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8013,"spinlock_wait_cycles":361226496,"thread_start_us":318043,"threads_started":2,"wal-append.queue_time_us":277183}
I20260709 13:19:30.187124 19067 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:30.283442 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.405583 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.453154 19217 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:30.297961 19068 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:30.414400 19071 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:30.425629 22049 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.420511 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:30.455047 19071 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:30.410881 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.231968 21958 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:30.459599 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:30.456768 19221 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:30.465292 19220 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:30.459100 22295 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.458504 22127 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:30.462761 22335 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.469645 22370 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.471186 22061 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.486554 22330 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.478636 22295 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:30.476727 22347 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.455022 22327 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:30.505409 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:30.551642 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:30.553053 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 511612us
I20260709 13:19:30.554195 19214 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:30.555506 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.491882 22127 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.559010 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:30.507926 22330 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:30.538686 22295 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.505736 22370 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.502246 22335 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.513211 22388 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:30.562187 22138 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.568459 22330 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.579546 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.586202 19220 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:30.538480 22061 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.589056 19213 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:30.591521 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:30.594398 21696 consensus_meta.cc:287] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.001s
I20260709 13:19:30.594995 21696 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.588219 19214 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:30.592557 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.604821 22333 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:30.605176 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 14973b885f3f4ff1833ff0e215658aa9: Illegal state: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:30.564014 22072 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:19:30.571709 22387 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:30.585928 22138 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:30.606297 22310 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:30.615320 22393 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:30.537077 21958 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.622598 19213 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.623183 19213 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:30.606045 22332 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.615729 22327 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:19:30.619632 22388 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.657482 22388 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.658257 22018 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:30.658653 22018 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:30.659629 22388 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.625545 22310 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.659523 22018 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.661568 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1700) took 1337 ms. Trace:
I20260709 13:19:30.625689 21958 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.693060 22363 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:30.693993 22363 consensus_queue.cc:1243] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:30.696310 22243 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:30.626437 19213 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.629860 22127 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:30.630722 22392 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:19:30.631387 22389 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:30.635651 22344 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:30.635756 22061 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.636823 22361 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.616942 22138 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:30.638055 22379 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:19:30.639638 22370 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:30.641417 19063 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:30.641532 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:30.642913 22353 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:30.722522 19745 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:30.645676 22192 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:30.623731 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:30.723102 19745 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:19:30.739120 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 115513us
I20260709 13:19:30.648232 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:30.622967 22381 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:19:30.619482 22346 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
I20260709 13:19:30.653751 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:30.616760 22380 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:19:30.664021 21696 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:30.661917 19064 rpcz_store.cc:276] 0709 13:19:29.324537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.324670 (+   133us) service_pool.cc:224] Handling call
0709 13:19:29.336165 (+ 11495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.392215 (+ 56050us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:29.423247 (+ 31032us) log.cc:844] Serialized 14 byte log entry
0709 13:19:29.652316 (+229069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:29.652370 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:29.652410 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.661360 (+1008950us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b54001a9854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:30.661404 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.661515 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17490,"prepare.queue_time_us":394036,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":21900,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":51820,"spinlock_wait_cycles":87671040,"thread_start_us":205811,"threads_started":1,"wal-append.queue_time_us":250977}
I20260709 13:19:30.667100 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.670445 22335 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:30.671289 22320 consensus_meta.cc:287] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.000s
W20260709 13:19:30.673036 22322 consensus_meta.cc:287] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.003s
I20260709 13:19:30.660681 22018 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.668244 22295 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:30.676826 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4: Illegal state: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:30.679198 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:30.775789 19071 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:30.679136 22332 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:30.700130 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:30.776845 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 76815.2us
I20260709 13:19:30.699322 21842 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:30.703486 19213 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.778090 21842 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:30.778884 21842 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.754033 22187 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.780012 21842 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.780051 22187 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.744205 22396 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:30.781101 22396 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.781447 22396 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:30.782461 22187 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.744966 22353 raft_consensus.cc:3055] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:30.784765 22187 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.785034 22353 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:30.714600 22361 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.785250 22187 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.785943 22353 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.786283 22186 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.787132 22353 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.787177 22361 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.787462 22186 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.712292 22344 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.788722 19213 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:19:30.750890 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 102717us
I20260709 13:19:30.789065 19213 pending_rounds.cc:85] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
W20260709 13:19:30.789073 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.789345 22344 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.789805 22187 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.752640 19218 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:30.703683 22330 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.754544 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.742585 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:30.792821 19143 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:30.792933 19217 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.789526 19213 pending_rounds.cc:107] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:30.752065 19220 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:30.791857 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:30.795449 19213 raft_consensus.cc:2889] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:30.794858 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:30.748957 22310 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:30.782492 22295 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:30.754509 22243 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.804333 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:30.805430 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.806038 19220 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:30.814851 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.816133 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.816856 19147 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:30.821866 19140 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:30.815464 19143 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:30.793332 21958 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:30.824326 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:30.830916 19143 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:30.750560 22192 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:30.838944 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.871325 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.837278 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1707) took 1037 ms. Trace:
I20260709 13:19:30.836074 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:30.804292 22332 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:30.751960 22319 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:19:30.872380 19068 rpcz_store.cc:276] 0709 13:19:29.799744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.025922 (+226178us) service_pool.cc:224] Handling call
0709 13:19:30.837078 (+811156us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b540024b154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:30.837213 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194721152}
I20260709 13:19:30.874220 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:30.874627 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:30.823556 21696 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:19:30.879385 19138 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:30.777554 22320 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.879904 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.880488 19220 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:30.805547 22243 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.881201 21895 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:30.881489 22320 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.881614 22243 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.882275 19145 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:30.881636 21895 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.883414 21895 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.826066 22363 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:30.889540 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 384194us
I20260709 13:19:30.887461 22312 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:30.888496 21958 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:30.895282 21958 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:30.895780 21958 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.895723 22346 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:30.890969 22400 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:30.897426 22400 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.901762 22248 raft_consensus.cc:3055] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:30.902230 22248 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:30.902343 22192 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:30.903306 22248 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:30.906729 22396 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:30.908363 22382 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.357s	user 0.000s	sys 0.002s
I20260709 13:19:30.803830 22322 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:30.911069 22322 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:30.911912 19216 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:30.894754 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:30.877669 22332 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:30.887589 22319 consensus_queue.cc:1243] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:30.916407 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:30.900776 22141 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:30.904837 22248 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.918179 22330 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:30.914631 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:30.923190 19141 raft_consensus.cc:606] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:30.925765 19141 raft_consensus.cc:614] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:30.925844 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:30.833760 22344 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:19:30.924757 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:31.005129 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.983675 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.999948 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.011876 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 97324.3us
I20260709 13:19:31.013216 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:31.011282 19213 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:31.024605 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:30.981428 19139 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
W20260709 13:19:31.006189 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.989267 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.031095 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.031719 19219 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:31.016501 19071 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:31.033505 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.035581 19065 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:30.919189 22332 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:31.037223 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.038287 19066 raft_consensus.cc:2410] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:31.038913 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:31.004185 22382 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:19:31.041252 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:30.923683 22072 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:30.920840 22187 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.036984 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:31.044656 19140 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:31.056354 19072 raft_consensus.cc:2410] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:30.986032 22396 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.050604 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.021955 22330 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.056088 19212 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:31.005983 22066 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.057950 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:31.033895 22335 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:31.064571 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:31.062551 19064 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:31.060644 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.066421 19144 raft_consensus.cc:2368] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8.
I20260709 13:19:31.050060 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:31.068066 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1914) took 1229 ms. Trace:
I20260709 13:19:31.070717 19219 raft_consensus.cc:2410] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:31.068574 19145 rpcz_store.cc:276] 0709 13:19:29.838674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.838838 (+   164us) service_pool.cc:224] Handling call
0709 13:19:29.850525 (+ 11687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.882637 (+1032112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.067798 (+185161us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540017acd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:31.067996 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372304128}
W20260709 13:19:31.072962 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.073511 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:31.058068 22072 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.076468 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.076821 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:31.077589 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 253354us
I20260709 13:19:31.077622 19143 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:31.060856 22127 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:31.080482 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.054028 22322 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:31.078454 22072 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.099241 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.081792 19145 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:31.063848 22330 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:31.097008 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.097512 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:31.064100 22335 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.083616 19219 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:31.070729 22328 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.108409 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.108707 19138 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:31.055357 22401 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:19:31.110389 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.111902 19212 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:31.182964 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 84964.5us
I20260709 13:19:31.183709 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:31.185576 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.097986 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 293729us
I20260709 13:19:31.114838 19184 leader_election.cc:400] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9.
I20260709 13:19:31.176614 19219 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:31.178050 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.067188 22066 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.179205 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.194684 19143 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:31.115049 22335 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:31.206485 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 108217us
I20260709 13:19:31.206979 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.113636 22330 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.115178 22344 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.219460 19143 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:31.229183 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.192832 22363 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:31.193292 22275 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.111773 22141 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:19:31.098958 22127 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.204928 22321 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.251319 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:31.261016 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:31.260145 19217 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:31.263185 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:31.191877 22328 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.287200 19147 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:31.283210 22138 consensus_meta.cc:287] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:19:31.261076 22321 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.252797 22295 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:31.284610 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:31.295176 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.229375 22344 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:31.238381 22388 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.326567 19212 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
W20260709 13:19:31.321952 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.309126 22402 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:19:31.258263 22275 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.312367 22321 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.275606 19143 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:31.353725 19212 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:31.306658 21875 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:31.258378 22363 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.325678 22344 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.358145 22415 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:31.334352 22295 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:31.347185 22409 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:19:31.312184 22138 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:31.369957 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 173233us
I20260709 13:19:31.381628 19064 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:31.403367 19110 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:31.404134 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 189204us
I20260709 13:19:31.346961 22328 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.294914 22322 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:19:31.331012 22388 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.412382 19212 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:31.412950 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 200976us
I20260709 13:19:31.433879 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:31.358911 21875 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.370803 22295 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:31.446358 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:31.430269 22399 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:19:31.367801 21958 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.452517 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.429888 22396 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.439512 22415 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.466475 22415 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:31.466780 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1711) took 1333 ms. Trace:
I20260709 13:19:31.467319 22415 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.468513 22415 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.469002 22396 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.451519 22401 raft_consensus.cc:2764] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:31.469849 22332 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.470930 22401 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:31.462896 22417 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:19:31.463027 22248 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.005s
I20260709 13:19:31.463512 22295 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.464359 22423 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.464473 21875 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:31.448920 22328 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:31.447764 22330 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:31.475700 22353 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.688s	user 0.013s	sys 0.000s
I20260709 13:19:31.450424 22404 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.478014 22187 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:31.480671 19072 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:31.467160 19069 rpcz_store.cc:276] 0709 13:19:30.133206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.460574 (+327368us) service_pool.cc:224] Handling call
0709 13:19:30.460913 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.463719 (+  2806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.463750 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.464176 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.805949 (+341773us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:30.806589 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.806674 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.466584 (+659910us) raft_consensus.cc:1685] finished
0709 13:19:31.466603 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.466724 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2451,"raft.queue_time_us":2558,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3786,"thread_start_us":328233,"threads_started":1,"wal-append.queue_time_us":585408}
I20260709 13:19:31.470944 22396 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.476377 22401 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:31.485882 22411 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 13:19:31.493127 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.480825 22066 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.481163 22423 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.511201 19069 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
W20260709 13:19:31.514659 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 111401us
I20260709 13:19:31.497776 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:31.518375 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:31.496970 22295 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.490993 22404 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:31.526332 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51744 (request call id 20) took 1358 ms. Trace:
I20260709 13:19:31.513934 21696 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.526650 19141 rpcz_store.cc:276] 0709 13:19:30.189336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.249636 (+ 60300us) service_pool.cc:224] Handling call
0709 13:19:31.520628 (+1270992us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540017c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103584853 00007f610855260a 00007f6101ad87d4 00007f6101ad8762 00007f6101ad8691 00007f6101ad860c 00007f6101ad78c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:31.520727 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101945600}
W20260709 13:19:31.528457 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 92385.8us
W20260709 13:19:31.529486 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 77046.1us
I20260709 13:19:31.513298 22127 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:31.489871 22328 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.533473 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.534255 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:31.518924 22066 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.535506 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:31.517395 22423 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:31.537576 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.542073 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.546200 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:31.546772 19070 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.548260 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:31.549711 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:31.557191 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.557889 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.558571 19146 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:31.558616 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.559260 19140 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:31.559532 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:31.560554 19750 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:31.563105 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:31.563532 19140 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:31.563961 19221 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:31.520287 22428 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:31.527842 22332 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.566933 19141 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:31.498961 22187 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.573378 19747 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:31.549023 22127 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.576463 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.549438 22363 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.578497 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:31.580476 22422 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:19:31.530802 22425 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:31.588744 19070 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
W20260709 13:19:31.589288 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 73791.8us
I20260709 13:19:31.590637 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.569713 22322 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.566987 22424 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:31.594769 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:31.648352 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 54250.4us
I20260709 13:19:31.590736 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:31.568979 21875 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:31.617468 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.636674 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:31.566516 22427 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.561488 22066 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.570665 22353 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:19:31.562250 22335 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.661849 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:31.595536 19221 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:31.582020 22138 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:31.639514 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 97525.1us
W20260709 13:19:31.637205 22419 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:19:31.656188 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1762) took 1001 ms. Trace:
I20260709 13:19:31.666020 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:31.595029 22435 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:31.667685 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.670342 19217 rpcz_store.cc:276] 0709 13:19:30.654830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.267086 (+612256us) service_pool.cc:224] Handling call
0709 13:19:31.268381 (+  1295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.273612 (+  5231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.273657 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.314393 (+ 40736us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.531822 (+217429us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:31.531883 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.532440 (+   557us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.655926 (+123486us) raft_consensus.cc:1685] finished
0709 13:19:31.655954 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.656117 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4760,"raft.queue_time_us":55987,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":14440,"thread_start_us":165866,"threads_started":1,"wal-append.queue_time_us":231773}
I20260709 13:19:31.674918 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:31.669011 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:31.675650 19070 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.650823 21875 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.653057 22424 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.650995 22427 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.655915 22388 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.692406 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.688952 22049 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.664577 21958 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.688902 22332 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:19:31.697506 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.656059 22248 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:31.693531 22186 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.001s
I20260709 13:19:31.581744 22401 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:31.702033 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1586) took 1528 ms (client timeout 1551 ms). Trace:
I20260709 13:19:31.688215 22403 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.703238 19070 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:31.704309 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:31.713280 19218 rpcz_store.cc:269] 0709 13:19:30.164316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.283134 (+118818us) service_pool.cc:224] Handling call
0709 13:19:31.692796 (+1409662us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b540034ce54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:31.692942 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689368448}
I20260709 13:19:31.714218 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.709156 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:31.715408 19218 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:31.715513 19071 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:19:31.699777 22429 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:19:31.656997 22430 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:31.673574 22243 consensus_meta.cc:287] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.000s
I20260709 13:19:31.693367 21875 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:31.717378 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 126760us
I20260709 13:19:31.693559 22424 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.717911 19063 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:31.700172 22427 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.692474 22330 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:31.701653 22175 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.701196 22049 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:31.702971 22435 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:31.723464 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 61723.7us
I20260709 13:19:31.724450 19218 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:31.738309 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.726503 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.739639 22403 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:31.740100 22403 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:31.741308 22403 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.743870 22450 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:31.728471 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:31.729231 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1755) took 1182 ms. Trace:
I20260709 13:19:31.703363 22439 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.734817 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:31.745441 22439 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.745924 22439 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.746309 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:31.745271 19214 rpcz_store.cc:276] 0709 13:19:30.547007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.599014 (+ 52007us) service_pool.cc:224] Handling call
0709 13:19:30.599285 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.983689 (+384404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.983737 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.006134 (+ 22397us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.196938 (+190804us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:31.197000 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.197113 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.729044 (+531931us) raft_consensus.cc:1685] finished
0709 13:19:31.729064 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.729179 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46703,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":525040,"threads_started":2,"wal-append.queue_time_us":297463}
I20260709 13:19:31.747285 19070 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:31.705364 22322 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.749327 22322 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:31.749774 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:31.750145 22322 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:31.736359 19071 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:31.725309 22186 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.751968 22322 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.730825 22127 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.730348 22361 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.729712 22430 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:31.645924 22404 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.717021 22248 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.706919 22428 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:19:31.752746 22328 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:31.798959 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 47956.8us
I20260709 13:19:31.730623 22243 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.766013 22353 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:19:31.762341 22322 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:31.763895 22443 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.761126 22426 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:31.812222 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 72160.8us
I20260709 13:19:31.761914 22330 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:19:31.754082 22175 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.814666 19068 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:31.819828 19067 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:31.808180 22443 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:31.818372 22444 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:19:31.808640 22426 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:31.819098 22072 consensus_meta.cc:287] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.002s
I20260709 13:19:31.823778 19066 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [4.4-7.5]
I20260709 13:19:31.825474 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.802419 22388 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.790838 22361 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.829061 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.830678 19714 leader_election.cc:400] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8.
I20260709 13:19:31.836272 19714 leader_election.cc:403] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:31.831688 19068 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:19:31.846887 19068 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:31.835492 21895 consensus_meta.cc:287] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.952s	user 0.012s	sys 0.000s
W20260709 13:19:31.834493 22436 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:19:31.858330 22447 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.859019 22447 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.866954 22320 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.867658 22320 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.823606 22443 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.820900 22187 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.823464 22426 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.817096 22428 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:31.837168 22138 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:31.848196 21842 consensus_meta.cc:287] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.068s	user 0.007s	sys 0.004s
I20260709 13:19:31.885378 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1592) took 1238 ms. Trace:
I20260709 13:19:31.887516 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:31.880857 22187 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.881088 22449 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.836354 22332 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.890425 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.887907 19213 rpcz_store.cc:276] 0709 13:19:30.646484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.117416 (+470932us) service_pool.cc:224] Handling call
0709 13:19:31.198755 (+ 81339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.449229 (+250474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.449263 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.453772 (+  4509us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.539593 (+ 85821us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:31.568688 (+ 29095us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.568867 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.568949 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.695876 (+126927us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b180037b460. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:19:31.885102 (+189226us) raft_consensus.cc:1685] finished
0709 13:19:31.885193 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.885320 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1659,"prepare.queue_time_us":30883,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":103751,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":25147,"spinlock_wait_cycles":6022528,"thread_start_us":302465,"threads_started":2,"wal-append.queue_time_us":102065}
I20260709 13:19:31.848263 22066 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.837172 22396 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:19:31.884678 22421 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.439s	user 0.001s	sys 0.002s
I20260709 13:19:31.829960 22072 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:31.902925 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:31.856256 22335 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:31.882045 22438 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:19:31.912308 19140 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:31.885751 22330 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.881438 22432 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:31.938763 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:31.878181 21895 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.887511 22439 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.958565 22456 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:31.970289 19213 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:31.961220 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1764) took 1168 ms. Trace:
I20260709 13:19:31.942727 22330 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.966727 19221 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:31.969334 22428 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.004124 22455 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.883334 22430 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.004700 22455 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.005455 21895 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:31.905740 22449 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.960414 22432 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.945634 22335 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.006956 19138 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:32.011089 22439 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.011576 22428 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.021301 22406 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:32.021938 22406 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.023722 22453 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.024937 22243 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:32.027823 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.069047 22439 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.069751 22439 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.910874 22332 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:31.973122 19212 rpcz_store.cc:276] 0709 13:19:30.792803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.444166 (+651363us) service_pool.cc:224] Handling call
0709 13:19:31.444563 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.451971 (+  7408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.452001 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.488973 (+ 36972us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.573149 (+ 84176us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:31.573309 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.573375 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.960960 (+387585us) raft_consensus.cc:1685] finished
0709 13:19:31.960985 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.961155 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6986,"raft.queue_time_us":25794,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":1921920,"thread_start_us":46931,"threads_started":1,"wal-append.queue_time_us":156058}
I20260709 13:19:32.101822 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1579) took 1943 ms. Trace:
I20260709 13:19:32.102262 19216 rpcz_store.cc:276] 0709 13:19:30.158056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.183755 (+ 25699us) service_pool.cc:224] Handling call
0709 13:19:30.283892 (+100137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.912373 (+628481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.101587 (+1189214us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540034c954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:32.101763 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443691264}
I20260709 13:19:32.107232 22275 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.131428 22192 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:32.131999 22192 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:32.143636 22445 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 13:19:32.146387 22404 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.147161 22192 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.164633 22341 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:32.165171 22341 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:32.166098 22341 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.170481 22248 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.171944 22435 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.172323 22435 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:32.173355 22435 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.174578 22435 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.179469 22310 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:32.179996 22310 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.182085 22310 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.182549 22310 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.182971 22310 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:32.188810 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.191406 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1920) took 1087 ms. Trace:
I20260709 13:19:32.191869 19064 rpcz_store.cc:276] 0709 13:19:31.104493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.225819 (+121326us) service_pool.cc:224] Handling call
0709 13:19:32.191165 (+965346us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:32.191337 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345755008}
I20260709 13:19:32.193084 22322 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.163182 22141 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:32.208698 22400 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.208774 22322 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.209280 22141 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.210392 22341 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.220890 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.223074 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:32.227396 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 389087us
I20260709 13:19:32.238312 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.240202 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.253038 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1718) took 1236 ms. Trace:
I20260709 13:19:32.257793 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1930) took 2372 ms. Trace:
I20260709 13:19:32.258260 19139 rpcz_store.cc:276] 0709 13:19:29.885456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.885596 (+   140us) service_pool.cc:224] Handling call
0709 13:19:29.885877 (+   281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:31.034009 (+1148132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.257509 (+1223500us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540017bbd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:32.257729 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518597376}
I20260709 13:19:32.253492 19063 rpcz_store.cc:276] 0709 13:19:31.016223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.016801 (+   578us) service_pool.cc:224] Handling call
0709 13:19:31.017147 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.727753 (+710606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.252766 (+525013us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540025ce54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:32.252966 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610871552}
I20260709 13:19:32.270352 19745 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.271940 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 1938) took 1177 ms. Trace:
I20260709 13:19:32.272285 19147 rpcz_store.cc:276] 0709 13:19:31.079980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.080232 (+   252us) service_pool.cc:224] Handling call
0709 13:19:32.257107 (+1176875us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400123254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:32.257232 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467806592}
I20260709 13:19:32.352134 22332 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:32.355149 22344 consensus_meta.cc:287] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.947s	user 0.015s	sys 0.002s
I20260709 13:19:32.355754 22344 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.358889 19745 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.366024 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.288328 22346 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.338939 22440 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.339803 22400 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:32.381088 22450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.000s	sys 0.012s
I20260709 13:19:32.398788 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.403293 19219 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.407910 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.411979 19220 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:32.411600 22400 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.411645 22346 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.411597 22440 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.414325 22400 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:32.411791 22450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.012s
I20260709 13:19:32.415127 22346 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.411931 19219 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:32.415174 22440 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.416587 19219 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.417887 19219 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.410712 19218 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:32.386197 22248 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.435137 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.436043 19218 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:32.443301 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:32.408798 22056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.021s	sys 0.038s
W20260709 13:19:32.436868 22403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.005s	sys 0.009s
I20260709 13:19:32.409421 22072 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.407730 22175 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:32.475521 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 127896us
I20260709 13:19:32.455029 19745 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:32.467805 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:32.476228 19745 pending_rounds.cc:85] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 8
I20260709 13:19:32.476248 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.476608 19745 pending_rounds.cc:107] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:32.477833 19745 raft_consensus.cc:2889] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.478782 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 387) took 2935 ms. Trace:
I20260709 13:19:32.480921 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:32.481720 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 506) took 1922 ms. Trace:
I20260709 13:19:32.446204 22457 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.442384 22330 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:32.452836 22056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.022s	sys 0.038s
I20260709 13:19:32.472195 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.479215 19745 rpcz_store.cc:276] 0709 13:19:29.543409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.543624 (+   215us) service_pool.cc:224] Handling call
0709 13:19:29.564505 (+ 20881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.722428 (+1157923us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b54005b52a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103501dc0 00007f610358c1c0 00007f610358d231 00007f6103589d8f 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c
0709 13:19:32.269986 (+1547558us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54005b52a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610350806f 00007f6103580f60 00007f61035827de 00007f610358cb49 00007f610358d416 00007f6103589d8f 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62
0709 13:19:32.478433 (+208447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.478714 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521437312}
I20260709 13:19:32.483312 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:32.441179 22248 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.439949 22460 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.499943 19220 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:32.487682 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:32.467618 22403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.006s	sys 0.009s
I20260709 13:19:32.395030 22049 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:32.499934 19069 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:32.467921 19184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.007s	sys 0.010s
W20260709 13:19:32.487339 22180 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:32.466486 22449 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.508553 19221 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:32.477398 22439 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.482970 22080 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.482501 22141 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.482807 22363 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.511174 19184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.007s	sys 0.010s
I20260709 13:19:32.537746 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.516775 22396 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.512120 19066 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.041s
W20260709 13:19:32.509060 22444 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.062s	sys 0.095s
I20260709 13:19:32.537487 22432 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:32.586150 22415 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.111s	user 0.022s	sys 0.009s
I20260709 13:19:32.504266 22310 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.504608 22460 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:32.568773 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.497722 22428 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.520249 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.555754 19219 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:32.641111 19219 pending_rounds.cc:85] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:19:32.641393 19219 pending_rounds.cc:107] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:32.641618 19219 raft_consensus.cc:2889] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:32.641880 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.642421 19220 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 5: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:32.588234 19069 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:32.497201 22072 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.578466 22336 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.594316 19212 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:32.595700 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 208579us
I20260709 13:19:32.639235 22080 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.537881 22275 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:32.597688 19066 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.011s	sys 0.055s
I20260709 13:19:32.540691 22480 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.506762 22406 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:32.592108 22295 consensus_meta.cc:287] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.064s	user 0.016s	sys 0.003s
I20260709 13:19:32.639995 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.508131 22455 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.508615 22464 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:19:32.501490 22457 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:32.593397 21696 consensus_meta.cc:287] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.063s	user 0.009s	sys 0.009s
I20260709 13:19:32.622140 22396 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.622260 22363 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.640568 22460 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:32.620582 22444 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.064s	sys 0.103s
I20260709 13:19:32.651103 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:32.663429 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.664081 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.654893 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.686359 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:32.686905 19220 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:32.654059 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.687873 19219 raft_consensus.cc:2410] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:32.687925 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 220163us
I20260709 13:19:32.677266 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.678609 19221 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:32.650620 22248 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.682307 19215 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:32.597162 22475 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:32.652441 22310 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.664271 22192 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.647706 22474 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.597570 22321 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.231s	user 0.013s	sys 0.019s
W20260709 13:19:32.674809 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.665299 22361 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.687391 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:32.687407 21696 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:32.693554 22415 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.726542 19221 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:32.679973 21958 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.676448 22275 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:32.698488 22443 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.811s	user 0.004s	sys 0.014s
I20260709 13:19:32.652448 22428 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:32.718256 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.651819 22072 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.661131 22336 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:32.736563 22186 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.973s	user 0.013s	sys 0.006s
I20260709 13:19:32.703086 22344 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.680003 22480 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:32.728567 22127 consensus_meta.cc:287] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.938s	user 0.032s	sys 0.014s
I20260709 13:19:32.731945 22431 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:32.733860 22341 consensus_meta.cc:287] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.014s
W20260709 13:19:32.749035 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.748713 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:32.683936 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:32.751112 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:32.707409 22310 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.757603 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.744740 22248 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:32.759442 22248 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:32.760363 22404 consensus_meta.cc:287] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.613s	user 0.014s	sys 0.006s
I20260709 13:19:32.760921 19218 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:32.755678 22477 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:19:32.761947 22248 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.738035 21958 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.756098 22186 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.762970 22396 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.763687 22396 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.764114 21958 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.767738 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:32.768242 22414 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:32.769186 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:32.769816 22456 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:32.772567 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.772836 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 88933.9us
I20260709 13:19:32.770476 22456 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:32.774453 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:32.776787 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.739799 22478 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.705838 22475 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.777674 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:32.781654 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.764101 22396 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:32.723168 22474 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.780921 22476 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.785696 22439 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:32.781101 22456 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:32.723620 22321 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.779171 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:32.774957 22423 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.208s	user 0.013s	sys 0.040s
I20260709 13:19:32.782418 19221 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:32.782807 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:32.745514 22486 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:32.776722 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.781733 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:32.771214 22127 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.789784 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:32.798676 19138 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:32.770917 22415 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:32.754891 22483 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.789623 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:32.791138 22468 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:19:32.797477 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.801151 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.811620 19214 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:32.783294 22248 consensus_queue.cc:1059] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:32.810225 22388 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:32.813079 22456 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.814181 19216 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.820710 19216 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:32.821993 22485 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.108s	user 0.000s	sys 0.003s
I20260709 13:19:32.822160 22180 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:32.826107 22310 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.785081 22455 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:19:32.826797 22320 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.800523 22476 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.829015 22475 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.830294 22474 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.831398 22396 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.797216 22423 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.834277 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:32.835460 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.487883 19743 rpcz_store.cc:276] 0709 13:19:30.558877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.561041 (+  2164us) service_pool.cc:224] Handling call
0709 13:19:30.603056 (+ 42015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.616156 (+ 13100us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:31.201381 (+585225us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.168612 (+967231us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b1800205f00. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:19:32.480698 (+312086us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:32.480843 (+   145us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:32.480995 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.481180 (+   185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.481574 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29010,"prepare.queue_time_us":782788,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":368869,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":24493,"spinlock_wait_cycles":20103040,"thread_start_us":1075202,"threads_started":3,"wal-append.queue_time_us":284496}
I20260709 13:19:32.786978 22432 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.837177 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:32.837718 19144 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.837456 22432 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.838549 22072 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.742970 22443 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.780761 22361 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.758536 22431 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.808534 19145 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:32.784245 22404 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.783365 22401 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:32.745033 22428 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.836540 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.845525 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.808676 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.850008 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1928) took 1588 ms. Trace:
I20260709 13:19:32.852838 19146 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:32.776054 22344 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:19:32.849421 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 159339us
I20260709 13:19:32.861982 19221 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:32.849325 22431 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:32.850571 22426 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.968s	user 0.028s	sys 0.030s
I20260709 13:19:32.797883 22482 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:32.853677 22427 consensus_meta.cc:287] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.116s	user 0.026s	sys 0.032s
I20260709 13:19:32.888295 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:32.889484 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.886013 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:32.861914 19066 rpcz_store.cc:276] 0709 13:19:31.261616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.829092 (+567476us) service_pool.cc:224] Handling call
0709 13:19:31.839869 (+ 10777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.840050 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:32.667069 (+827019us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.849679 (+182610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:32.849740 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:32.849788 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.849855 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.849956 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51651,"prepare.queue_time_us":845257,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":957375,"threads_started":2}
W20260709 13:19:32.891701 22424 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.162s	user 0.021s	sys 0.038s
I20260709 13:19:32.892108 22424 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:32.894227 22138 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.004s	user 0.010s	sys 0.007s
I20260709 13:19:32.894599 22138 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:32.895166 22138 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:32.895640 22138 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:32.897559 22336 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.898138 22480 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.898293 22428 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.899571 22443 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:32.844244 22483 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.901062 21958 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.901311 22426 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.901572 21958 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.901937 22483 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.797672 22341 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:19:32.790482 22478 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.903328 22426 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:32.903617 21958 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.903869 22427 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.904917 22478 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.905977 22451 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:32.888837 22482 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.906477 22451 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:32.906596 22482 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.907325 22451 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.908262 22451 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.857440 22347 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.886956 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:32.888276 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.909739 22464 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.909843 19071 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:32.910270 22454 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:32.910559 22363 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.910640 22454 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:32.911547 22454 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.912150 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1919) took 1827 ms. Trace:
I20260709 13:19:32.910228 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.913146 19146 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:32.913982 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.912097 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.914853 19141 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:32.917929 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:32.912636 19071 rpcz_store.cc:276] 0709 13:19:31.084607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.752820 (+668213us) service_pool.cc:224] Handling call
0709 13:19:31.753140 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.910283 (+1157143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.911920 (+  1637us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000a0354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:32.912096 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2659705728}
I20260709 13:19:32.918722 19143 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:32.935442 19070 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:32.938184 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:32.927918 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 153348us
I20260709 13:19:32.887692 22486 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:32.940985 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:32.942425 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:32.942700 19141 raft_consensus.cc:606] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:32.943122 19141 raft_consensus.cc:614] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:32.944099 19071 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:32.944583 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:32.851800 22475 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:19:32.960703 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:32.960919 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.961269 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.964049 19215 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
W20260709 13:19:32.936589 22322 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.726s	user 0.005s	sys 0.017s
I20260709 13:19:32.964815 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.969213 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:32.962258 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.923847 19212 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:32.965677 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.885540 22401 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:32.969297 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:32.905990 22427 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.968869 19063 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:32.896492 22138 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:32.963464 22468 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:32.979951 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:32.980218 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:32.970888 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 121023us
I20260709 13:19:32.981130 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:32.971549 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.981724 19747 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:32.971709 19213 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:32.936316 22061 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.920953 22361 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.976598 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:32.982816 19146 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.935442 22400 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.978456 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.983911 19064 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:32.986656 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.987373 19064 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:32.981413 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:32.988385 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.972114 22446 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:19:32.989818 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:32.990016 22424 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.985396 22186 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.991158 19750 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:32.985531 22400 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:32.982046 19066 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 6.
I20260709 13:19:32.991930 22061 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:32.992795 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.993168 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:32.993757 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:32.993847 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.994871 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:32.995920 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:32.992563 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.996721 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:32.997206 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.997891 19063 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:32.998603 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:32.998726 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.999768 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:32.944214 22346 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:19:33.001298 22346 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:33.001624 22346 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:33.002434 22346 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.003545 22346 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:33.006042 21875 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.272s	user 0.014s	sys 0.005s
I20260709 13:19:33.006438 21875 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.007380 19069 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:33.008289 21875 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.972093 22275 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:32.997428 19067 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:33.000710 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.009621 19141 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:33.008647 19144 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:32.990902 22186 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:32.964097 22336 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.009208 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.964735 22404 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.992148 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.021870 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:32.977212 22454 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:32.994886 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.013448 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.013756 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.012748 19064 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:32.969046 22426 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.014707 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:33.019731 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:33.022853 19750 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:32.980193 22428 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.015630 19063 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:33.034934 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:32.910240 22464 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.036501 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:32.992136 22400 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.037300 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:32.986920 22489 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:32.960803 22483 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:33.038887 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 60266.1us
I20260709 13:19:33.039188 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.041158 19072 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.041725 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.020931 22404 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.042750 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.035508 19146 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:33.032153 19066 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:33.036239 22320 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.042783 19063 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:33.056367 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.053937 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:33.059114 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.039712 22414 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:33.030092 22187 consensus_meta.cc:287] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.129s	user 0.009s	sys 0.010s
I20260709 13:19:33.060456 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.049551 22248 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:33.061209 19066 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:33.064736 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:33.071743 19068 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:33.053890 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.039714 22428 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.058053 22325 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:33.009616 22361 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.067373 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:33.066825 22320 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.065663 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.117877 19063 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.072083 19068 pending_rounds.cc:85] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 4
I20260709 13:19:33.073017 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:33.073715 19066 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:33.119390 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.120564 22361 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.122107 22460 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.123260 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.124423 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.073624 22187 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 7. Current term is 8.
I20260709 13:19:33.125891 22321 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.126722 19746 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:33.128976 22494 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:33.129326 22080 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.129971 22320 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.132076 22460 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.063820 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:33.134634 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 70884.6us
I20260709 13:19:33.058260 21875 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:33.029762 22336 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.061107 22404 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.146651 22336 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:33.035848 22426 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:33.080454 19072 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:33.081166 19146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3627cae163084c338404a5153ef0efb9"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:33.148098 19146 raft_consensus.cc:606] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.054724 22489 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.149590 22489 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.086239 22332 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.073839 22490 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:33.087276 22464 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.087940 22186 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.071192 22248 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.163157 22248 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.068967 22414 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:33.166548 22414 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.068027 22275 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:33.081568 22322 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.170953 22322 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:33.171933 22322 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.172088 22400 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.178188 22457 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.179991 22320 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.182071 22467 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:33.182267 22400 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.070326 22406 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:19:33.081732 22428 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:33.098814 22448 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.286s	user 0.007s	sys 0.000s
I20260709 13:19:33.099376 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:33.072258 22478 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.153251 22332 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.082270 22325 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.105377 22347 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.070581 22056 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.073328 22401 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.109810 22483 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.111210 22482 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.111833 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.192001 22406 consensus_queue.cc:1243] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:33.058398 22486 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.118326 19068 pending_rounds.cc:107] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:33.217697 19068 raft_consensus.cc:2889] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.134025 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.137563 19742 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:33.138715 19063 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:33.135481 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:33.139609 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 66722.8us
I20260709 13:19:33.139885 19215 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:33.148430 19146 raft_consensus.cc:614] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:33.148960 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.119395 22049 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.139271 21875 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.144922 22460 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.148021 22451 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:33.148710 22426 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.245944 22451 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:33.246680 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.246855 22451 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.247710 22455 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.248180 22455 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:33.250259 22061 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:33.233709 22482 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.195199 22446 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:33.251781 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1918) took 2172 ms. Trace:
I20260709 13:19:33.252118 19070 rpcz_store.cc:276] 0709 13:19:31.079725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.748833 (+669108us) service_pool.cc:224] Handling call
0709 13:19:31.757644 (+  8811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.938232 (+1180588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.251583 (+313351us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001a8954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:33.251731 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708204416}
I20260709 13:19:33.253261 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.254247 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.254323 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.254810 19070 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 5.
I20260709 13:19:33.254966 19743 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:33.255625 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.255963 22426 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:33.257932 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.258265 19221 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:33.258647 22426 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.221985 22321 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.262132 22321 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:33.262509 22321 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:33.194161 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 94840.9us
I20260709 13:19:33.266263 22388 raft_consensus.cc:3055] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:33.266657 22388 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:33.199031 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.196182 22478 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.269116 22423 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.269618 22478 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.188845 22275 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:33.270638 22275 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.239522 22449 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:33.272418 22449 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:33.113482 22431 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.273162 22449 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.274309 22449 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.274405 22431 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.182637 22467 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.197079 22332 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.221726 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1766) took 2334 ms. Trace:
I20260709 13:19:33.220036 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.222213 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.277935 19212 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.278251 19220 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:33.217841 19747 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:19:33.279290 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.226743 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.277401 19217 rpcz_store.cc:276] 0709 13:19:30.887386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.690783 (+803397us) service_pool.cc:224] Handling call
0709 13:19:31.691023 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.699657 (+  8634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.699702 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.700282 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.792854 (+ 92572us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:31.792945 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.793065 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.009532 (+1216467us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:33.221408 (+211876us) raft_consensus.cc:1685] finished
0709 13:19:33.221437 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.221674 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17693,"raft.queue_time_us":10976,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1939,"spinlock_wait_cycles":2334464,"thread_start_us":57158,"threads_started":1,"wal-append.queue_time_us":94058}
I20260709 13:19:33.256537 22320 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.280792 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.227602 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:33.200796 22325 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.228865 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:33.230290 22430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.001s	sys 0.007s
I20260709 13:19:33.281981 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.282881 19217 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:33.201418 22501 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:19:33.231958 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.289268 19066 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:33.232224 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:33.233314 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 97882.9us
I20260709 13:19:33.226754 19219 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:33.290712 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.236670 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.217106 22483 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.237533 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.234711 21875 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.234570 22460 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.238556 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.238863 22447 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.239547 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.239782 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:33.321466 19141 raft_consensus.cc:606] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.321839 19141 raft_consensus.cc:614] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:33.240422 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.322535 19146 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:33.238837 22248 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.245091 22490 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:33.208447 22056 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:33.104563 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.250022 22432 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.267488 22388 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.280669 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.283787 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.187112 22404 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.285095 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.285697 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.283788 22423 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:33.286695 22430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.001s	sys 0.007s
I20260709 13:19:33.287899 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.282354 19215 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:33.291497 19068 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:33.291211 19219 raft_consensus.cc:2376] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8. Re-sending same reply.
I20260709 13:19:33.256610 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.290231 19139 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:33.291196 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:33.315429 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.320784 19147 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
W20260709 13:19:33.327816 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.373935 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:33.398820 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107688us
I20260709 13:19:33.378336 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:33.373566 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:33.378165 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.400811 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.362309 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.386740 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:33.402575 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:33.402856 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 115000us
I20260709 13:19:33.316620 22444 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.309757 22476 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.406625 19751 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:33.406818 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44597.3us
I20260709 13:19:33.391646 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.407047 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.407997 19212 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:33.384999 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.408429 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.398993 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.408725 19217 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:33.315192 22310 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.411422 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.325736 22460 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.326241 22459 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:33.416169 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.415041 19142 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:33.454174 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.326000 22490 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:33.476097 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:33.457067 19747 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:33.457746 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.437867 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.462590 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.463897 22056 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.479178 19147 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:33.465083 22248 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.466470 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:33.480098 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.481325 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.481654 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.405886 21822 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.468117 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:33.372552 22493 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.381193 22489 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.415134 22401 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.469262 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 108012us
I20260709 13:19:33.469666 22396 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.470346 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.498649 19072 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:33.500054 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:33.409474 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 181910us
I20260709 13:19:33.500417 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.501204 19141 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:33.501334 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.474598 19217 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.462142 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.486289 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.387053 22467 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:33.505151 19146 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 4.
I20260709 13:19:33.506911 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.508116 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:33.383893 22321 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.410465 22482 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.413910 22138 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.410351 22480 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.489084 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:33.490922 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 72093us
I20260709 13:19:33.529909 19147 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:33.496412 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:33.410964 22423 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.510735 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.488116 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.535050 19070 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:33.518635 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:33.521310 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 83531.4us
I20260709 13:19:33.532667 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.483023 22490 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.476480 22459 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:33.460206 22476 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:33.550206 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.550339 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.550676 19217 raft_consensus.cc:2410] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:33.524916 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.551615 19144 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:33.438330 22444 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.537606 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.537787 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:33.552477 19213 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.532670 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:33.553035 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.526696 22482 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.543213 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.544323 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.545418 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:33.547140 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.548199 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:33.646461 19141 raft_consensus.cc:2368] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:33.554234 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:33.646751 19072 raft_consensus.cc:2368] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9.
I20260709 13:19:33.555197 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.521271 22322 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.552552 22403 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.509045 22401 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.632287 19138 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:33.527169 22243 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.497814 22447 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:19:33.527060 22492 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.544960 22432 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.534142 22480 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.541601 22061 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.499198 22493 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.557277 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:33.647466 19217 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:33.713599 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.714427 19217 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:33.715476 19217 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:33.644778 19068 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:33.649036 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 94868.5us
I20260709 13:19:33.542395 22330 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:33.654780 19144 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:33.606477 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:33.719308 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:33.526532 22426 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.116s
W20260709 13:19:33.654277 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 111136us
I20260709 13:19:33.473279 22310 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.720314 22426 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:33.720675 22426 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:33.721849 22310 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.559023 22056 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.558409 22478 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.585027 22248 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.690450 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.723199 22248 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.723381 19065 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.723742 22248 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.723968 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:33.726600 19215 pending_rounds.cc:85] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 3
I20260709 13:19:33.726886 19215 pending_rounds.cc:107] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:33.727095 19215 raft_consensus.cc:2889] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.729717 19065 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:33.729909 19218 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:33.730670 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.731175 19065 raft_consensus.cc:2376] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10. Re-sending same reply.
I20260709 13:19:33.731983 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.554847 22459 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.697177 19213 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:33.650981 22457 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.661820 22320 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:33.713724 21822 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.719236 22330 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.721488 22426 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.770922 22426 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.771725 22330 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.772298 22322 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:33.773001 22310 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.772866 22322 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.773198 22320 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:33.774865 22322 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.774399 22320 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.722002 22401 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:33.776917 22474 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:33.777372 22474 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:19:33.777930 22510 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:19:33.778213 22474 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.640748 22482 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.779625 22310 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.783965 22310 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.736985 19065 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:33.785878 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:33.786736 19065 raft_consensus.cc:2368] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:33.787920 19065 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:33.554140 22415 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.790045 22415 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:33.792479 22415 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:33.738632 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 181443us
W20260709 13:19:33.740409 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.655311 22451 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:19:33.704954 22508 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:33.698544 22455 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:33.867429 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.759078 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.552556 22400 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:33.871467 22428 consensus_meta.cc:287] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.003s
I20260709 13:19:33.871867 22428 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:33.705243 22432 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.872721 22432 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:33.794890 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.873282 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.873391 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1779) took 1406 ms (client timeout 1555 ms). Trace:
I20260709 13:19:33.707451 22480 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.800100 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:33.800482 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 245671us
W20260709 13:19:33.873833 19216 rpcz_store.cc:269] 0709 13:19:32.467549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.467793 (+   244us) service_pool.cc:224] Handling call
0709 13:19:33.873232 (+1405439us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54000753d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:33.873326 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720638848}
I20260709 13:19:33.875046 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:33.779212 22474 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.757867 22056 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:33.766472 22483 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.888602 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.755007 19139 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
W20260709 13:19:33.869930 22505 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:19:33.875015 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:33.828996 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.877354 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 77299.5us
I20260709 13:19:33.899700 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.901140 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.762603 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:33.906077 22423 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:33.906893 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.907258 22476 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:33.883172 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:33.911473 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:33.909593 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:33.876888 22511 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:19:33.890970 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.933102 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.904764 22444 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:33.905205 22061 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.884573 22430 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:33.938005 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:33.922950 22449 consensus_meta.cc:287] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 13:19:33.887444 22056 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.952836 22056 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.953114 22401 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.908722 22451 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.909924 22423 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:33.871753 22400 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:33.908816 22454 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.002s
I20260709 13:19:33.947497 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:33.922772 22325 consensus_meta.cc:287] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:19:33.951434 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.970705 19212 raft_consensus.cc:2376] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9. Re-sending same reply.
I20260709 13:19:33.971782 19212 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:33.971489 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.941619 22310 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.973361 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:33.868283 22447 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:19:33.940829 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.909878 22321 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:33.943975 22455 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:33.949169 22506 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:19:33.954717 22322 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.950344 22483 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.948557 22446 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:33.941340 22430 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:33.983608 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:33.984616 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1622) took 1022 ms. Trace:
I20260709 13:19:33.992839 19221 rpcz_store.cc:276] 0709 13:19:32.962688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.260017 (+297329us) service_pool.cc:224] Handling call
0709 13:19:33.260316 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.310294 (+ 49978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.310338 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.310802 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.506186 (+195384us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:33.506222 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.508353 (+  2131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.984415 (+476062us) raft_consensus.cc:1685] finished
0709 13:19:33.984434 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.984553 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100934,"raft.queue_time_us":54634,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"thread_start_us":96188,"threads_started":1,"wal-append.queue_time_us":315457}
I20260709 13:19:33.971977 22401 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.994769 22061 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:33.993795 19110 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:34.000547 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:33.992239 22414 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.002s
I20260709 13:19:33.989744 19216 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:33.980381 22476 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.003588 19110 leader_election.cc:400] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9.
I20260709 13:19:34.004253 19221 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:33.980173 22455 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:34.006174 19110 leader_election.cc:403] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:19:33.997920 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 260065us
I20260709 13:19:33.993983 22423 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:34.000363 22507 log.cc:927] Time spent T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 13:19:33.993517 22451 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.004041 22321 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:34.003233 22512 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:19:34.014731 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:34.004390 22509 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:19:33.977383 22325 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.004180 22430 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:34.021427 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:34.024390 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:34.009083 22446 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.012775 22455 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.035686 22243 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:34.037853 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1620) took 1076 ms. Trace:
I20260709 13:19:34.046154 19214 rpcz_store.cc:276] 0709 13:19:32.961304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.247577 (+286273us) service_pool.cc:224] Handling call
0709 13:19:33.247863 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.289008 (+ 41145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.289034 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.289453 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.412593 (+123140us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:33.412620 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.412664 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.037585 (+624921us) raft_consensus.cc:1685] finished
0709 13:19:34.037612 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.037781 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41120,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":46,"thread_start_us":122882,"threads_started":1,"wal-append.queue_time_us":314534}
W20260709 13:19:34.048794 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.996327 22483 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.050320 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.050948 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.019330 22061 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9.
I20260709 13:19:34.016395 22451 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:34.018810 22321 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.021076 22347 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.038319 22332 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.000s
I20260709 13:19:34.005707 22414 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.078977 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.031002 22449 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:34.085156 19214 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 5.
I20260709 13:19:34.093899 19067 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:34.053449 22243 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.113641 22243 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.130597 22483 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.053933 22447 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:34.137409 22447 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:34.072203 22428 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:34.138322 22447 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.143772 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.144918 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.145891 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:34.146509 19219 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:34.147127 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.149075 22400 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.149190 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.149788 19214 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:34.155333 22248 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.081043 22321 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.162070 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:34.080371 22451 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.163297 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:34.079713 22492 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.165341 22325 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.168568 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1731) took 1156 ms. Trace:
I20260709 13:19:34.168452 22347 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.169032 19066 rpcz_store.cc:276] 0709 13:19:33.012633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.466061 (+453428us) service_pool.cc:224] Handling call
0709 13:19:33.466363 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.466711 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.466744 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.467206 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.641621 (+174415us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:33.641729 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.641866 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.168365 (+526499us) raft_consensus.cc:1685] finished
0709 13:19:34.168387 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.168512 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2208,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":173902,"threads_started":1,"wal-append.queue_time_us":289228}
I20260709 13:19:34.170781 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.171824 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.172336 19066 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:34.084298 22332 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.173053 19064 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:34.173395 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.174674 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1952) took 1343 ms. Trace:
I20260709 13:19:34.199998 19110 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:34.199894 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:34.264750 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 64824.7us
I20260709 13:19:34.175107 19142 rpcz_store.cc:276] 0709 13:19:32.831135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.831242 (+   107us) service_pool.cc:224] Handling call
0709 13:19:32.831559 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.478460 (+646901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.174428 (+695968us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b540010d954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:34.174604 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341263744}
I20260709 13:19:34.265688 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.246690 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.215888 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.271246 19748 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:34.277995 19110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 2.135s (SENT) [suppressed 10 similar messages]
I20260709 13:19:34.170687 22347 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:34.288210 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 315312us
W20260709 13:19:34.290189 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.260421 22396 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.753s	user 0.010s	sys 0.000s
W20260709 13:19:34.216029 22460 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.718s	user 0.008s	sys 0.002s
W20260709 13:19:34.280050 22490 consensus_meta.cc:287] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.003s
W20260709 13:19:34.305233 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.317123 19184 leader_election.cc:400] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:34.317595 19184 leader_election.cc:403] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:19:34.318602 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.319634 19184 leader_election.cc:400] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:34.321080 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1794) took 1041 ms. Trace:
I20260709 13:19:34.277295 22439 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:34.278237 22049 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:34.299363 22332 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.299826 22325 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:34.277830 22414 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.249722 22480 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.321566 19217 rpcz_store.cc:276] 0709 13:19:33.279224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.716182 (+436958us) service_pool.cc:224] Handling call
0709 13:19:33.716453 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.716649 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:33.966686 (+250037us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.320620 (+353934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.320684 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:34.320743 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.320830 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.321008 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10440,"prepare.queue_time_us":173367,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":62,"raft.queue_time_us":13936,"thread_start_us":583408,"threads_started":2}
I20260709 13:19:34.396162 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 1943) took 3193 ms. Trace:
I20260709 13:19:34.387012 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 425) took 1004 ms. Trace:
W20260709 13:19:34.399317 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 324594us
W20260709 13:19:34.324600 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.403709 19145 rpcz_store.cc:276] 0709 13:19:31.203392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.203541 (+   149us) service_pool.cc:224] Handling call
0709 13:19:31.203908 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.852461 (+1648553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.395908 (+1543447us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540017a2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:34.396092 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3689779968}
I20260709 13:19:34.363509 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.405821 19748 rpcz_store.cc:276] 0709 13:19:33.382270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.379293 (+997023us) service_pool.cc:224] Handling call
0709 13:19:34.386358 (+  7065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.386586 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.386624 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.386685 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:34.386727 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.386796 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.386944 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:34.378053 22482 consensus_meta.cc:287] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.003s
I20260709 13:19:34.366333 22388 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:34.366451 22459 consensus_meta.cc:287] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.599s	user 0.004s	sys 0.010s
I20260709 13:19:34.419319 22414 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.434155 22459 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.434377 22414 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.436167 22459 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.437058 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:34.319114 22400 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:19:34.437505 22456 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.437641 19748 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:34.431810 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:34.433265 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69850.2us
W20260709 13:19:34.326884 21875 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.966s	user 0.013s	sys 0.004s
I20260709 13:19:34.445060 22483 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:34.445518 22243 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.440395 19747 raft_consensus.cc:2368] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:34.329116 22517 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:34.436167 22414 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.385185 22449 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:34.408146 22049 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.460589 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.325347 22476 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:19:34.451417 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1736) took 1414 ms. Trace:
I20260709 13:19:34.455297 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.455937 19145 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:34.456810 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:34.442761 22522 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:34.474241 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1931) took 1491 ms. Trace:
I20260709 13:19:34.475492 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.475562 19069 rpcz_store.cc:276] 0709 13:19:32.982836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.982958 (+   122us) service_pool.cc:224] Handling call
0709 13:19:32.983209 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.007726 (+ 24517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.474037 (+1466311us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b540017d9d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:34.474187 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55168384}
I20260709 13:19:34.439476 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:34.315208 22460 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.324592 22490 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.474304 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.476133 19146 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.476699 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.476815 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.483835 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.485153 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:34.453538 22426 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.453141 22523 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:34.441330 22248 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.478179 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.459656 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.524842 19141 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:34.524691 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.525453 19069 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:34.473430 19072 rpcz_store.cc:276] 0709 13:19:33.036519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.872195 (+835676us) service_pool.cc:224] Handling call
0709 13:19:33.872506 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.872694 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:34.200854 (+328160us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.450063 (+249209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.450113 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:34.450160 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.450218 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.451366 (+  1148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6250,"prepare.queue_time_us":469753,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3355,"raft.queue_time_us":70,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":9722,"thread_start_us":576498,"threads_started":2}
I20260709 13:19:34.405588 22325 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.465736 22049 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.460155 22243 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.522038 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.450606 22310 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:34.533219 19744 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:34.430728 22482 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.544209 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:34.543553 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1738) took 1477 ms. Trace:
I20260709 13:19:34.440215 22455 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.538560 19750 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:34.539492 19745 raft_consensus.cc:2368] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:34.455799 22531 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.445062 21875 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.542415 19219 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:34.558342 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.465102 22459 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:19:34.552764 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.562321 19221 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:34.522927 22431 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:34.553480 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:34.565511 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.533897 22426 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:34.554205 19212 raft_consensus.cc:2368] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:34.555570 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.557516 19146 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:34.558970 19072 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
W20260709 13:19:34.568658 22529 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:19:34.525933 22532 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:34.561504 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:34.566068 19071 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:34.529066 22523 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.569100 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.635632 19072 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:34.636780 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.531481 22447 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.575798 19064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1940) took 1590 ms (client timeout 1809 ms). Trace:
W20260709 13:19:34.638207 19064 rpcz_store.cc:269] 0709 13:19:32.984966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.041245 (+ 56279us) service_pool.cc:224] Handling call
0709 13:19:34.575597 (+1534352us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001211d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.575733 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562872064}
W20260709 13:19:34.584370 22056 consensus_meta.cc:287] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 13:19:34.586102 22325 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.586259 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:34.553202 22401 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.592172 22517 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:34.543766 22483 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.598176 22460 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:34.562431 22449 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.601192 21875 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.556716 22476 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.603957 22482 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.605748 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:34.607487 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1728) took 1595 ms. Trace:
I20260709 13:19:34.664853 19067 rpcz_store.cc:276] 0709 13:19:33.012112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.056131 (+ 44019us) service_pool.cc:224] Handling call
0709 13:19:34.607276 (+1551145us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54001b9254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.607413 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098834816}
I20260709 13:19:34.666247 19067 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:34.666770 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1753) took 1289 ms. Trace:
I20260709 13:19:34.667052 19067 rpcz_store.cc:276] 0709 13:19:33.377559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.665734 (+1288175us) service_pool.cc:224] Handling call
0709 13:19:34.666051 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.666560 (+   509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.666720 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:34.608781 19751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 456) took 1627 ms. Trace:
I20260709 13:19:34.668553 19751 rpcz_store.cc:276] 0709 13:19:32.981371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.981584 (+   213us) service_pool.cc:224] Handling call
0709 13:19:32.993913 (+ 12329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.437532 (+443619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.608485 (+1170953us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54004cdbd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:34.608713 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815162240}
I20260709 13:19:34.669704 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:34.670735 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:34.671376 19751 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:34.672060 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:34.609840 22426 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:34.611022 22430 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:19:34.683239 22430 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.684198 22330 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:34.613123 22455 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.684692 22330 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:34.687208 19143 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:34.653844 22517 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:34.613773 22534 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:34.689034 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1734) took 1672 ms. Trace:
I20260709 13:19:34.688858 22517 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.690045 22517 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.689435 19065 rpcz_store.cc:276] 0709 13:19:33.016329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.788717 (+772388us) service_pool.cc:224] Handling call
0709 13:19:33.794959 (+  6242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.795377 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.795419 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.795948 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.304307 (+508359us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:34.304383 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.304517 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.688804 (+384287us) raft_consensus.cc:1685] finished
0709 13:19:34.688825 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.688977 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7486,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3781,"thread_start_us":394682,"threads_started":1,"wal-append.queue_time_us":498075}
I20260709 13:19:34.690986 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 306) took 1459 ms. Trace:
I20260709 13:19:34.691484 19065 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:34.692081 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1761) took 1221 ms. Trace:
I20260709 13:19:34.692369 19065 rpcz_store.cc:276] 0709 13:19:33.470952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.690878 (+1219926us) service_pool.cc:224] Handling call
0709 13:19:34.691189 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.691861 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.692034 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:34.563650 22531 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.691483 19138 rpcz_store.cc:276] 0709 13:19:33.231575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.231711 (+   136us) service_pool.cc:224] Handling call
0709 13:19:34.690742 (+1459031us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400221d54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.690916 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787115264}
I20260709 13:19:34.694180 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.694787 19138 raft_consensus.cc:2368] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:34.614497 19743 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:34.695492 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.653599 22401 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.696523 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.631467 19219 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.643854 22537 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:34.632804 19145 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:34.708619 19145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:34.709267 19145 raft_consensus.cc:606] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:34.644543 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.649325 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:34.650885 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1750) took 1366 ms. Trace:
I20260709 13:19:34.711220 19064 rpcz_store.cc:276] 0709 13:19:33.284591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.649924 (+1365333us) service_pool.cc:224] Handling call
0709 13:19:34.650275 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.650494 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.650531 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.650585 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:34.650628 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.650698 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.650819 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:34.652480 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1749) took 1496 ms. Trace:
I20260709 13:19:34.647908 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1799) took 1365 ms. Trace:
W20260709 13:19:34.656665 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 70468.7us
I20260709 13:19:34.716747 19072 rpcz_store.cc:276] 0709 13:19:33.156232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.651522 (+1495290us) service_pool.cc:224] Handling call
0709 13:19:34.651877 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.652084 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.652120 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.652173 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:34.652221 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.652288 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.652402 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:34.707747 19138 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:34.719261 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:34.659305 19213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.024s	sys 0.012s
I20260709 13:19:34.617383 22431 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.630771 22490 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:34.630996 22061 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:34.745437 22061 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.746387 19221 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:34.746747 19221 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:34.747449 22061 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.747519 19221 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.748539 19221 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.663631 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.749486 19146 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:34.750516 19146 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:34.750849 22489 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.675357 19067 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:34.752794 19069 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.643935 22523 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.753357 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 1949) took 1203 ms. Trace:
I20260709 13:19:34.753698 19069 rpcz_store.cc:276] 0709 13:19:33.549793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.752420 (+1202627us) service_pool.cc:224] Handling call
0709 13:19:34.752648 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.753176 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.753304 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:34.755545 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 520) took 1337 ms. Trace:
I20260709 13:19:34.756062 19747 rpcz_store.cc:276] 0709 13:19:33.417765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.480912 (+ 63147us) service_pool.cc:224] Handling call
0709 13:19:34.755299 (+1274387us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b5400596354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.755470 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203583872}
I20260709 13:19:34.633237 22423 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:34.757131 22423 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.757643 22430 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.653903 22056 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.759105 22423 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.759647 22056 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.644161 22532 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.687788 22320 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:34.761962 22532 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:34.762779 19068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1751) took 1390 ms (client timeout 1750 ms). Trace:
W20260709 13:19:34.763358 19068 rpcz_store.cc:269] 0709 13:19:33.372186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.411262 (+ 39076us) service_pool.cc:224] Handling call
0709 13:19:34.762570 (+1351308us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540025e254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.762702 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380267776}
I20260709 13:19:34.696775 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 460) took 1150 ms. Trace:
W20260709 13:19:34.764752 22321 consensus_meta.cc:287] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 13:19:34.764647 19743 rpcz_store.cc:276] 0709 13:19:33.546165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.906428 (+360263us) service_pool.cc:224] Handling call
0709 13:19:34.696518 (+790090us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54000c0dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.696702 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516479360}
I20260709 13:19:34.681619 22476 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.768138 22476 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.654011 22447 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.697363 22401 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:34.552278 22347 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:34.770248 22447 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.770318 22347 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:34.722393 22537 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.771174 22347 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.771720 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.772393 19146 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.770440 22523 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.621237 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.698938 19216 raft_consensus.cc:2410] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:34.699548 19144 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 5.
I20260709 13:19:34.699091 19749 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:34.707201 19742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 509) took 1708 ms (client timeout 2074 ms). Trace:
W20260709 13:19:34.778198 19742 rpcz_store.cc:269] 0709 13:19:32.990042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.992919 (+  2877us) service_pool.cc:224] Handling call
0709 13:19:34.698481 (+1705562us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54005fcdd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.698613 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302761216}
I20260709 13:19:34.782433 22493 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.783320 22332 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.784037 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:34.784962 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 163795us
I20260709 13:19:34.787336 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.687630 21875 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.788795 22332 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:34.631788 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.712718 19215 rpcz_store.cc:276] 0709 13:19:33.282566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.726146 (+443580us) service_pool.cc:224] Handling call
0709 13:19:33.726419 (+   273us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:33.727642 (+  1223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:33.727669 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:33.728210 (+   541us) log.cc:844] Serialized 52 byte log entry
0709 13:19:34.054556 (+326346us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:34.054613 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.054678 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.647641 (+592963us) raft_consensus.cc:1685] finished
0709 13:19:34.647671 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.647839 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1907,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":58,"thread_start_us":304392,"threads_started":1,"wal-append.queue_time_us":577408}
I20260709 13:19:34.726920 22531 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:34.790809 19142 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:34.791998 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.793646 22332 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:34.794395 19744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 452) took 1814 ms (client timeout 1922 ms). Trace:
W20260709 13:19:34.794842 19744 rpcz_store.cc:269] 0709 13:19:32.979915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.980014 (+    99us) service_pool.cc:224] Handling call
0709 13:19:34.794250 (+1814236us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400572454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.794343 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3066854144}
I20260709 13:19:34.796430 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 417) took 1434 ms. Trace:
I20260709 13:19:34.796783 19750 rpcz_store.cc:276] 0709 13:19:33.361996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.362109 (+   113us) service_pool.cc:224] Handling call
0709 13:19:34.796247 (+1434138us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000e6ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.796374 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617896192}
I20260709 13:19:34.797988 19221 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
W20260709 13:19:34.798053 19745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 423) took 1416 ms (client timeout 1767 ms). Trace:
I20260709 13:19:34.798450 19221 pending_rounds.cc:85] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:19:34.798763 19221 pending_rounds.cc:107] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.8
W20260709 13:19:34.798506 19745 rpcz_store.cc:269] 0709 13:19:33.381671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.386479 (+  4808us) service_pool.cc:224] Handling call
0709 13:19:34.797889 (+1411410us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54005e9554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:34.797999 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603623680}
I20260709 13:19:34.792651 19142 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:34.799503 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 172291us
I20260709 13:19:34.685879 22330 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.728057 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:34.826068 19220 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.826094 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:34.826745 19215 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.827569 19146 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:34.827929 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.828439 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.828332 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.732017 22049 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:19:34.741384 22474 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.856s	user 0.014s	sys 0.000s
I20260709 13:19:34.765296 22321 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.785109 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.838253 19139 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.799717 19748 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:34.720441 19213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.024s	sys 0.012s
I20260709 13:19:34.803790 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:34.841532 19747 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:34.803854 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:34.799125 19221 raft_consensus.cc:2889] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:34.753383 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1760) took 1282 ms. Trace:
I20260709 13:19:34.842515 19067 rpcz_store.cc:276] 0709 13:19:33.470692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.667683 (+1196991us) service_pool.cc:224] Handling call
0709 13:19:34.667924 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.753143 (+ 85219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.753304 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:34.843729 19067 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:34.844913 19067 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:34.715523 19035 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:34.845575 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 130137us
I20260709 13:19:34.846201 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:34.813328 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:34.817204 19219 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:34.821403 19751 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:34.727471 22480 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:34.822011 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.698804 22432 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.000s
I20260709 13:19:34.829388 19146 raft_consensus.cc:2410] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:34.830265 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:34.830359 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:34.831482 22532 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.834372 19110 leader_election.cc:400] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:34.835848 19745 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:34.864317 19110 leader_election.cc:403] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:34.853811 22404 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:34.855214 22330 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.859946 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:34.865474 19219 raft_consensus.cc:2410] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:34.865741 19067 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:34.866389 19063 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:34.863643 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:34.869035 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:34.867100 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:34.871958 19065 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.872598 19140 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:34.873754 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1807) took 1370 ms. Trace:
W20260709 13:19:34.850697 22451 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.003s
I20260709 13:19:34.875141 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:34.876196 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46035.7us
I20260709 13:19:34.883703 19139 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:34.886006 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:34.886528 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:34.890374 19146 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:34.892915 19142 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:34.894511 19746 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
W20260709 13:19:34.897264 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.857959 22414 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.851151 22493 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:34.900206 19714 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:34.901783 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:34.827172 22537 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:34.905910 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.857395 21875 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.906917 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.907552 19142 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:19:34.911630 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.871384 22456 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:34.871243 22533 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.873039 22430 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.871340 22457 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:34.918030 19215 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:34.911972 19220 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:34.885114 22056 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10.
I20260709 13:19:34.876847 22532 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:34.903836 21822 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.901266 22404 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.920794 22456 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.904896 22486 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:34.903568 22414 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.863348 22432 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:34.933434 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.917642 22474 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:34.897101 22480 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.937590 22430 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:34.940006 22400 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:34.899827 22451 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.938234 22454 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:34.944764 22456 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:34.950884 22492 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.000s
I20260709 13:19:34.946485 22414 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.952652 22400 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:34.973418 22049 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.974148 22492 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:34.974812 19744 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.974525 22400 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.975544 22400 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.981040 22532 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:34.981941 19744 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:34.984349 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:34.985793 19141 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:34.986785 22536 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.427s	user 0.002s	sys 0.000s
I20260709 13:19:34.986819 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:34.988037 19141 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:34.990078 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 99355.1us
W20260709 13:19:34.991091 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.952312 22486 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:34.957954 22547 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.991876 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:35.000909 22430 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:34.960562 22474 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:35.004134 22431 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.003731 22474 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.005625 22432 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:34.958315 22480 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:35.006723 22480 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.008374 22404 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:35.009737 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.011498 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:35.033218 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:35.041893 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 140154us
W20260709 13:19:35.037940 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 135178us
I20260709 13:19:35.042889 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:35.045634 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:35.048348 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:35.052613 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.053201 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:35.044761 22546 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.481s	user 0.001s	sys 0.000s
I20260709 13:19:35.042975 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.051828 22404 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:35.052377 22431 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.031438 22426 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.058584 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:35.056169 19035 leader_election.cc:400] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:35.045720 22531 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.052158 22476 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:35.066248 19035 leader_election.cc:403] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.052187 22310 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:35.056018 22243 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.067566 19038 leader_election.cc:400] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:35.046152 22403 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:35.062966 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.072999 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.050513 22401 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:19:35.075722 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.076223 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.059592 22141 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:35.067108 22554 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:35.077557 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:35.087340 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:35.031002 22547 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.063843 22428 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.068964 22310 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:35.093668 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.094157 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:35.068665 22476 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.066104 22404 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:35.070873 22537 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:35.133158 22537 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.133293 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.133587 22537 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.133445 22490 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:35.135367 22490 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.135711 19742 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:35.060536 22486 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.138345 22347 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.100437 22431 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.073503 22551 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.140393 22347 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.100769 22558 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.141222 22558 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.141590 22451 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.143249 22558 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:35.094498 22545 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:35.143941 22545 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.092625 22310 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.144304 22545 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.874409 19218 rpcz_store.cc:276] 0709 13:19:33.503463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.870120 (+366657us) service_pool.cc:224] Handling call
0709 13:19:33.870437 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.870650 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:34.611896 (+741246us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b18003f9700. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6106f823c7 00007f61035949a7 00007f61035a40bf
0709 13:19:34.612094 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.873344 (+261250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.873412 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:34.873472 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.873554 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.873690 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119931,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2225,"raft.queue_time_us":8633,"spinlock_wait_cycles":11215616,"thread_start_us":388217,"threads_started":2}
I20260709 13:19:35.149653 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.150748 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.100111 22426 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:35.107961 22547 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:35.108700 22464 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.106252 22414 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.176965 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:35.177690 19745 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
W20260709 13:19:35.185398 19746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 459) took 1642 ms (client timeout 1955 ms). Trace:
W20260709 13:19:35.185922 19746 rpcz_store.cc:269] 0709 13:19:33.542749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.882949 (+340200us) service_pool.cc:224] Handling call
0709 13:19:35.185203 (+1302254us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b540049f054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:35.185324 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186556160}
I20260709 13:19:35.111024 19067 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:35.112581 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.113022 22531 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:35.115115 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 421) took 1740 ms. Trace:
I20260709 13:19:35.193008 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:34.544862 19066 rpcz_store.cc:276] 0709 13:19:33.066604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.174975 (+1108371us) service_pool.cc:224] Handling call
0709 13:19:34.175240 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.199865 (+ 24625us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:34.381247 (+181382us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.541584 (+160337us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.541772 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.541816 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:34.541862 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.543338 (+  1476us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.543483 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16732,"prepare.queue_time_us":169847,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":54,"raft.queue_time_us":1255,"spinlock_wait_cycles":22323584,"thread_start_us":294970,"threads_started":2}
I20260709 13:19:35.115383 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.195732 19064 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:35.196089 19065 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.196137 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.118630 22322 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:35.119658 22467 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:35.122895 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:35.124015 22428 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:35.061228 22454 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:35.127473 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:35.128568 22449 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:35.130229 22493 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:35.131064 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.098870 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.155087 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.157349 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.078411 22474 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.161432 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.084466 22459 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.168264 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:35.213878 19146 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:35.170843 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:35.215232 19068 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:19:35.176381 19063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1762) took 1640 ms (client timeout 2161 ms). Trace:
I20260709 13:19:35.176407 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:35.215751 19063 rpcz_store.cc:269] 0709 13:19:33.535817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.723744 (+187927us) service_pool.cc:224] Handling call
0709 13:19:35.176236 (+1452492us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002cc754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:35.176329 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2625693056}
I20260709 13:19:35.217017 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.218302 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.220064 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.220654 19219 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.222038 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.222651 19063 raft_consensus.cc:2368] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
W20260709 13:19:35.224969 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 63644.7us
I20260709 13:19:35.225746 19218 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:35.190505 19067 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:35.225965 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.227263 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.190407 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.099560 22476 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.229962 19071 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:35.230993 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.232393 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.201244 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.233078 19067 raft_consensus.cc:2376] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11. Re-sending same reply.
I20260709 13:19:35.233489 19070 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:35.234088 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.234503 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.234992 19067 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:35.084299 22492 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:19:35.243197 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 144389us
I20260709 13:19:35.207351 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.244834 19064 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:35.160671 22426 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.171692 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1802) took 1850 ms. Trace:
I20260709 13:19:35.195180 19749 rpcz_store.cc:276] 0709 13:19:33.375045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.006184 (+631139us) service_pool.cc:224] Handling call
0709 13:19:34.698855 (+692671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.777858 (+ 79003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.114932 (+337074us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54000c0dd0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:35.115056 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570945920}
I20260709 13:19:35.227553 22477 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:35.194927 22531 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:35.259363 19219 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:35.260267 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.260917 19219 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:35.261847 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.203536 22467 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.263278 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.263990 19219 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:35.264922 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.265470 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.175572 22447 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:19:35.224030 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.269855 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:35.250753 19070 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:35.203385 22322 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.257009 22426 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.251435 19213 rpcz_store.cc:276] 0709 13:19:33.321693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.749091 (+427398us) service_pool.cc:224] Handling call
0709 13:19:33.749459 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.775488 (+ 26029us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:34.075509 (+300021us) log.cc:844] Serialized 14 byte log entry
0709 13:19:34.840694 (+765185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.840763 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:34.840824 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.171429 (+330605us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b54001d4a54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:35.171483 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.171628 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19461,"prepare.queue_time_us":180494,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3347,"raft.queue_time_us":9369,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":11715,"spinlock_wait_cycles":59374336,"thread_start_us":971243,"threads_started":2,"wal-append.queue_time_us":583957}
I20260709 13:19:35.251127 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.276867 19214 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:35.257272 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.254626 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:35.251808 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 75608.3us
I20260709 13:19:35.258324 19065 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:35.266201 19216 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:35.188751 22432 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:19:35.255285 22141 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.229063 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.264163 22531 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.237051 22490 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.270072 19217 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:35.194106 22415 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.189251 22464 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:35.292621 22559 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:35.272068 22404 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.266498 21696 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:35.304641 21696 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:35.305011 21696 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.305823 21696 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.307158 21696 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.274044 22320 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:35.228048 22489 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:35.276168 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.243554 22403 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.264546 22401 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.278817 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.339715 19065 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:35.260951 22428 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:35.341251 22428 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.341991 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.342567 19068 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.343807 22428 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:35.280401 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 51446.1us
I20260709 13:19:35.237269 22493 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.346031 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.346599 19072 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.348088 22493 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.252982 22243 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:19:35.269119 22456 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.350761 22456 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:35.272167 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.352141 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:35.353999 19071 raft_consensus.cc:2368] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:35.354624 22423 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:35.355100 22423 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:35.355535 22423 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.358150 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 522) took 1315 ms. Trace:
I20260709 13:19:35.359018 22444 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:35.359433 22444 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:35.359704 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.360270 19213 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:35.360158 22444 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.280514 22049 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:35.263970 22454 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:35.285929 22480 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.338280 22403 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:35.276170 22566 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:19:35.395373 22476 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.396595 19221 raft_consensus.cc:2368] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:35.396713 22403 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.397279 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:35.398223 22476 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.398309 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3bb7a633516455782a998ee89832b55"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:19:35.398731 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.398911 19071 raft_consensus.cc:606] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.399334 19071 raft_consensus.cc:614] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:35.399494 19216 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:35.400486 19071 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:35.400579 19216 pending_rounds.cc:85] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:19:35.358613 19748 rpcz_store.cc:276] 0709 13:19:34.042789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.442299 (+399510us) service_pool.cc:224] Handling call
0709 13:19:34.799558 (+357259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.858129 (+ 58571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.357912 (+499783us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54000e6ad0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:35.358080 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820859264}
I20260709 13:19:35.287053 22451 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:19:35.291060 22558 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:35.322057 22320 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.361275 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.425861 19070 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:35.426318 19218 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.340740 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.364759 22414 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.361168 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.429005 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.382349 19068 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:35.430176 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.380791 19072 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:35.383580 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 127071us
I20260709 13:19:35.431186 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.389827 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:35.392731 22310 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.394022 22464 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:35.394618 22545 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.317484 22415 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.334681 22467 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.408799 22444 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.386417 22493 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.412110 22551 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:35.413012 22049 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.456934 22049 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.432524 22426 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.414400 22330 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:35.458407 22330 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.459296 22426 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.460281 22330 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.412671 19212 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:35.461040 19212 pending_rounds.cc:85] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 5
I20260709 13:19:35.461297 19212 pending_rounds.cc:107] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:35.461557 19212 raft_consensus.cc:2889] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.423062 19216 pending_rounds.cc:107] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:35.464896 19216 raft_consensus.cc:2889] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.466178 19213 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:35.427940 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:35.433643 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 43889us
I20260709 13:19:35.433954 19069 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:35.437008 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.469517 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.441511 19220 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:35.441681 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:35.445008 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:35.445070 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:35.473284 19140 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:35.445179 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:35.446161 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:35.474308 19141 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.471815 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.447293 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:35.476692 19219 raft_consensus.cc:2368] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:35.477314 19218 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:35.435393 22388 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:35.454824 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:35.479570 19751 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:35.455201 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:35.427284 19065 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:35.479925 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:35.472720 19143 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.481437 19110 leader_election.cc:400] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:35.440104 22449 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.486711 19147 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:35.482016 19066 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:35.494455 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.453256 22544 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:35.500342 19141 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 6.
I20260709 13:19:35.503901 19110 leader_election.cc:403] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.483487 19035 leader_election.cc:400] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:35.504534 19035 leader_election.cc:403] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.504376 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:35.449395 22476 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:35.516999 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.475400 22447 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.493923 22551 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.483044 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:35.483747 22325 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:35.519760 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:35.479305 22388 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:35.491638 22330 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.484405 22455 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.521600 22476 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.516387 22558 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:35.534400 22537 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.435271 22320 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.537926 22415 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.538185 22432 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:35.575220 22432 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.576337 22432 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.549494 19143 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:35.503274 22544 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:35.579938 22544 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.519364 22517 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.514768 22426 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:35.581314 22426 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:35.465531 22493 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:35.564414 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 44763.6us
I20260709 13:19:35.519755 22532 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:35.563596 22388 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.572047 22545 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.574615 22320 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.582760 19065 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:35.584784 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.590123 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.591246 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.530215 22451 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:19:35.592723 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.567011 21822 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.567677 22476 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:35.597278 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.566107 19743 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:35.568269 22325 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.602303 19212 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:35.586612 22404 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.586853 22574 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.605394 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.586248 22322 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.599220 22430 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:35.598100 22455 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.596307 22517 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.570441 22330 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:35.611948 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 95083.4us
I20260709 13:19:35.587990 22524 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:35.596508 22532 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.600607 22447 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.623989 19110 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:35.632421 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:35.632905 19215 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:35.582221 22426 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.592088 22141 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:19:35.605222 22310 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.623713 22430 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:35.625787 22524 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:35.644789 19220 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:35.608465 22531 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:35.636603 22455 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:19:35.680272 22531 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:35.681017 19212 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.682408 22444 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.684544 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.684742 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:35.685146 19214 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.686103 22489 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.686226 22330 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.613821 22423 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.688753 22423 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.689602 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.690829 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.648237 22061 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:35.665282 22523 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.665755 22537 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:35.667848 22310 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:35.672060 22388 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.668534 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:35.609445 22404 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:35.691596 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.691824 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:35.614172 22574 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:35.694186 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 106494us
I20260709 13:19:35.643688 22447 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:35.626838 22517 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.693220 19743 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:35.697367 19212 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:35.682911 22444 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.648541 22430 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.694938 22330 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:35.720147 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 100631us
I20260709 13:19:35.702193 22061 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.722114 19038 leader_election.cc:400] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:35.723944 19038 leader_election.cc:403] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.726243 19214 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:35.727581 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:35.767093 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 45176.9us
W20260709 13:19:35.768190 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 180382us
I20260709 13:19:35.778918 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.691736 22325 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.772799 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:35.784277 19214 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:35.698450 22310 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.793335 19145 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:35.803824 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:35.783969 22533 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:19:35.811625 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 96521.5us
I20260709 13:19:35.812381 19221 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:35.816895 22444 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.722023 22330 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.802208 22464 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:35.824398 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.797075 22523 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.811075 22322 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.793881 22447 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:35.801589 22426 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.863889 22426 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:35.856976 22588 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:19:35.866443 22426 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:35.829911 22593 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:35.867612 22388 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.831346 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:35.875344 19065 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:35.834947 19221 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:35.808672 22415 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.795907 22477 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:19:35.808495 22493 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.843307 19035 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.846827 19147 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:35.857033 22597 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.860210 22310 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.808614 22049 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:35.857977 19068 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:35.884589 19068 pending_rounds.cc:85] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 4
I20260709 13:19:35.885118 19068 pending_rounds.cc:107] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:35.885519 19068 raft_consensus.cc:2889] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.719674 22524 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.886260 22275 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:35.887634 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:35.857491 22404 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.876900 22517 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.859606 22464 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:35.898211 22275 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:35.883184 22415 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.894507 22592 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.857961 22061 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.885003 22600 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:35.859318 22447 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:35.917819 22574 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.912483 22544 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.928074 22455 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.916179 22275 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.928735 22464 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:35.940452 22594 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:19:35.942706 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.939616 22455 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:35.954458 22415 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.956215 22455 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.965348 22330 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:35.974433 22321 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:35.995770 22558 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:35.996245 22558 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:35.997072 22558 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:36.004932 22558 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.037247 22544 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.041923 19110 leader_election.cc:400] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
I20260709 13:19:36.042779 19110 leader_election.cc:403] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.053864 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.054627 19070 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:36.042413 22455 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:19:36.056612 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:36.056859 22476 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:36.057410 19743 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.059036 22476 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:35.580648 22449 consensus_queue.cc:1175] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: [7.5-7.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:36.062793 22533 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:36.067112 19070 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:36.081579 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:36.053408 19072 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:36.083003 19068 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:36.164084 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.182284 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.094198 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.091706 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.207808 19743 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
W20260709 13:19:36.208361 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.086421 19147 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:36.107502 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.212489 19221 raft_consensus.cc:2410] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:19:36.204150 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 159403us
I20260709 13:19:36.042012 22551 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:36.223596 19221 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:36.045301 22332 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8.
W20260709 13:19:36.211540 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.149293 22404 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.119256 22455 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:19:36.229449 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1818) took 1010 ms. Trace:
I20260709 13:19:36.231051 19065 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:36.230875 22489 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:36.233210 19221 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:36.221891 22330 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.222090 22586 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.005s
I20260709 13:19:36.117115 22320 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:36.261909 22320 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.262259 22320 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.264248 22388 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:36.247238 19219 rpcz_store.cc:276] 0709 13:19:35.219287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.264680 (+ 45393us) service_pool.cc:224] Handling call
0709 13:19:36.229197 (+964517us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540036d154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:36.229364 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485492096}
I20260709 13:19:36.250020 19141 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:36.266149 22599 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.428s	user 0.003s	sys 0.000s
I20260709 13:19:36.257484 22330 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.258350 22061 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:36.264627 22388 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:36.042119 22430 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.222055 22480 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:19:36.284113 19063 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:36.281411 22492 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:36.291059 22455 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:36.285655 22489 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:36.281000 22404 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.302865 22477 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:19:36.316509 22404 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:36.337018 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.287575 22061 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.309935 22455 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:36.353708 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.345626 22332 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:36.348048 22532 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.348165 22600 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:36.345844 22388 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:36.357333 22332 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:36.359598 22532 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.354414 22320 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.367281 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:36.368007 19219 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 6: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:36.371694 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:36.373117 19221 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:36.373585 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.374179 19219 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:36.383699 19219 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:36.378851 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:36.388928 19113 leader_election.cc:400] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 5 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 5. Current term is 6.
I20260709 13:19:36.389109 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.390627 19219 raft_consensus.cc:2410] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:36.391763 19219 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:36.372633 22550 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:19:36.360859 22455 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.392606 19219 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:36.488549 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:36.429154 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.474197 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1650) took 1319 ms (client timeout 1535 ms). Trace:
W20260709 13:19:36.490305 19215 rpcz_store.cc:269] 0709 13:19:35.154431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.154832 (+   401us) service_pool.cc:224] Handling call
0709 13:19:36.473955 (+1319123us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400268ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:36.474126 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980989184}
I20260709 13:19:36.476421 19218 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:36.403415 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:36.394018 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.493920 19140 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:36.493793 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.494925 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.495446 19142 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.495720 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:36.496642 19744 raft_consensus.cc:2368] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:36.503645 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:36.506359 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.506773 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:36.442425 22618 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:19:36.430446 22614 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:36.543076 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.539556 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:36.540773 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.403595 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:36.553625 19748 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:36.554024 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 150549us
I20260709 13:19:36.494222 19221 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:36.392330 22325 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:36.546068 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.546255 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.419049 22330 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:36.549458 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 45941.8us
I20260709 13:19:36.563315 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1634) took 1119 ms. Trace:
I20260709 13:19:36.466511 22061 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.504922 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1825) took 1249 ms. Trace:
I20260709 13:19:36.554488 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.567747 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:36.568552 22404 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.360342 22600 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:36.548456 19142 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:36.461195 22620 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:36.571563 22620 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:36.571955 22325 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:36.572997 22325 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.575222 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.575997 19221 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:36.577265 22621 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:19:36.577615 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:36.540337 22444 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:36.561426 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 158083us
I20260709 13:19:36.431021 22430 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.563680 19146 rpcz_store.cc:276] 0709 13:19:35.443486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.445606 (+  2120us) service_pool.cc:224] Handling call
0709 13:19:35.445818 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.501911 (+ 56093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.501949 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.502000 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:35.502046 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.563098 (+1061052us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54000307d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:36.563141 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.563264 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128489216}
I20260709 13:19:36.558686 22550 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:36.545939 22455 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.570947 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.566267 22605 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:36.580044 22330 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:36.544992 19744 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:36.589746 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.606987 19213 rpcz_store.cc:276] 0709 13:19:35.255108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.360936 (+105828us) service_pool.cc:224] Handling call
0709 13:19:36.504728 (+1143792us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b5400074ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:36.504845 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85183232}
I20260709 13:19:36.592773 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.609778 19146 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:36.570958 22600 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:36.595106 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:36.560457 19140 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 6: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:19:36.588469 22625 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:19:36.588423 22444 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:36.590399 22620 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.558990 22310 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:36.587172 19138 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
W20260709 13:19:36.608465 22582 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 1.105s	user 0.003s	sys 0.002s
I20260709 13:19:36.593806 22061 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.617201 19748 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:36.618144 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.622160 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.592128 22551 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:36.595816 22550 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:36.612273 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 44578.1us
I20260709 13:19:36.621095 22310 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:36.629315 19066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 1966) took 1439 ms (client timeout 1809 ms). Trace:
W20260709 13:19:36.646912 19066 rpcz_store.cc:269] 0709 13:19:35.190324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.221831 (+ 31507us) service_pool.cc:224] Handling call
0709 13:19:36.629166 (+1407335us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54001211d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:36.629259 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596407552}
W20260709 13:19:36.630617 22591 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.840s	user 0.003s	sys 0.000s
I20260709 13:19:36.639410 22444 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.644534 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.648272 22532 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.646607 22550 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.650606 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.652091 19146 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:36.653250 19146 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:36.601496 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.621981 22628 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:36.647795 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.656931 19140 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.602661 22430 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:36.655082 19142 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:36.645411 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.648170 22310 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.675813 19213 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:36.682207 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.685926 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 91912.2us
I20260709 13:19:36.646365 22061 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.663334 22628 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.669531 22330 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:36.706831 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1823) took 1467 ms. Trace:
I20260709 13:19:36.707278 19216 rpcz_store.cc:276] 0709 13:19:35.238965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.400109 (+161144us) service_pool.cc:224] Handling call
0709 13:19:35.400401 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:35.465445 (+ 65044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:35.465475 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:35.465849 (+   374us) log.cc:844] Serialized 26 byte log entry
0709 13:19:35.633487 (+167638us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:35.633525 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.633613 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.630104 (+996491us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:36.704645 (+ 74541us) raft_consensus.cc:1685] finished
0709 13:19:36.704665 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.706756 (+  2091us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6951680,"thread_start_us":118739,"threads_started":1,"wal-append.queue_time_us":213336}
I20260709 13:19:36.691959 22477 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:36.711877 19138 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:19:36.711937 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.710014 22643 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:36.716789 22602 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:19:36.715921 22477 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:36.742731 22477 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:36.748548 19144 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:36.750003 22628 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:36.713889 22430 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:36.754540 22551 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:36.755077 22551 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.757395 22551 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.757890 22467 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.758533 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.761649 22524 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.761976 22061 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.765524 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1632) took 1322 ms. Trace:
I20260709 13:19:36.765909 19145 rpcz_store.cc:276] 0709 13:19:35.442863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.443008 (+   145us) service_pool.cc:224] Handling call
0709 13:19:35.443354 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.793743 (+350389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.765287 (+971544us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540017b1d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:36.765466 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804438784}
I20260709 13:19:36.771988 22310 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.744755 22550 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:36.773265 22630 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:36.775951 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.776257 19066 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:36.777169 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.777740 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.779295 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1831) took 1186 ms. Trace:
I20260709 13:19:36.779757 19218 rpcz_store.cc:276] 0709 13:19:35.593220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.595461 (+  2241us) service_pool.cc:224] Handling call
0709 13:19:36.474405 (+878944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.491474 (+ 17069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.779089 (+287615us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400268ed0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:36.779233 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020733824}
I20260709 13:19:36.781385 19071 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:36.782378 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:36.782891 19216 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:36.785179 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.785849 19067 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:36.776260 19212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1661) took 1181 ms (client timeout 1503 ms). Trace:
I20260709 13:19:36.787101 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.787348 22464 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.786870 19212 rpcz_store.cc:269] 0709 13:19:35.595277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.605165 (+  9888us) service_pool.cc:224] Handling call
0709 13:19:36.776118 (+1170953us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b540035c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:36.776208 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172523776}
I20260709 13:19:36.787822 19070 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 7: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:36.787941 22464 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.777938 19069 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:36.788736 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.788764 22332 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:36.790084 22464 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.801124 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.814462 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.787422 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.831089 19065 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:36.831230 19071 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:36.794131 22320 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.821806 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.800726 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.832721 19069 raft_consensus.cc:2368] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:36.807041 19212 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:36.818156 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:36.838177 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.839627 19748 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:36.840335 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.814291 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.841810 19220 raft_consensus.cc:2410] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:36.792927 19140 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:36.842932 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.843494 19070 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:36.840917 19069 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:19:36.844453 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 200466us
I20260709 13:19:36.804080 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:36.830094 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.845595 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49874.9us
I20260709 13:19:36.828583 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.815629 18970 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 2 to 5, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 5 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.796257 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.847843 19071 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:36.848301 19071 pending_rounds.cc:85] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 5
I20260709 13:19:36.848327 19068 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 6.
I20260709 13:19:36.848789 19071 pending_rounds.cc:107] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:36.808527 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:36.801389 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.859082 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.815606 19218 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:36.866817 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.866066 19219 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:36.867772 19144 raft_consensus.cc:2410] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:36.866408 19067 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:36.867954 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.869626 19138 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:36.874607 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.883708 19139 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:36.883807 19216 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:36.885507 19219 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:36.874642 19063 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:36.865427 19071 raft_consensus.cc:2889] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.849305 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.888646 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:36.892781 19217 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:36.893503 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:36.893823 19184 leader_election.cc:400] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:36.813207 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:36.891328 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.894182 19184 leader_election.cc:403] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:19:36.896404 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 83284.8us
I20260709 13:19:36.891336 19213 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:36.895761 19067 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:36.812500 22551 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:19:36.903860 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:36.908185 19138 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:36.902519 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:36.908155 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.909255 19071 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:36.911913 19138 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:36.908967 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.911681 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.912550 19139 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:36.910269 22600 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.913244 22600 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:36.914429 22310 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:36.915261 22600 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.916517 22454 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:36.901837 22415 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:36.917558 22415 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.917981 22415 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.884917 22550 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:36.934497 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.896332 22517 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.940783 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:36.950363 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:36.950902 19213 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.942305 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.950985 19071 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.952437 19139 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:36.942363 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:36.920099 22320 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:36.943619 22645 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:36.901654 22464 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:19:36.905257 22347 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:36.910379 22533 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:19:36.910686 22275 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:36.956765 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:36.959210 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:36.963249 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:36.965623 19145 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:36.970715 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:36.971853 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:36.970286 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.975723 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:36.975951 19067 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:36.976300 19216 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:36.977389 19216 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:36.978308 19216 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:36.982017 19071 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:36.983403 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 89702.7us
I20260709 13:19:36.985771 19071 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:36.954779 22320 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.911422 22447 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:19:36.989234 19213 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:36.998699 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.965261 22275 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.022306 19071 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
W20260709 13:19:36.990523 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48242.9us
I20260709 13:19:36.986286 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:36.982503 22464 consensus_queue.cc:1243] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:36.974151 22597 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.982806 22321 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:19:36.982641 22347 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:37.059737 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.967926 22634 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:19:37.060495 22347 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.061972 22415 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.020802 22320 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.064695 22275 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.102193 22444 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.065261 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.103097 19221 raft_consensus.cc:2410] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:19:37.106209 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.069816 18970 catalog_manager.cc:5697] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:37.113246 19067 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:37.022169 22404 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.021484 22061 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:37.021870 22449 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:37.020617 22332 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:37.020454 22620 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:37.019608 22645 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:19:37.097592 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 49213.9us
I20260709 13:19:36.977972 22310 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:36.988054 22457 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:37.114032 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57179.3us
I20260709 13:19:37.112798 18970 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 3 to 6, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 6 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:37.117576 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 131328us
I20260709 13:19:37.118631 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:36.956980 22517 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.019431 22595 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:37.132176 19751 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:37.136817 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:37.046610 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.135635 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.143676 19066 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:37.169328 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.140957 22489 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.173964 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:37.022925 22430 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:19:37.141076 22464 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.122231 22454 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:37.182978 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:37.145427 22330 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:37.175673 22636 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.178056 22550 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.136157 22404 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.198763 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:37.144573 22275 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.141167 22310 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.207784 22628 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.199695 22464 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.227133 22628 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.229113 22628 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:37.229301 22464 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.229502 22430 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.229949 22430 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.230329 22454 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.231343 22517 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.232052 22517 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:37.232458 22517 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.177342 22449 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:37.213027 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:37.141814 22332 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:37.225351 22647 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:19:37.233484 22449 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.208073 22415 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.222154 22655 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.245579 22655 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.246662 22388 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.181835 22593 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:37.188489 22423 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:37.236478 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.141562 22620 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:37.250941 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52285us
I20260709 13:19:37.251205 19143 raft_consensus.cc:2410] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:37.232837 22517 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.195220 22649 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:19:37.259045 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:37.254850 21696 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.260174 21696 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.260622 21696 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.256668 22600 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:37.261051 22325 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.261627 22061 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:37.261763 22325 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:37.262185 22325 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:37.223460 22550 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.262925 22325 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.263679 22423 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:37.264122 22325 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.264295 22550 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.220395 22636 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.264904 22423 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.265631 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.266232 19066 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:37.266979 22636 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:37.260195 19110 consensus_peers.cc:597] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f8c498b148c4d5db7c4a7d0e2b24360. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.230341 22430 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.187718 22489 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.272650 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.270428 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:37.273715 19216 raft_consensus.cc:2410] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:37.275835 22595 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:37.308367 22404 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.253141 22455 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.252655 22467 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:19:37.315966 22467 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:37.316530 22467 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:37.277823 22655 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.281473 22600 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:37.276469 22634 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:19:37.309824 22620 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:37.319162 22455 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.351708 22330 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:37.354106 22467 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.405159 22467 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:37.410945 22489 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.413731 22517 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.416172 22628 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:37.416354 22517 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:37.436295 22658 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.464s	user 0.002s	sys 0.000s
I20260709 13:19:37.416800 22628 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:37.439728 22628 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.441236 22628 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.393231 22595 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:37.432623 22652 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.461s	user 0.000s	sys 0.005s
W20260709 13:19:37.482081 19035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.004s	sys 0.008s
W20260709 13:19:37.482968 19035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.004s	sys 0.008s
W20260709 13:19:37.484297 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 205668us
I20260709 13:19:37.489316 19063 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:37.491005 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 519172us
I20260709 13:19:37.489984 18970 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 2 to 7, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 7 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:37.493572 18970 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 3 to 7, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:37.496057 18970 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 2 to 6, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1), VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2), VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3), VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:37.492666 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:37.515092 19143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 324) took 1449 ms (client timeout 1750 ms). Trace:
W20260709 13:19:37.515718 19143 rpcz_store.cc:269] 0709 13:19:36.065402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.065724 (+   322us) service_pool.cc:224] Handling call
0709 13:19:37.514420 (+1448696us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400220454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:37.514760 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397029632}
W20260709 13:19:37.519291 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 383581us
W20260709 13:19:37.521245 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.521278 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.524221 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:37.533135 19215 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.044s	sys 0.037s
W20260709 13:19:37.533706 19215 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.044s	sys 0.037s
I20260709 13:19:37.536824 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.566139 22664 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.567180 22664 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.569746 22672 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:37.571808 22457 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.573530 22664 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:37.574290 22332 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.574888 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.577316 22673 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.577807 22673 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:37.575673 22455 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.578259 22673 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.578814 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.580821 22665 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:37.581235 22672 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.581758 22672 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.582376 22672 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.581682 22665 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:37.586086 22665 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.583319 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.605068 22645 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:37.605585 22517 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:37.606003 22661 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:37.606271 22517 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:37.612860 22464 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:37.613703 22464 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:37.613778 22330 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.615154 22456 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:37.615967 22456 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.616425 22476 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.617453 22476 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.619251 22456 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.620281 22669 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:37.621170 22669 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.642053 22664 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:37.642783 22664 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:37.644027 22664 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.661810 22492 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.662496 22602 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.662648 22492 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.663556 22602 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.665748 22619 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:37.649114 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 429443us
I20260709 13:19:37.624867 22669 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.600281 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:37.632846 22275 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:37.634254 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 51171.1us
I20260709 13:19:37.572676 22457 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.677029 22620 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:37.678648 22480 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.597317 22551 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.689848 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:37.681775 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.682763 22476 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.682693 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.686906 18970 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:37.688199 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:37.607720 22517 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.705968 22619 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.708017 19143 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:37.709041 22480 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.711865 22480 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.717131 22551 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.719489 19216 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:37.721899 22689 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.722096 22457 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.722543 22689 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.765192 19144 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:37.765414 22464 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.788838 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.789673 19065 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:37.790678 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.769383 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.792726 19063 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 7.
I20260709 13:19:37.794821 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:37.780136 22620 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:37.799516 22464 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.799878 22672 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.800202 22464 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.801348 22620 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:37.802016 22620 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.802359 22620 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:37.802527 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.803195 19071 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:37.790612 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:37.796712 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:37.802721 22620 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.810391 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.811448 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.813951 19213 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:37.814695 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:37.819284 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 62216.5us
W20260709 13:19:37.824522 22325 consensus_meta.cc:287] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.009s
W20260709 13:19:37.824991 22320 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.689s	user 0.004s	sys 0.013s
I20260709 13:19:37.912182 22320 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:37.912588 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.826220 22602 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:37.914760 19140 raft_consensus.cc:2368] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:37.826437 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.828456 22310 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:37.833293 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 76210us
I20260709 13:19:37.813709 22619 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:37.817857 22444 consensus_meta.cc:287] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.715s	user 0.014s	sys 0.003s
W20260709 13:19:37.882488 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 390121us
I20260709 13:19:37.915730 19212 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:37.924018 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:37.924989 19742 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:37.925514 19069 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:37.923839 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:37.926749 19749 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:37.931540 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:37.936311 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 105240us
I20260709 13:19:37.966439 22492 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:37.969511 22480 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:37.969637 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:37.970078 22480 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.970532 22480 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.970600 19066 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:37.971834 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 43628us
I20260709 13:19:37.972754 22464 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:37.973505 21696 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.008s
I20260709 13:19:37.973968 21696 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:37.976230 21696 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:37.976279 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 45062.7us
I20260709 13:19:37.977203 22597 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:37.977650 22597 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.977977 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2009) took 1087 ms. Trace:
I20260709 13:19:37.978164 22597 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.978437 19140 rpcz_store.cc:276] 0709 13:19:36.890565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.890738 (+   173us) service_pool.cc:224] Handling call
0709 13:19:37.977762 (+1087024us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540010de54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:37.977923 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303979776}
W20260709 13:19:37.981091 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 65632.5us
I20260709 13:19:37.981664 19038 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:37.982877 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:37.983410 22456 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.983888 22456 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:37.984282 22456 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.985073 22672 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:37.985641 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:37.987311 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1804) took 1142 ms. Trace:
I20260709 13:19:37.987670 19069 rpcz_store.cc:276] 0709 13:19:36.845081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.845717 (+   636us) service_pool.cc:224] Handling call
0709 13:19:36.845959 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.925927 (+1079968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.987025 (+ 61098us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400036954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:37.987237 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480991616}
I20260709 13:19:37.969511 22489 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:37.977685 22430 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.004s
W20260709 13:19:38.029112 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 62684.6us
W20260709 13:19:38.036898 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 68867.6us
I20260709 13:19:38.052582 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:38.053361 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.053462 19742 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:38.054190 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 69325.7us
I20260709 13:19:38.055264 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:38.054833 18970 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 5 to 6, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 6 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.056427 22476 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.029851 22489 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:38.057344 22489 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.058560 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:38.059474 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:38.060571 22602 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.061000 22602 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:38.061434 22602 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.062628 22672 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:38.054220 19212 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:37.946100 22673 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.079784 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:38.080255 22456 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:38.083877 22551 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:38.086530 22688 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.005s
W20260709 13:19:38.094964 18966 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 234) took 31280 ms (client timeout 15000 ms). Trace:
I20260709 13:19:38.046365 22330 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.130062 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.046074 22430 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.142237 22664 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:38.142865 22664 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:38.143409 22664 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.143241 18970 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 2 to 4, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 4 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.145188 18970 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:38.146134 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 66494.4us
I20260709 13:19:38.147495 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:38.149014 19184 leader_election.cc:400] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8.
I20260709 13:19:38.149771 22517 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:38.128028 19714 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.116448 22320 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.165311 22415 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.166296 22056 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.166996 22056 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.169499 22653 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:19:38.170564 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:38.177265 22533 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:19:38.157380 22689 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.187467 19221 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:38.191092 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1857) took 1320 ms. Trace:
I20260709 13:19:38.191475 19214 rpcz_store.cc:276] 0709 13:19:36.870653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.068350 (+197697us) service_pool.cc:224] Handling call
0709 13:19:37.118303 (+ 49953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.276356 (+158053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.276399 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.276916 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:19:37.736818 (+459902us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:37.762547 (+ 25729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:37.804644 (+ 42097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.190668 (+386024us) raft_consensus.cc:1685] finished
0709 13:19:38.190693 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.190889 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50241,"raft.queue_time_us":111411,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":52,"thread_start_us":407494,"threads_started":2,"wal-append.queue_time_us":906048}
I20260709 13:19:38.180460 22673 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:38.212049 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43890.9us
W20260709 13:19:38.187266 22665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.033s	sys 0.050s
W20260709 13:19:38.243897 22665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.034s	sys 0.050s
I20260709 13:19:38.265730 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:38.164490 22480 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.274369 22493 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.274473 22056 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.267894 22645 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.273269 22628 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:19:38.279882 22320 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:38.281503 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 170998us
I20260709 13:19:38.282351 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.283245 22444 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:38.283712 22444 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.286912 22056 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.287505 22056 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.289263 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.290261 22645 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:38.290705 22645 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:38.292013 19066 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:38.291783 22645 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.294950 22645 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:38.108867 18966 rpcz_store.cc:269] 0709 13:19:06.814106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.814609 (+   503us) service_pool.cc:224] Handling call
0709 13:19:07.513850 (+699241us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540014ee54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f4090 00007f6103592f3a 00007f61093491cc 00007f610944737e 00007f61079082a4 00007f6107908232 00007f6107908161 00007f61079080dc 00007f6107907392 00007f61018c548c 00007f61018c48c6
0709 13:19:38.094636 (+30580786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:29.764341 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:29.771293 (+  6952us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:29.771346 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:19:29.771378 (+    32us) tablet.cc:662] Decoding operations
0709 13:19:29.910797 (+139419us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:29.919029 (+  8232us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:29.919061 (+    32us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:19:29.920687 (+  1626us) tablet.cc:701] Row locks acquired
0709 13:19:29.920734 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:19:29.920906 (+   172us) write_op.cc:270] Start()
0709 13:19:29.921061 (+   155us) write_op.cc:276] Timestamp: P: 1783603169920828 usec, L: 0
0709 13:19:29.921083 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:29.923838 (+  2755us) log.cc:844] Serialized 8524 byte log entry
0709 13:19:31.314492 (+1390654us) op_driver.cc:464] REPLICATION: finished
0709 13:19:31.673413 (+358921us) write_op.cc:301] APPLY: starting
0709 13:19:31.699459 (+ 26046us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:31.816141 (+116682us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:31.840270 (+ 24129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:31.966993 (+126723us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:31.967407 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:19:31.967452 (+    45us) write_op.cc:312] APPLY: finished
0709 13:19:31.967923 (+   471us) log.cc:844] Serialized 145 byte log entry
0709 13:19:31.968112 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:31.968311 (+   199us) write_op.cc:454] Released schema lock
0709 13:19:31.968387 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:31.968793 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:31.968833 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18017,"reported_tablets":50,"spinlock_wait_cycles":497597312,"child_traces":[["op",{"apply.queue_time_us":317810,"apply.run_cpu_time_us":6265,"apply.run_wall_time_us":318142,"num_ops":21,"prepare.queue_time_us":160449,"prepare.run_cpu_time_us":70909,"prepare.run_wall_time_us":358428,"raft.queue_time_us":471886,"raft.run_cpu_time_us":12087,"raft.run_wall_time_us":333696,"replication_time_us":1340727,"thread_start_us":680971,"threads_started":4,"wal-append.queue_time_us":226055,"wal-append.run_cpu_time_us":43516,"wal-append.run_wall_time_us":2796724}]]}
I20260709 13:19:38.297318 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.298063 19065 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:38.298411 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 224133us
I20260709 13:19:38.289264 19070 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:38.289358 22430 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.284185 22444 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.307765 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.308482 19221 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:38.308831 19213 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:38.310724 19212 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:38.311846 22489 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.293200 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:38.311691 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 141318us
I20260709 13:19:38.315086 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.375941 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:38.373191 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:38.376812 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.278577 18970 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:38.371456 22524 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:19:38.326732 22689 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:38.382591 22704 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:19:38.384894 22691 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:38.385774 19143 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:38.293908 22056 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:38.389973 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 85169.1us
I20260709 13:19:38.322815 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.321132 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:38.323536 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.393529 21696 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:38.395449 22480 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.396044 22612 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.396829 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.407783 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:38.408452 19751 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.409504 18970 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 5, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:38.410041 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:38.411357 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:38.411978 22673 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.411823 18970 catalog_manager.cc:5697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 2, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 2 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:38.412714 22673 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.413219 22673 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.414163 19743 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:38.414285 22489 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.415251 22673 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.401312 22665 raft_consensus.cc:2764] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:38.415840 22673 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:38.416275 22673 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:38.415251 21696 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.407845 19749 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:38.407065 19217 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:38.410140 19069 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:38.312206 22602 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.420735 19751 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:38.416721 22673 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.406745 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:38.401268 22492 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:38.424069 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.437019 19214 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:38.433812 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:38.305131 22620 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.415421 22694 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.434595 19215 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:38.446077 22517 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:38.446470 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:38.448541 22628 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:38.449186 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.449467 22628 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:38.449838 22628 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:38.450007 19212 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:38.450192 22628 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.450765 22694 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.451176 22694 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:38.452764 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 48213.1us
I20260709 13:19:38.453042 22665 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:38.453167 22636 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.453558 22665 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:38.453691 22636 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:38.454164 22636 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.454684 22665 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.456017 22665 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.416855 22664 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.441309 22480 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.460830 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.462419 22664 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.467032 22669 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:19:38.470002 22636 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.424593 22492 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.473398 19748 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.461414 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.462316 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.480690 19070 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:38.482874 19065 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:38.461747 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.484253 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.506217 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.508150 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.495489 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.509287 19070 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:38.439517 22689 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.461373 22480 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.514432 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.514948 22480 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.461501 22653 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.518216 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.518558 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:38.523823 19749 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:38.524410 19065 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.524852 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.525794 19070 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:38.515798 22653 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.525066 18970 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 3 to 5, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 5 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.514948 22689 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.534570 19066 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:38.540987 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:38.541890 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.543713 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.544308 19069 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:38.441906 22612 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.550344 19219 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:38.550531 22347 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:38.551086 22347 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:38.551151 22456 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.536026 22415 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.552227 22415 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.550387 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.552106 22347 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:38.555475 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52121.6us
I20260709 13:19:38.559445 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:38.563805 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.565747 19212 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:38.520794 22533 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:38.526201 22464 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:19:38.574921 19184 leader_election.cc:400] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
W20260709 13:19:38.575019 22705 log.cc:927] Time spent T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:38.583724 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:38.535046 22330 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:19:38.583041 21696 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.599149 18970 catalog_manager.cc:5697] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 2 to 4, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 4 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.597383 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.604133 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:38.597867 22430 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:38.621065 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 60020.9us
I20260709 13:19:38.625964 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:38.630995 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:38.634466 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:38.635504 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 246255us
I20260709 13:19:38.637311 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.637311 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.642025 19147 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:38.605139 22602 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.668865 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.643965 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.677387 19143 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:38.680735 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:38.644079 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:38.682093 19216 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.686362 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.605573 22628 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.637166 22456 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.643929 22672 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.700886 22672 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.701301 22672 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.702261 22628 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.703084 22713 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.703744 22713 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.705379 19140 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:19:38.705827 19140 pending_rounds.cc:85] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 5
I20260709 13:19:38.706127 19140 pending_rounds.cc:107] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:38.706436 19140 raft_consensus.cc:2889] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.643743 22664 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.709264 22664 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.709533 22415 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.709676 22664 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.711845 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.713500 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:38.714025 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:38.715653 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.672506 22430 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.713526 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.633848 22636 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.694830 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:38.723258 19751 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:19:38.694975 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 90821.1us
I20260709 13:19:38.689829 22492 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.605449 22444 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.781752 19064 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:38.782536 22444 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.695309 22423 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:19:38.697115 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 103568us
I20260709 13:19:38.700219 22476 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.783327 22423 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.783648 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.783561 22476 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.713513 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.784900 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.785601 19141 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:38.715759 21696 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:38.786669 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.786798 21696 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.787890 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:38.730356 19140 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:38.671428 22517 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:19:38.731454 18970 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 3 to 5, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 5 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.737134 19138 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:38.790556 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.791260 19138 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:38.730803 22713 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.743366 22653 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.683854 22620 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.745129 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:38.745994 22430 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:38.755116 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:38.824755 19742 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
W20260709 13:19:38.825677 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 101356us
I20260709 13:19:38.755805 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:38.826783 19749 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:38.756623 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:38.759117 22612 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.760143 22673 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.766750 22664 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.770624 22457 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:38.773177 22672 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.788029 19145 raft_consensus.cc:2410] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:38.718509 22456 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.842768 22456 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.830432 22645 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:38.843492 22645 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:38.739457 22275 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:38.844398 22645 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.845043 22275 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:38.824901 22524 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:38.845573 22694 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.846061 22275 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.847425 22275 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:38.847745 22694 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.748786 19139 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:38.845600 22645 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.726575 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.849210 19147 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:38.807015 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:38.788478 22597 consensus_meta.cc:287] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.006s
I20260709 13:19:38.851445 22597 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.852614 19063 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:38.803301 19216 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:38.853590 22597 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:38.831368 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:38.806598 22415 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.854493 19141 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:38.856254 19143 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.835853 19065 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:38.846072 22524 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.849272 19139 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:38.807013 19748 raft_consensus.cc:2410] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:38.847775 19145 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:38.840201 18970 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 4 to 7, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 7 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:19:38.860128 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:38.869036 19220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.007s
W20260709 13:19:38.869458 19220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.008s	sys 0.008s
I20260709 13:19:38.802037 21696 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:38.874496 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:38.875245 19144 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:38.877012 19140 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:38.873260 22713 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.882974 22713 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:38.883472 22713 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.883882 22673 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.873485 22619 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.885018 22619 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.885646 22430 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.886320 22430 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.888342 22447 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:38.888995 22631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.032s	sys 0.052s
W20260709 13:19:38.889446 22631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.032s	sys 0.052s
I20260709 13:19:38.883908 22524 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.888957 22447 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.857369 22444 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.895881 18970 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 4 to 7, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 7 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:38.911361 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 55841.2us
I20260709 13:19:38.918294 22664 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.902115 22430 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.876821 22457 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:38.918592 22714 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.922222 22423 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:38.959950 19113 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:38.966377 22476 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:38.968384 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:38.970500 22415 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.974193 22423 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:38.974716 22423 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.974676 22612 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:38.975375 22423 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.977300 22467 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:38.979306 22714 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.980183 19751 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:38.980163 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:38.981482 22714 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:38.982038 22712 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:38.982443 22712 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.982780 22712 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.984273 22423 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.986343 22715 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:38.986682 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:38.992555 22653 consensus_queue.cc:1059] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:38.993645 22597 raft_consensus.cc:3055] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:38.994040 22597 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:38.994575 22423 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:38.994908 22597 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:38.995929 19143 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:38.993026 19751 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:38.998647 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:38.996557 22597 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:38.997270 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 311009us
I20260709 13:19:39.001617 19142 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.004982 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:39.005538 19212 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:39.006093 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 364768us
I20260709 13:19:39.006811 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:39.010466 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:39.007516 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:39.021431 19220 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.026233 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.022274 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:39.027042 19217 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:39.010874 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.046994 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.047046 19213 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:39.050686 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.051499 19221 raft_consensus.cc:2410] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:39.047838 19145 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:39.054088 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.024058 22694 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:39.060233 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.060895 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.064489 19213 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:39.067683 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.046452 22551 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:19:39.058928 22694 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.077605 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:39.085773 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.086145 19221 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:39.086537 19145 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:39.089697 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:39.089916 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 447553us
I20260709 13:19:39.069743 22672 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:39.091638 19215 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:39.061092 22524 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.084918 22694 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.112215 22423 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:39.113132 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 472669us
I20260709 13:19:39.112722 22423 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:39.122184 22730 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.122890 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:39.095525 22669 consensus_meta.cc:287] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.001s
I20260709 13:19:39.056036 22712 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:39.137758 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:39.141054 19142 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:39.095831 22620 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:39.144354 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 53587.3us
W20260709 13:19:39.160162 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 100426us
I20260709 13:19:39.132467 22447 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:39.157539 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:39.164841 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.165701 19139 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:39.171984 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:39.176211 22447 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:39.176682 22447 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:39.177137 22447 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:39.180886 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 101956us
I20260709 13:19:39.184185 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.164214 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.127948 22558 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:39.213125 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 70831us
I20260709 13:19:39.217473 19751 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:39.218079 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:39.220428 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:39.221686 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:39.222244 19221 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.215224 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.237965 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:39.233472 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:39.234831 22457 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:39.254504 19145 raft_consensus.cc:2368] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:39.254725 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:39.258441 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:39.259377 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.260290 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:39.262844 19143 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.256583 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:39.263132 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:39.254938 19069 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:39.261580 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:39.265285 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.255636 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:39.273382 19139 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:39.145212 22524 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:39.213165 22620 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:39.330019 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:39.332852 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69924.9us
I20260709 13:19:39.280507 19064 raft_consensus.cc:2368] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:39.242035 22665 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:39.353791 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:39.260361 22551 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.366405 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:39.266131 22415 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.331557 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:39.275545 22464 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:39.373097 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:39.370321 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:39.380509 19749 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.384986 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:39.386660 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 55200.6us
I20260709 13:19:39.376356 19213 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:39.377254 19063 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:39.392307 19069 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:39.377269 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:39.400915 19067 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.384433 22415 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:39.404625 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.336006 22517 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:39.405478 19138 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:39.414551 19143 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:39.257690 22430 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:19:39.366108 22653 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:39.419996 22709 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:19:39.420707 22719 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:39.420600 22653 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:39.421506 22718 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:19:39.422960 22653 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:39.285521 22444 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:19:39.362504 22457 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.416556 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:39.377781 22689 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:39.416555 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.243402 22558 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:39.465440 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.466670 19213 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:39.446550 22669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33232 (request call id 19) took 8131 ms. Trace:
I20260709 13:19:39.450781 22620 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:39.455334 22456 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.000s
W20260709 13:19:39.461606 22731 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:39.424039 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:39.467803 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:39.469219 19220 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:39.471824 19212 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:39.424126 22320 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:19:39.480517 22447 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:39.392313 22665 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:39.496806 19221 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:39.547847 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:39.912724 19219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.005s	sys 0.020s
W20260709 13:19:40.059645 19219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.005s	sys 0.027s
I20260709 13:19:39.648499 19067 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:40.061568 19749 consensus_meta.cc:287] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.023s
I20260709 13:19:39.486095 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:39.594945 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.055686 19213 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:40.062991 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.054698 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:39.416733 22740 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.089879 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1880) took 1056 ms. Trace:
I20260709 13:19:40.064095 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 1878) took 1058 ms. Trace:
I20260709 13:19:40.063764 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1675) took 1190 ms. Trace:
W20260709 13:19:40.094861 19035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.014s	sys 0.029s
W20260709 13:19:40.098516 19035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.015s	sys 0.030s
W20260709 13:19:40.099359 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 726329us
W20260709 13:19:40.061214 19144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.008s
W20260709 13:19:40.101109 19144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.012s	sys 0.008s
W20260709 13:19:39.484985 22722 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.289s	user 0.000s	sys 0.000s
W20260709 13:19:39.600732 22733 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 13:19:40.102788 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:39.912158 22636 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:39.603595 22558 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.104477 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.100152 19220 rpcz_store.cc:276] 0709 13:19:38.997984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.998096 (+   112us) service_pool.cc:224] Handling call
0709 13:19:40.056431 (+1058335us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:39.597157 22713 consensus_meta.cc:287] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.713s	user 0.004s	sys 0.008s
W20260709 13:19:39.517550 22704 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:19:40.105068 19751 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.020s	sys 0.031s
I20260709 13:19:40.106797 19072 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:40.062212 19749 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:40.106469 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:40.108189 19221 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:39.549048 22325 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.621s
W20260709 13:19:39.602001 22275 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.000s
I20260709 13:19:39.484190 22524 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:39.548908 22727 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:39.585892 22551 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.097252 19212 rpcz_store.cc:276] 0709 13:19:38.999379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.999499 (+   120us) service_pool.cc:224] Handling call
0709 13:19:40.055410 (+1055911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.517102 22689 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:40.103922 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 49327.3us
I20260709 13:19:39.549196 22631 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.179970 22712 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.169312 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.170897 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:39.974231 22724 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.064064 22330 raft_consensus.cc:2764] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:40.098292 19141 rpcz_store.cc:276] 0709 13:19:38.867780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.876502 (+  8722us) service_pool.cc:224] Handling call
0709 13:19:38.884301 (+  7799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.893372 (+  9071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.893407 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.893885 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.198337 (+304452us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:39.364287 (+165950us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.387017 (+ 22730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.387162 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.054628 (+667466us) raft_consensus.cc:1685] finished
0709 13:19:40.054648 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.054800 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36182,"prepare.queue_time_us":61092,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":28,"raft.queue_time_us":62971,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":38321,"thread_start_us":466773,"threads_started":2,"wal-append.queue_time_us":1081074}
I20260709 13:19:40.169095 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:39.431402 22517 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:39.585330 22430 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.527s
W20260709 13:19:40.003307 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.547s (SENT) [suppressed 2 similar messages]
I20260709 13:19:40.182168 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1897) took 1014 ms. Trace:
I20260709 13:19:40.219899 22524 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:40.243417 19221 rpcz_store.cc:276] 0709 13:19:39.168067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.107671 (+939604us) service_pool.cc:224] Handling call
0709 13:19:40.107908 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.181914 (+ 74006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.182120 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.063855 22456 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:40.184191 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 77779.5us
I20260709 13:19:40.246551 19035 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:40.108947 22612 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:40.181957 19751 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.021s	sys 0.031s
I20260709 13:19:40.173182 22636 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.248242 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1891) took 1235 ms. Trace:
I20260709 13:19:40.178068 22713 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.233476 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1707) took 1672 ms. Trace:
I20260709 13:19:40.230494 19068 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:40.238407 19036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.004s
W20260709 13:19:40.253286 19036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.017s	sys 0.004s
I20260709 13:19:40.240270 19069 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:40.248616 19216 rpcz_store.cc:276] 0709 13:19:39.013048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.063688 (+ 50640us) service_pool.cc:224] Handling call
0709 13:19:39.075957 (+ 12269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.082234 (+  6277us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:39.242407 (+160173us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.945533 (+703126us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.247934 (+302401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.247990 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:40.248029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.248091 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.248191 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112514,"prepare.queue_time_us":391162,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":88676,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":33792,"spinlock_wait_cycles":166758016,"thread_start_us":758275,"threads_started":3}
I20260709 13:19:40.255816 19066 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:40.251329 19214 rpcz_store.cc:276] 0709 13:19:38.560548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.560717 (+   169us) service_pool.cc:224] Handling call
0709 13:19:38.570983 (+ 10266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.585913 (+ 14930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.585955 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.590724 (+  4769us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.960494 (+369770us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:38.960545 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.960639 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.233204 (+1272565us) raft_consensus.cc:1685] finished
0709 13:19:40.233229 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.233402 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":232,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5631,"thread_start_us":337830,"threads_started":1,"wal-append.queue_time_us":497560}
I20260709 13:19:40.195307 22727 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.284528 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.286700 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:40.287411 19144 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:40.237192 22712 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:19:40.246889 22524 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:40.290611 19141 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:40.252224 22741 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:40.225302 22631 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.278009 22551 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.232909 22665 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.316751 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2017) took 1470 ms. Trace:
I20260709 13:19:40.241165 22724 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.294148 22524 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.294409 22741 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:40.345080 22694 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.206s	user 0.011s	sys 0.002s
W20260709 13:19:40.350837 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 347554us
I20260709 13:19:40.327040 22447 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.321547 19146 rpcz_store.cc:276] 0709 13:19:38.712335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.759538 (+ 47203us) service_pool.cc:224] Handling call
0709 13:19:38.759915 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:38.855297 (+ 95382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.855333 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:38.856021 (+   688us) log.cc:844] Serialized 52 byte log entry
0709 13:19:39.121897 (+265876us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:39.184292 (+ 62395us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.184782 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.184862 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.182663 (+997801us) raft_consensus.cc:1685] finished
0709 13:19:40.182691 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.182837 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97081,"prepare.queue_time_us":99261,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":51,"raft.queue_time_us":119888,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":224,"thread_start_us":306320,"threads_started":2,"wal-append.queue_time_us":536750}
I20260709 13:19:40.344149 22558 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:19:40.345273 22741 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.351296 22760 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:40.359105 22760 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.344686 22551 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.357259 22751 ts_tablet_manager.cc:933] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:40.359519 22760 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:40.365585 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 169619us
W20260709 13:19:40.367292 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 961700us
I20260709 13:19:40.356446 22619 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.372654 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:40.370553 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:40.378023 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 119001us
I20260709 13:19:40.055500 22669 rpcz_store.cc:276] 0709 13:19:31.239508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.257218 (+ 17710us) service_pool.cc:224] Handling call
0709 13:19:31.445381 (+188163us) log.cc:844] Serialized 499 byte log entry
0709 13:19:32.070719 (+625338us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b18003bbae0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:19:32.113301 (+ 42582us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b18003bbae0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f61034e3b0b 00007f6103568b63 00007f6103590752
0709 13:19:32.380173 (+266872us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b54004194a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61034ffdbe 00007f610350a930 00007f610350a8d8 00007f610350a858 00007f610350a813 00007f6103509a9c 00007f61093f5626 00007f61093efdd8 00007f61035467cb 00007f61035492c0
0709 13:19:33.110181 (+730008us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54004194a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103500aaa 00007f61034ffdd9 00007f610350a930 00007f610350a8d8 00007f610350a858 00007f610350a813 00007f6103509a9c 00007f61093f5626 00007f61093efdd8 00007f61035467cb
0709 13:19:39.354297 (+6244116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18997,"raft.queue_time_us":66734,"raft.run_cpu_time_us":2499,"raft.run_wall_time_us":148611,"spinlock_wait_cycles":343066368,"thread_start_us":330260,"threads_started":2,"wal-append.queue_time_us":273052,"wal-append.run_cpu_time_us":9320,"wal-append.run_wall_time_us":2394139}
I20260709 13:19:40.355898 22694 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.392321 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.393297 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.394627 22275 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:40.395170 22275 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.397166 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:40.397692 19068 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.406057 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1896) took 1239 ms. Trace:
I20260709 13:19:40.406467 19213 rpcz_store.cc:276] 0709 13:19:39.166805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.107107 (+940302us) service_pool.cc:224] Handling call
0709 13:19:40.107370 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.107554 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:40.362112 (+254558us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.405723 (+ 43611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.405776 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.405818 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.405886 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.405996 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4748,"prepare.queue_time_us":236502,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"thread_start_us":198080,"threads_started":3}
I20260709 13:19:40.413596 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.388414 22689 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.390552 22430 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:40.393059 22447 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:40.416116 22325 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.409914 22761 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:40.421241 19068 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:40.424068 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.422142 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:40.420166 22456 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.418323 22713 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.420641 22763 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:19:40.438465 22758 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:19:40.421643 21696 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:40.425626 22275 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:40.436491 22754 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:19:40.449157 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.442256 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.417723 22430 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.446707 22636 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:40.447041 22551 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.450318 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.454171 22464 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:40.465865 22464 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.462627 22430 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.445765 22769 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.443645 22777 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.465265 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.434829 22761 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.492779 22761 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:40.492821 22769 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.493801 22761 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.494436 22761 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.495162 22769 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.495688 22777 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.496482 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.497303 22709 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:40.497673 22709 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:40.497812 22777 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.498891 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1892) took 1485 ms. Trace:
I20260709 13:19:40.499752 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:40.500133 22763 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.502607 22763 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.441665 22325 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:40.504030 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 455) took 1531 ms. Trace:
I20260709 13:19:40.504369 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:40.505025 19212 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:40.506166 22628 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.479677 22320 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:40.504395 19748 rpcz_store.cc:276] 0709 13:19:38.972858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.975981 (+  3123us) service_pool.cc:224] Handling call
0709 13:19:38.976289 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.976675 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:38.976962 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.234707 (+257745us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.253035 (+ 18328us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.253230 (+   195us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.253281 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.253385 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.499849 (+1246464us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b180033fa60. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:19:40.503735 (+  3886us) raft_consensus.cc:1685] finished
0709 13:19:40.503846 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.503958 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60625,"prepare.queue_time_us":20507,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":69256,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":19730,"spinlock_wait_cycles":22368512,"thread_start_us":196653,"threads_started":1,"wal-append.queue_time_us":284525}
I20260709 13:19:40.508092 22320 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:40.509291 22415 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.509076 22320 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.471264 22778 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.488337 19141 raft_consensus.cc:2410] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:40.498505 22709 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.497764 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.481360 22727 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.499255 19219 rpcz_store.cc:276] 0709 13:19:39.013214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.066880 (+ 53666us) service_pool.cc:224] Handling call
0709 13:19:39.081020 (+ 14140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.083340 (+  2320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.083381 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.091440 (+  8059us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.060160 (+968720us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:40.362383 (+302223us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.362571 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.362639 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.498700 (+136061us) raft_consensus.cc:1685] finished
0709 13:19:40.498719 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.498827 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31278,"prepare.queue_time_us":283632,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":72306,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":17106,"thread_start_us":1111340,"threads_started":2,"wal-append.queue_time_us":1087334}
I20260709 13:19:40.516214 19070 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:40.516387 19072 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:40.533272 19067 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
W20260709 13:19:40.484467 22753 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:19:40.519223 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:40.500808 22732 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:40.538645 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.539500 19072 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:40.531086 19144 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:40.515976 22778 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.532604 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.506660 22628 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.545812 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 344) took 1057 ms. Trace:
I20260709 13:19:40.547088 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1899) took 1376 ms. Trace:
I20260709 13:19:40.550256 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:40.557503 19067 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:40.541946 22732 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:40.557277 19220 rpcz_store.cc:276] 0709 13:19:39.170623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.187347 (+1016724us) service_pool.cc:224] Handling call
0709 13:19:40.187732 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.187995 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:40.373230 (+185235us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.546733 (+173503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.546780 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.546833 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.546943 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.547037 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":156203,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":21,"raft.queue_time_us":102183,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":316776,"threads_started":3,"wal-append.queue_time_us":72512}
W20260709 13:19:40.561612 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 111351us
I20260709 13:19:40.544822 22778 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:40.562474 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 140380us
I20260709 13:19:40.557193 19144 rpcz_store.cc:276] 0709 13:19:39.482983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.259911 (+776928us) service_pool.cc:224] Handling call
0709 13:19:40.540662 (+280751us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.553601 22724 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:40.549849 22759 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.556213 22415 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.552582 22777 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.558404 22489 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.590260 22275 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.593850 22489 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:40.594040 22773 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:19:40.594094 22275 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.598014 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:40.598565 19138 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.599710 22775 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.592732 22631 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.569582 22447 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:40.600380 22775 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.591204 22759 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.601656 22447 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.603194 22775 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:40.589403 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:40.589190 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.559911 22456 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.608819 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:40.591141 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:40.603411 22776 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:40.566967 22751 tablet_copy_client.cc:323] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:19:40.604907 22628 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.605702 22732 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.551533 22709 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.592986 22415 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.643573 22415 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.588817 22763 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.609972 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.645313 22636 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.648185 22760 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.649088 22727 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:40.649595 22727 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:40.640373 22524 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.650455 22727 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.596827 22275 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.641245 22631 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:40.652364 22631 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.652762 22631 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.590453 22785 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:40.653401 22785 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.655516 22785 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.656627 22665 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.657066 22665 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:40.657392 22665 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.657984 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2006) took 1441 ms. Trace:
I20260709 13:19:40.658084 22464 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.658443 19063 rpcz_store.cc:276] 0709 13:19:39.216932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.217627 (+   695us) service_pool.cc:224] Handling call
0709 13:19:39.254274 (+ 36647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.391437 (+137163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.657752 (+1266315us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400056254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:40.657926 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266488576}
I20260709 13:19:40.660470 22464 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.661072 22777 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.587297 22770 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.637753 22759 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:40.588789 22517 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.662111 22770 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.662551 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1898) took 1493 ms. Trace:
I20260709 13:19:40.662935 19217 rpcz_store.cc:276] 0709 13:19:39.169354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.107351 (+937997us) service_pool.cc:224] Handling call
0709 13:19:40.170977 (+ 63626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.349344 (+178367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.349391 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.349452 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.349512 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.662300 (+312788us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400269dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:40.662348 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.662499 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409725312}
I20260709 13:19:40.664130 22770 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.639058 22779 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.664680 19138 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
W20260709 13:19:40.666942 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 75868.4us
I20260709 13:19:40.666915 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 339) took 1185 ms. Trace:
I20260709 13:19:40.644358 22763 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.661006 22456 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.630743 22489 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.669718 19110 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:40.668792 19138 rpcz_store.cc:276] 0709 13:19:39.481165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.521941 (+ 40776us) service_pool.cc:224] Handling call
0709 13:19:40.597861 (+1075920us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:40.666850 (+ 68989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663680}
I20260709 13:19:40.663892 22777 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.653402 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:40.685940 19147 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:40.640736 22732 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:40.643574 22736 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.272s	user 0.005s	sys 0.020s
I20260709 13:19:40.686043 19067 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:40.686530 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 341) took 1204 ms. Trace:
I20260709 13:19:40.677939 22709 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:40.678107 22524 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:40.691797 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 172644us
I20260709 13:19:40.690498 19147 rpcz_store.cc:276] 0709 13:19:39.481954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.600984 (+119030us) service_pool.cc:224] Handling call
0709 13:19:40.653250 (+1052266us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:40.686473 (+ 33223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4387712}
I20260709 13:19:40.694798 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:40.694254 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:40.692035 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 83820.7us
W20260709 13:19:40.698367 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 110451us
I20260709 13:19:40.687847 22467 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.702248 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:40.702972 19067 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.698897 22628 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.704279 22636 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:40.694741 22517 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:19:40.705667 22517 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:40.706002 22517 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:40.706254 22760 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:40.706753 22517 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.708012 22517 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.702005 22467 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.709275 22467 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.713023 22783 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:40.704787 22636 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:40.690851 22619 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:40.715875 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:40.716106 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.719029 19138 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.720604 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.725962 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:40.726619 19068 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 8: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:40.729169 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.690881 22759 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:40.733479 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.731434 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.735670 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.731868 19145 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:40.737884 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.731926 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 338) took 1306 ms. Trace:
I20260709 13:19:40.732204 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:40.739243 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.739485 19147 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
W20260709 13:19:40.739714 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.690743 22713 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:19:40.730284 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:40.750284 19751 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:40.750494 19069 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:40.748854 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:40.740192 19139 rpcz_store.cc:276] 0709 13:19:39.425312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.425553 (+   241us) service_pool.cc:224] Handling call
0709 13:19:40.092272 (+666719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.110501 (+ 18229us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:40.174840 (+ 64339us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.661358 (+486518us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18000f8c20. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:19:40.731459 (+ 70101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.731582 (+   123us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:40.731645 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.731730 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.731860 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64320,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3164,"raft.queue_time_us":108,"spinlock_wait_cycles":3079552,"thread_start_us":69796,"threads_started":1}
I20260709 13:19:40.684814 22779 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.751825 19063 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:40.736241 19146 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:40.754838 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.762306 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.757539 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.767373 19067 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
W20260709 13:19:40.772373 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 78189.9us
I20260709 13:19:40.772541 19743 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:40.779513 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.780844 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:40.781572 19146 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:40.783779 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 54692.1us
I20260709 13:19:40.792539 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:40.729799 22741 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.779397 22628 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:40.736588 22619 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.713637 22783 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.750415 22759 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.803457 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:40.812069 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.800545 22636 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.821511 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:40.821966 22782 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:19:40.818025 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:40.826153 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 76537.4us
I20260709 13:19:40.827832 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.828048 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:40.837780 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58334.1us
I20260709 13:19:40.838603 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:40.838835 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:40.840895 19184 leader_election.cc:400] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:40.841310 19184 leader_election.cc:403] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:40.830895 22724 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:19:40.842025 22769 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:40.842281 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.842918 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:40.844024 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:40.844244 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:40.842957 19744 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:40.831513 22628 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:40.823711 22423 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.843783 22330 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:40.864575 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 87957.4us
I20260709 13:19:40.830654 22760 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:40.843621 22476 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.867654 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.847293 22456 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.871254 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.839792 22785 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:40.854841 22769 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:40.882941 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.886690 19751 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:40.889397 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.884465 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:40.889995 19750 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:40.894675 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.895735 19744 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:40.869457 22777 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.868772 22763 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.867184 22761 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:40.873090 22784 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.873519 22476 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.912657 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.922806 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:40.921875 22628 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:40.952086 19142 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.926797 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:40.955096 19744 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.910334 22777 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.962965 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:40.925590 22423 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.973374 22789 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.925874 22476 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.964258 22777 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:40.982049 22800 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.975358 22774 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:19:40.983035 22723 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:40.982800 22797 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:19:40.986057 22779 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.963574 22783 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:40.926416 22761 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:40.976536 22619 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:40.992336 19065 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.036783 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2005) took 1820 ms. Trace:
I20260709 13:19:40.995463 22669 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:41.002239 22741 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:41.006793 19067 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.013505 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:41.052630 19068 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:41.053870 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:41.026975 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:40.972682 22760 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:40.990468 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2010) took 1772 ms. Trace:
I20260709 13:19:41.035307 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:41.037232 19065 rpcz_store.cc:276] 0709 13:19:39.216655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.216766 (+   111us) service_pool.cc:224] Handling call
0709 13:19:40.991860 (+1775094us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:40.992115 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.036456 (+ 44341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.036711 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13608832}
I20260709 13:19:41.054929 19066 rpcz_store.cc:276] 0709 13:19:39.218009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.218587 (+   578us) service_pool.cc:224] Handling call
0709 13:19:40.990206 (+1771619us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54001211d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:40.990379 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242935168}
I20260709 13:19:41.014432 22800 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.021222 22723 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:41.035528 22759 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:41.072086 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:41.050382 22669 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:41.070233 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:41.058720 22524 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.074688 19069 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:41.068511 22783 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.067298 22330 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:41.063103 22800 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.087319 19146 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:41.088032 19138 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.066206 22760 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:41.088371 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 244156us
I20260709 13:19:41.084717 22769 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:41.091290 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:41.091521 22769 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.092232 22464 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:41.092588 22464 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.092952 22464 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:41.095715 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:41.145074 22802 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:19:41.149147 22794 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:19:41.084489 22774 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:41.096298 19147 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:41.148016 22330 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.152336 19142 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:41.080077 22524 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.161346 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:41.162163 19744 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:41.171337 19143 raft_consensus.cc:2368] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9.
W20260709 13:19:41.171885 19143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 340) took 1690 ms (client timeout 1839 ms). Trace:
W20260709 13:19:41.172372 19143 rpcz_store.cc:269] 0709 13:19:39.481561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.537735 (+ 56174us) service_pool.cc:224] Handling call
0709 13:19:41.161208 (+1623473us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:41.171818 (+ 10610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335488}
I20260709 13:19:41.082587 22783 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.178961 22813 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:41.179523 22813 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.180469 22783 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.188187 22783 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.188752 22783 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.191203 22783 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:41.161650 22741 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.174391 22812 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.192063 22741 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.194592 22741 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:41.176563 22799 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:19:41.195755 22489 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.508s	user 0.000s	sys 0.009s
I20260709 13:19:41.178296 22524 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:41.196225 22489 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.181198 22672 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:41.160048 22803 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.200475 22803 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.200963 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:41.202366 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.202646 22803 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:41.172410 22774 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.199726 22672 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:41.163160 22665 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.505s	user 0.022s	sys 0.000s
I20260709 13:19:41.161235 22817 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:41.166031 22805 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:19:41.166301 22669 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:41.204761 22467 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.222297 19144 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:41.223335 19110 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:41.181519 22813 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.182816 19184 leader_election.cc:400] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:41.186086 22760 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:41.180743 22631 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.003s
I20260709 13:19:41.187433 22759 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.192137 22812 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.174850 22815 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.162865 22775 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.197975 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:41.160590 22723 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:41.233062 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50403.5us
I20260709 13:19:41.268663 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:41.283767 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 60533.9us
I20260709 13:19:41.290431 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:19:41.284531 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 58236.8us
I20260709 13:19:41.287299 19743 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:41.287490 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.217451 22669 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:41.296069 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:41.209167 22672 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.207309 22774 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:41.300897 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.316567 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.210214 22761 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:41.321841 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.212352 22817 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:41.317363 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.324944 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.300302 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.325363 19215 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:41.325773 19213 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:41.326597 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.289407 22732 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.281522 22760 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.321135 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.209509 22665 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.303081 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:41.274121 22325 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.273880 22712 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:41.324204 19071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2008) took 2099 ms (client timeout 1804 ms). Trace:
I20260709 13:19:41.328392 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.333158 19063 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.292975 22813 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.334342 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.336205 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:41.338208 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:41.316900 22713 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:41.344825 22817 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.345681 22812 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.346369 22476 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.305814 22816 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.348359 22476 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.348302 22816 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:19:41.349298 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.349535 19717 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:41.350682 22816 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.351367 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.351502 22810 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.351966 22810 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.337174 22723 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.352358 22810 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.292755 22759 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.354576 22759 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.355026 22694 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:41.339030 19071 rpcz_store.cc:269] 0709 13:19:39.217453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.217569 (+   116us) service_pool.cc:224] Handling call
0709 13:19:41.295922 (+2078353us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:41.316771 (+ 20849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14898944}
I20260709 13:19:41.356153 22665 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.297300 22775 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.293411 22744 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:19:41.358271 22775 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.341575 22672 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:41.362083 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.360431 22810 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.362777 22464 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.351527 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.364828 19218 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:41.365875 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.358302 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.368623 19216 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:41.291800 22631 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:41.388851 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50765.2us
I20260709 13:19:41.390771 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.397910 19213 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:41.398838 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:41.424978 19742 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:41.367234 22602 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.345701 22467 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:41.386304 22464 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:41.297024 22815 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.389613 22713 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:41.339774 22760 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.366019 22774 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:19:41.372601 22813 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.416324 22517 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:41.509334 19220 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
W20260709 13:19:41.507899 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 203080us
W20260709 13:19:41.517243 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 81187.9us
I20260709 13:19:41.531952 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:41.429363 22672 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:41.497522 22737 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:19:41.549707 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.533476 22517 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.551482 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.475507 22710 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.553694 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.554528 19218 raft_consensus.cc:2410] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:41.438731 22602 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.555282 19217 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:41.562496 22784 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:41.564994 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:41.565470 22823 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:41.566111 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:41.567167 22777 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.000s
I20260709 13:19:41.553517 22825 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:41.568014 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:41.568274 22778 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.977s	user 0.008s	sys 0.001s
I20260709 13:19:41.568531 22489 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:41.569162 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:41.569739 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:41.570822 22713 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.568219 22825 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:41.567117 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.475658 22712 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:41.567639 22777 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.572680 19218 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:41.567750 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:41.530447 22689 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.507140 22819 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:41.437427 22476 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 13:19:41.581697 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.582288 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.552423 22517 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.583424 19218 pending_rounds.cc:85] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 8
I20260709 13:19:41.614199 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:41.620054 19138 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:41.584723 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.620849 19218 pending_rounds.cc:107] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:41.620980 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.621263 19218 raft_consensus.cc:2889] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.568789 22778 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.619482 22819 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.624554 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:41.625073 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.626304 19213 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:41.579994 22825 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:41.632735 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.633113 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50868.2us
I20260709 13:19:41.635447 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:41.644261 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.645447 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.553181 22710 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.649849 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.584170 22712 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.654062 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.656524 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:41.634593 22775 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:41.641387 22783 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.647251 22447 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.534439 22812 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:19:41.646739 22476 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:19:41.747507 19750 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:41.748364 22476 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:41.748790 22476 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:41.749167 22822 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:19:41.713685 22761 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:41.714864 22813 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:41.651106 22774 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.648972 22628 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:41.624466 22689 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:41.657169 22665 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:41.667405 22759 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:41.665472 22789 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.661787 22775 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.749629 22476 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:41.773661 22832 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:19:41.774140 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1701) took 1054 ms. Trace:
I20260709 13:19:41.665938 22783 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:41.779353 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.779742 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.665757 22744 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:19:41.649430 22672 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:41.809299 19144 rpcz_store.cc:276] 0709 13:19:40.719655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.720385 (+   730us) service_pool.cc:224] Handling call
0709 13:19:41.773953 (+1053568us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002b84d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:41.774085 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147084160}
W20260709 13:19:41.819700 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 164382us
I20260709 13:19:41.799860 22628 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:41.805588 22775 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:41.803853 22815 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:41.819491 22783 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.899180 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:41.900825 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:41.822171 22760 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:41.928961 22829 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:19:41.965173 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.928188 22710 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:41.921561 22830 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:19:41.945672 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.933491 22628 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:41.922677 22712 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:41.926985 22669 consensus_meta.cc:287] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
I20260709 13:19:41.944734 22778 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:41.911854 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.943938 22689 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:41.953313 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:41.971494 22447 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.963335 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:41.948094 22800 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.858s	user 0.007s	sys 0.000s
I20260709 13:19:41.958799 22777 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.009979 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.010891 19221 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:41.970211 19217 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
W20260709 13:19:42.015398 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.973153 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 265197us
I20260709 13:19:41.896828 22834 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:41.993441 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:41.999665 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.006242 19138 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
W20260709 13:19:41.975293 22723 consensus_meta.cc:287] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.623s	user 0.003s	sys 0.007s
I20260709 13:19:42.007105 19743 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.019953 19144 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:41.961896 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:41.998621 22464 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.025960 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:41.993928 22817 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:42.025327 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.024181 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.030900 19221 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:42.026504 19217 raft_consensus.cc:2376] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9. Re-sending same reply.
I20260709 13:19:42.021739 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:42.033318 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.032137 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.008215 22819 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:42.039498 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.022753 22834 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:42.039813 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.051330 19143 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:42.052105 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.054430 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.054980 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.055580 19217 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:42.055693 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.056375 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:42.056506 19221 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:42.054980 19140 raft_consensus.cc:2376] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12. Re-sending same reply.
I20260709 13:19:42.059424 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:42.060387 19750 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:42.065919 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.066783 19144 raft_consensus.cc:2368] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9.
I20260709 13:19:42.039165 22760 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.023468 22447 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.040983 22765 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:42.022568 22800 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.071871 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.031390 22464 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.096707 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.097293 19221 raft_consensus.cc:2376] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9. Re-sending same reply.
I20260709 13:19:42.099351 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.069792 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:42.095866 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.101401 19714 leader_election.cc:400] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9.
I20260709 13:19:42.103364 19714 leader_election.cc:403] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:42.105973 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:42.106739 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 1.04404e+06us
I20260709 13:19:42.064294 22423 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:42.108384 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.070132 22760 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:42.116453 19744 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:42.113440 19217 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:42.119961 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.062425 22826 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:19:42.059587 22817 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.124450 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.131609 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:42.131942 19217 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:42.112422 22489 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9.
I20260709 13:19:42.134394 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.121461 22760 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.134356 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:42.137672 22837 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:42.138028 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 6f8c498b148c4d5db7c4a7d0e2b24360 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:19:42.135286 19217 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:42.160133 22447 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.112378 22825 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.161688 22464 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.161861 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.176335 19138 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:42.160953 22602 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.165853 22330 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:42.166618 22517 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:19:42.167248 22800 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.120802 22819 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.167654 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:42.181785 19070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1850) took 2640 ms (client timeout 1828 ms). Trace:
I20260709 13:19:42.098778 22765 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.169837 19065 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:42.171437 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.172020 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:42.182298 19070 rpcz_store.cc:269] 0709 13:19:39.541181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.541365 (+   184us) service_pool.cc:224] Handling call
0709 13:19:42.181577 (+2640212us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400209754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:42.181705 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383417728}
I20260709 13:19:42.184448 19143 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.160945 19743 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:42.117522 22423 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.173065 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.173005 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1848) took 2802 ms. Trace:
I20260709 13:19:42.135038 22803 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.181967 19212 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:42.186455 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.187636 22789 raft_consensus.cc:2764] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:19:42.184180 22517 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.181519 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 6f8c498b148c4d5db7c4a7d0e2b24360 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-6f8c498b148c4d5db7c4a7d0e2b24360
I20260709 13:19:42.189953 22517 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:42.190289 22765 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:42.185745 22819 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.192420 22819 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:42.194626 22423 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:42.198091 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:42.194641 22825 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:42.202142 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:42.202087 19217 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:42.203936 19143 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:42.186429 19218 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:42.213253 19749 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:42.168970 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 195902us
I20260709 13:19:42.227281 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.228864 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.231537 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.180862 22330 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:42.238557 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:42.245786 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:42.248533 19219 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.186618 19064 rpcz_store.cc:276] 0709 13:19:39.368034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.584909 (+216875us) service_pool.cc:224] Handling call
0709 13:19:41.785095 (+2200186us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:41.785291 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.785505 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:41.801630 (+ 16125us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.169538 (+367908us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.169610 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:42.169663 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.169748 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.169891 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21597,"prepare.queue_time_us":16161,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":49228,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2813,"spinlock_wait_cycles":6484992,"thread_start_us":346932,"threads_started":2,"wal-append.queue_time_us":319335}
I20260709 13:19:42.252713 19156 tablet_copy_source_session.cc:215] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:42.217485 22825 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.261160 19143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:42.276804 19143 raft_consensus.cc:606] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.277185 19143 raft_consensus.cc:614] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:42.275908 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.279212 19213 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:42.281327 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.281949 19212 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:42.285835 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.280913 19213 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:19:42.286108 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:42.274863 22846 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.290463 22847 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:42.301044 19070 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:42.303382 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1716) took 1148 ms. Trace:
I20260709 13:19:42.303697 19141 rpcz_store.cc:276] 0709 13:19:41.155056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.296637 (+1141581us) service_pool.cc:224] Handling call
0709 13:19:42.303071 (+  6434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.303194 (+   123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.303209 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.303235 (+    26us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:42.303253 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.303284 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.303345 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.281920 22825 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.309665 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:42.310220 19070 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.317406 19070 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:42.302789 22847 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:42.326804 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.328516 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.332906 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.333563 19141 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:42.306264 22330 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.327390 22817 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.339143 22751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8c498b148c4d5db7c4a7d0e2b24360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.333570 22847 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.325039 22783 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.338073 22723 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.384259 19212 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.386686 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:42.387825 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 58330.7us
W20260709 13:19:42.384094 22848 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:42.388911 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:42.392629 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.394631 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.399667 22854 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.399938 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.406723 19717 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.421291 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.397735 22723 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.418905 22783 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:42.425429 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:42.427305 19749 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:42.396219 22330 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.432205 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.397392 22777 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.409336 22840 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.426564 22846 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.424069 22850 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.401614 22858 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.451830 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.453670 19141 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:42.425127 22723 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:42.445955 22854 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.429236 22800 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:42.459579 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.460490 22476 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.466392 22834 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.467343 22834 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:42.468163 22775 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.005s
I20260709 13:19:42.457440 22723 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.455880 22858 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:42.459057 22825 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:42.468569 22775 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.483856 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.485031 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.485710 19221 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:42.485952 22760 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:42.487212 22833 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.705s	user 0.002s	sys 0.000s
I20260709 13:19:42.487612 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.487944 22760 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:42.490001 22631 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:42.454015 22840 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.477519 22858 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:42.516734 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1710) took 1689 ms (client timeout 1854 ms). Trace:
W20260709 13:19:42.517158 19147 rpcz_store.cc:269] 0709 13:19:40.827691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.827820 (+   129us) service_pool.cc:224] Handling call
0709 13:19:42.516583 (+1688763us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540018a954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:42.516680 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615317248}
I20260709 13:19:42.517484 22840 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:42.492236 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.520766 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.492903 22765 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.498777 19743 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.501721 22767 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:42.502576 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.505254 19215 raft_consensus.cc:2410] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:42.506253 22775 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:42.507128 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.524866 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:42.526894 19113 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:42.529109 22765 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.531811 22765 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:42.533521 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.533591 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:42.534245 19147 raft_consensus.cc:606] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.534581 19147 raft_consensus.cc:614] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:42.523043 19216 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:42.535915 19221 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.537824 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:42.538724 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:42.539654 19113 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.535728 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:42.543552 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 111441us
I20260709 13:19:42.539732 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.555011 19035 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:42.555895 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.557927 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1722) took 1257 ms. Trace:
I20260709 13:19:42.558190 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:42.558305 19214 rpcz_store.cc:276] 0709 13:19:41.300553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.337660 (+ 37107us) service_pool.cc:224] Handling call
0709 13:19:41.361708 (+ 24048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.623835 (+262127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.623871 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.623917 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:41.623952 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.557715 (+933763us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540024c554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:42.557760 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.557879 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602405632}
I20260709 13:19:42.562144 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.563551 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.567912 22846 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.568380 19214 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:42.570540 19214 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:42.536106 22602 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:19:42.545452 22447 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.572556 22447 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:42.575793 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.577793 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:42.536015 22767 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:42.580058 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.580271 22767 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.581329 22770 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:42.581717 22770 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:42.582082 22770 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.582603 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.584161 22810 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.550184 22709 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.554612 22423 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.565295 22854 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.586241 22694 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:42.554503 22464 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:42.589244 22464 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:42.589629 22464 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.564966 22320 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.593176 22777 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.593822 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.595160 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.595623 22320 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.596051 22320 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.596246 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.593856 22777 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.598021 22777 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.599123 19145 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:42.600745 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 558) took 1884 ms. Trace:
I20260709 13:19:42.601150 19742 rpcz_store.cc:276] 0709 13:19:40.716730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.716835 (+   105us) service_pool.cc:224] Handling call
0709 13:19:40.717130 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.433422 (+716292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.600537 (+1167115us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400685454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:42.600690 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627377920}
I20260709 13:19:42.603521 19141 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:42.604143 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:42.603781 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.605079 19217 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:42.605258 19145 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:42.606613 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:42.607474 22853 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.607883 22853 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.608212 22853 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.608938 22467 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:42.609431 22467 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:42.610404 22467 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:42.580790 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.615134 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.615845 22723 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.616487 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.617264 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:42.618137 19065 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:42.603410 19138 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.624527 22858 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:42.625327 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1727) took 1287 ms. Trace:
I20260709 13:19:42.626446 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.649590 19063 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:42.628301 19065 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:42.628688 19212 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:42.629191 19717 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.629305 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.652658 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:42.601410 22447 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.632380 19138 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:42.620667 22689 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:42.634693 22770 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.635098 19143 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:42.636327 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.637394 22777 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.638100 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.681810 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.638213 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.639278 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.683589 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.639407 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.648803 22467 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.690773 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.691210 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:42.640691 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.692430 19141 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:42.653292 19742 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:42.649641 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:42.653582 19220 rpcz_store.cc:276] 0709 13:19:41.338419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.339094 (+   675us) service_pool.cc:224] Handling call
0709 13:19:42.625129 (+1286035us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001d6854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:42.625255 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337242368}
W20260709 13:19:42.693214 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 43662.2us
W20260709 13:19:42.693976 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 130501us
I20260709 13:19:42.694682 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:42.694809 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:42.660816 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.668227 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:42.684702 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 45367.6us
I20260709 13:19:42.640105 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:42.689919 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:42.691386 19138 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:42.690562 19065 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.700428 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1738) took 1074 ms. Trace:
I20260709 13:19:42.660684 22694 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.697126 19071 raft_consensus.cc:2376] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11. Re-sending same reply.
I20260709 13:19:42.700817 19218 rpcz_store.cc:276] 0709 13:19:41.626198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.644535 (+ 18337us) service_pool.cc:224] Handling call
0709 13:19:42.700259 (+1055724us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54001d6354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:42.700377 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241498496}
I20260709 13:19:42.564811 22847 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:19:42.702996 19214 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:42.701841 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:42.701977 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 142778us
I20260709 13:19:42.707520 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:42.708165 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.711609 19038 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:42.680680 22765 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.710465 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:42.757076 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.689576 22789 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:42.710140 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.712754 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:42.760924 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.704137 22808 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.763911 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:42.765151 19144 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:42.704630 22850 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:42.769043 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58634.7us
I20260709 13:19:42.717171 22777 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.770766 19066 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:42.770996 19212 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:42.788511 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:42.771548 22476 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.771559 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.797051 22476 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.797415 19069 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:42.797544 22476 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:42.763648 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1903) took 1048 ms. Trace:
I20260709 13:19:42.798441 19213 rpcz_store.cc:276] 0709 13:19:41.715664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.280165 (+564501us) service_pool.cc:224] Handling call
0709 13:19:42.280506 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.280745 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:42.430816 (+150071us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.763107 (+332291us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.763296 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:42.763342 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:42.763388 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.763448 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.763595 (+   147us) inbound_call.cc:177] Queueing success response
0709 13:19:42.778707 (+ 15112us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b1800481b40. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
Metrics: {"prepare.queue_time_us":53401,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":6010,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":57636,"spinlock_wait_cycles":14077824,"thread_start_us":277356,"threads_started":1}
I20260709 13:19:42.801260 19743 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:42.758679 22755 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:42.773025 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 60338us
I20260709 13:19:42.804324 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:42.710963 22456 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:42.684193 22689 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.708642 22517 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:19:42.703792 22669 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:19:42.760423 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.781085 22423 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:42.781649 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.762852 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.802498 22850 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:42.715086 22760 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.795234 19144 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:19:42.858294 19144 pending_rounds.cc:85] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 6
I20260709 13:19:42.858564 19144 pending_rounds.cc:107] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:42.858783 19144 raft_consensus.cc:2889] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.796355 22854 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:42.774078 22865 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:19:42.806211 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:42.808634 19220 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:42.690333 22859 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:19:42.814555 19141 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:42.815356 22476 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.817232 22840 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:42.817862 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:42.825055 18965 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 8, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 8 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.789745 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.708249 22820 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:19:42.771118 22415 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.769296 22839 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.806046 22777 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:42.861299 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 110694us
W20260709 13:19:42.866416 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 162418us
I20260709 13:19:42.831117 22808 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.901849 19067 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:42.850641 22456 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:42.792356 22694 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:19:42.863495 22850 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:42.915153 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.834441 22846 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.930414 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.812130 22827 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:19:42.863193 22760 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.001094 22760 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.868026 22826 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.005393 22826 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:43.007927 22826 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:43.017874 22868 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:43.019411 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2043) took 1461 ms. Trace:
I20260709 13:19:43.019832 19142 rpcz_store.cc:276] 0709 13:19:41.557672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.557820 (+   148us) service_pool.cc:224] Handling call
0709 13:19:41.566868 (+  9048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.567184 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.567208 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.579128 (+1011920us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b2c0005c228. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:19:42.579603 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.782030 (+202427us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:42.782067 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.782137 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.019023 (+236886us) raft_consensus.cc:1685] finished
0709 13:19:43.019047 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.019342 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":357,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":16513920,"thread_start_us":201979,"threads_started":1,"wal-append.queue_time_us":290188}
I20260709 13:19:42.931578 22789 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:19:42.932654 22602 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.932405 22775 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:42.964609 22858 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:42.912364 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 94570.1us
I20260709 13:19:43.038663 22456 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.039970 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:43.041674 19142 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:43.041877 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:42.965839 22865 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:43.045425 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2044) took 1487 ms. Trace:
I20260709 13:19:43.045849 19139 rpcz_store.cc:276] 0709 13:19:41.558006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.560190 (+  2184us) service_pool.cc:224] Handling call
0709 13:19:41.581261 (+ 21071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.615969 (+ 34708us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:41.652227 (+ 36258us) log.cc:844] Serialized 14 byte log entry
0709 13:19:42.519146 (+866919us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b18003839e0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:19:42.564402 (+ 45256us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:42.668201 (+103799us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.677063 (+  8862us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:42.677117 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.677214 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.045102 (+367888us) raft_consensus.cc:1685] finished
0709 13:19:43.045217 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.045359 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4680,"prepare.queue_time_us":36090,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":30469,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":3401,"spinlock_wait_cycles":48679168,"thread_start_us":45045,"threads_started":1,"wal-append.queue_time_us":1015965}
I20260709 13:19:43.049590 22872 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:42.955350 22850 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.861027 22423 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.941098 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.943042 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.946849 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.951303 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.908075 22741 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:43.059006 22741 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:43.059526 22741 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.957080 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:42.957501 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.907754 22723 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.911028 22840 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:43.065853 22517 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.066447 22517 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:42.977973 22751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42930 (request call id 551) took 3760 ms. Trace:
I20260709 13:19:43.072154 22751 rpcz_store.cc:276] 0709 13:19:39.237055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.254049 (+ 16994us) service_pool.cc:224] Handling call
0709 13:19:40.371513 (+1117464us) ts_tablet_manager.cc:934] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
0709 13:19:42.291560 (+1920047us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:42.525393 (+233833us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:42.525518 (+   125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:42.947807 (+422289us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:42.977384 (+ 29577us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:42.977784 (+   400us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:42.977860 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":40435,"tablet-copy.queue_time_us":1031070,"thread_start_us":1091143,"threads_started":2}
I20260709 13:19:43.073998 22751 tablet_copy_client.cc:806] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:43.074677 22751 tablet_copy_client.cc:670] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:42.979024 22770 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:42.979759 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:42.962558 22819 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:43.076224 22819 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:42.993669 19744 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:42.924183 22777 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.078905 22800 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:43.079401 22800 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:19:43.087497 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.997025 22689 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:43.106078 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.107466 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69635.2us
I20260709 13:19:43.116227 19742 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:43.080411 22800 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:43.123404 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:43.124187 19743 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:43.126159 22820 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:43.127836 22808 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:43.137669 22775 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:43.142390 22709 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:43.142954 22709 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:43.143280 22839 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:43.143936 22839 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.147744 22800 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.142370 22767 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:43.149978 22767 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.150557 19220 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:43.152442 22767 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.153417 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:43.159114 22423 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.158860 22839 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:42.911520 22415 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:43.172279 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 57178.7us
I20260709 13:19:43.217849 19146 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:43.178690 19070 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:43.068817 18965 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.185281 22819 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:43.033370 22602 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:43.191216 22320 consensus_meta.cc:287] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
W20260709 13:19:43.192342 22834 consensus_meta.cc:287] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.002s
W20260709 13:19:43.194954 22853 consensus_meta.cc:287] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.001s
I20260709 13:19:43.263052 22853 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.264307 19072 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:43.195796 22840 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:43.202951 22476 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:43.143972 22709 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:43.213153 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:43.270372 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:43.213646 22517 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:43.239238 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.226437 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.281023 19146 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:43.283483 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:43.284132 19143 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:43.218674 19217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.059s	sys 0.106s
I20260709 13:19:43.234267 22694 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:43.244167 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:43.247817 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:43.247841 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.255051 19147 raft_consensus.cc:606] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:43.289007 19147 raft_consensus.cc:614] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:43.217545 22415 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.258113 22767 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:43.259800 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 453643us
I20260709 13:19:43.266949 19140 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:43.275374 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:43.285152 19217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.063s	sys 0.106s
I20260709 13:19:43.258795 22819 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:43.290059 19145 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:43.295089 19145 pending_rounds.cc:85] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 4
I20260709 13:19:43.293807 19038 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:43.295459 19145 pending_rounds.cc:107] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:43.295841 19145 raft_consensus.cc:2889] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:43.293722 19068 raft_consensus.cc:2393] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:43.294304 19067 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:43.299336 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:43.300668 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 46643.3us
I20260709 13:19:43.302520 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:43.304216 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:43.306422 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:43.297617 19035 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:43.255102 22320 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.308774 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:43.313366 19140 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:43.311434 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:43.310515 19143 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
W20260709 13:19:43.297377 22464 consensus_meta.cc:287] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 13:19:43.316486 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:43.308012 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:43.317595 19067 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.314822 22467 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:43.310882 22689 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:43.296828 22709 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.323521 22689 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:43.235167 22777 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.324393 22689 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.326442 22777 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.322119 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:43.311102 22817 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:43.329900 22817 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.330317 22817 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.338325 19143 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:43.341174 22817 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:43.342224 22320 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.342746 22846 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:43.343155 22846 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:43.343300 22817 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.343551 22846 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.344559 22847 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:43.345113 22847 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:43.345955 22847 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.319649 22476 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:19:43.353339 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.355829 22839 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:43.321319 22517 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:43.357396 22517 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:43.358264 22517 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:43.360177 18970 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60514 (request call id 220) took 26259 ms (client timeout 15000 ms). Trace:
I20260709 13:19:43.362458 18965 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 6 to 7, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 7 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.321633 22467 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.365407 22467 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.367583 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:43.258610 22820 consensus_queue.cc:1175] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f833abfb3544031bee566e655b7fedc" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 11 index: 9 } }
W20260709 13:19:43.373585 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65664.1us
I20260709 13:19:43.374550 19072 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:43.368664 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:43.377239 19145 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.380091 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:43.303355 22853 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.382984 19140 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:43.383955 22712 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:43.296245 22694 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:43.386480 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 455395us
I20260709 13:19:43.321162 22423 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.311297 22826 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:19:43.390475 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:43.614305 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 223909us
I20260709 13:19:43.615538 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:43.360577 18970 rpcz_store.cc:269] 0709 13:19:17.101107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.113096 (+ 11989us) service_pool.cc:224] Handling call
0709 13:19:43.360104 (+26247008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:40.236597 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:40.379039 (+142442us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:40.388112 (+  9073us) write_op.cc:435] Acquired schema lock
0709 13:19:40.389815 (+  1703us) tablet.cc:662] Decoding operations
0709 13:19:40.465115 (+ 75300us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:40.465200 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:40.465226 (+    26us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:19:40.466818 (+  1592us) tablet.cc:701] Row locks acquired
0709 13:19:40.466864 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:19:40.467030 (+   166us) write_op.cc:270] Start()
0709 13:19:40.467173 (+   143us) write_op.cc:276] Timestamp: P: 1783603180466969 usec, L: 0
0709 13:19:40.467189 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:19:40.467923 (+   734us) log.cc:844] Serialized 7106 byte log entry
0709 13:19:41.938254 (+1470331us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180030df00. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:19:42.188532 (+250278us) op_driver.cc:464] REPLICATION: finished
0709 13:19:42.361546 (+173014us) write_op.cc:301] APPLY: starting
0709 13:19:42.370400 (+  8854us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:42.419339 (+ 48939us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:42.423775 (+  4436us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:42.489682 (+ 65907us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:42.490037 (+   355us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:19:42.490081 (+    44us) write_op.cc:312] APPLY: finished
0709 13:19:42.490489 (+   408us) log.cc:844] Serialized 125 byte log entry
0709 13:19:42.490667 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:42.490836 (+   169us) write_op.cc:454] Released schema lock
0709 13:19:42.490903 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:42.491318 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:42.491350 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2555160,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":145652,"apply.run_cpu_time_us":5668,"apply.run_wall_time_us":131737,"num_ops":18,"prepare.queue_time_us":743723,"prepare.run_cpu_time_us":25587,"prepare.run_wall_time_us":484249,"raft.queue_time_us":229993,"raft.run_cpu_time_us":92100,"raft.run_wall_time_us":130821,"replication_time_us":1713154,"spinlock_wait_cycles":25309184,"thread_start_us":896079,"threads_started":4,"wal-append.queue_time_us":235772}]]}
I20260709 13:19:43.298434 22767 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.395735 19072 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:43.399619 22846 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:43.400540 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 335362us
I20260709 13:19:43.364291 18965 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.315147 22873 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:19:43.404233 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:43.638167 19070 raft_consensus.cc:2410] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:19:43.589730 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 283341us
I20260709 13:19:43.591725 19140 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:19:43.465689 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.585619 22467 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:43.414167 22867 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:43.533494 19064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.003s	sys 0.007s
I20260709 13:19:43.370277 22464 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:43.605741 22741 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.004s
W20260709 13:19:43.648434 19064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.004s	sys 0.008s
I20260709 13:19:43.649351 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1880) took 1031 ms. Trace:
I20260709 13:19:43.609220 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51744 (request call id 27) took 1031 ms. Trace:
I20260709 13:19:43.650904 19147 rpcz_store.cc:276] 0709 13:19:42.577482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.577683 (+   201us) service_pool.cc:224] Handling call
0709 13:19:43.609027 (+1031344us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400121454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103584853 00007f610855260a 00007f6101ad87d4 00007f6101ad8762 00007f6101ad8691 00007f6101ad860c 00007f6101ad78c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:43.609133 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556228864}
I20260709 13:19:43.624260 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:43.627653 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:43.589213 22760 consensus_meta.cc:287] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.001s
I20260709 13:19:43.639511 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:43.649724 19064 rpcz_store.cc:276] 0709 13:19:42.618083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.619027 (+   944us) service_pool.cc:224] Handling call
0709 13:19:42.619281 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.619459 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:42.619724 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.648996 (+1029272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.649058 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:43.649109 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.649183 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.649295 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2194,"prepare.queue_time_us":500,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":43684,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":19977,"thread_start_us":1026641,"threads_started":2,"wal-append.queue_time_us":430488}
I20260709 13:19:43.644074 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:43.617915 22447 consensus_meta.cc:287] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.941s	user 0.012s	sys 0.012s
I20260709 13:19:43.680249 19067 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:43.682288 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:43.661056 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.643121 19145 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:43.618259 22517 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.684419 22447 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.695729 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:43.688465 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.701728 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 74178.2us
I20260709 13:19:43.702425 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:43.629065 22712 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.688936 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:43.648434 22850 consensus_meta.cc:287] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.008s
I20260709 13:19:43.718458 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:43.724457 19145 raft_consensus.cc:2368] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
I20260709 13:19:43.727844 19071 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:43.710167 22517 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.653587 22839 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.737589 19141 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:43.680511 22877 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:43.633071 22423 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.698035 22602 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.698254 22760 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:43.732400 22778 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:43.698385 22476 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:43.680754 22867 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.648451 22820 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:19:43.750809 19067 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.709939 22840 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:19:43.716918 22713 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:43.761399 22871 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:43.733206 22847 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:43.687798 22741 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:43.772739 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 128738us
I20260709 13:19:43.731936 22775 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:43.823058 22751 tablet_copy_client.cc:538] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:43.823150 22775 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.791561 19064 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.751590 22862 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:43.717240 22834 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:43.766836 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 151376us
W20260709 13:19:43.805995 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 102052us
I20260709 13:19:43.806564 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:43.830575 19067 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:43.830618 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:43.818545 19139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:43.831631 19139 raft_consensus.cc:606] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:43.736670 22850 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.833156 22775 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:43.838685 19064 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:43.793128 22476 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.842494 22476 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.853737 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:43.854202 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:43.863286 19067 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:43.864261 19218 raft_consensus.cc:2410] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:43.863143 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:43.865202 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:43.866912 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:43.868150 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:43.865806 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:43.805285 22713 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:43.886386 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:43.887545 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:43.888034 22846 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.888322 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:43.888510 19063 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:43.889056 22884 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:43.889164 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:43.889494 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:43.779422 22839 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:43.881585 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:43.868738 19067 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:43.884503 19216 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:43.884992 19219 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.889539 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:44.017830 19063 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.019083 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.019714 19065 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:44.021036 22467 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.021488 19215 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.020596 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.022761 19065 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:43.707012 18965 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 5 to 6, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 6 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.023471 19216 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:19:43.861049 22415 consensus_meta.cc:287] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.005s
I20260709 13:19:43.916482 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:43.889871 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:43.839479 22808 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:44.044212 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 327879us
I20260709 13:19:44.026286 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.050928 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.027529 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:44.022746 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.035169 19072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:19:43.890815 19070 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:43.929080 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:43.957736 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:44.031281 19218 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 7: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:44.038074 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 289708us
I20260709 13:19:44.020918 19219 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.925952 22751 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:19:43.847966 22862 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:44.025401 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.061319 19220 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:44.060860 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.062366 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.022199 22517 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:43.926860 22879 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
W20260709 13:19:43.992203 22819 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.005s
W20260709 13:19:43.920394 22891 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:19:43.921990 22888 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:19:43.929694 22834 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:43.921438 22895 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:43.898330 22712 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.022262 22447 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.058597 22839 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:43.897003 22713 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.891219 22878 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.110685 19221 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:44.079842 22775 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.015362 22694 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:44.024156 22871 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.926178 22741 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.919759 22464 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:43.867447 22602 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.201s
I20260709 13:19:43.954879 22877 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.128708 19221 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:44.129222 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.094954 19184 leader_election.cc:400] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
I20260709 13:19:44.058503 22767 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.059861 22820 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.060204 22456 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:43.929356 22320 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:19:44.084116 22689 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:44.071441 19110 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.828s (SENT)
I20260709 13:19:44.169646 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.067884 22900 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:44.043874 22415 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.065114 22808 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.129946 19184 leader_election.cc:403] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:44.103156 22904 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:44.168236 19063 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:44.017848 22423 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.120750 22846 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.103533 22819 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:19:44.175786 19072 raft_consensus.cc:606] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.181370 19072 raft_consensus.cc:614] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:44.176262 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 104859us
I20260709 13:19:44.128331 22871 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.129863 22867 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.112648 22834 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:44.177989 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 83213.3us
I20260709 13:19:44.131543 22877 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.130872 22760 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.167320 22741 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.140777 22778 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:44.124567 22903 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.125072 22775 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.206736 19220 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:19:44.208062 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 346628us
I20260709 13:19:44.208457 19066 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:44.217733 19221 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:44.169778 22820 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.268458 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.277444 19068 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.315945 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.317157 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:44.316902 22712 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:44.318181 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.319187 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:44.320142 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.279625 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.321816 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.284868 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.181857 22767 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:44.322126 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 44456.7us
I20260709 13:19:44.323737 22767 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:44.289866 19035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.050s
W20260709 13:19:44.324451 19035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.013s	sys 0.051s
W20260709 13:19:44.324781 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 629066us
W20260709 13:19:44.297744 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.300237 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.324198 22767 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:44.330137 22767 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.331509 22767 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.332012 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:44.301467 19138 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:44.322430 19067 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:44.333503 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:44.333725 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:44.334457 19138 raft_consensus.cc:2368] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:44.334836 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:44.302901 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:44.303249 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.336431 19141 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:44.304111 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.267336 22689 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.302196 22887 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.305114 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.184198 22846 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.215714 22423 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:19:44.304591 22840 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.340315 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.320667 19068 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:44.271670 22867 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:44.344241 19138 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:19:44.405630 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 43999.4us
I20260709 13:19:44.185643 22862 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:19:44.398263 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 93222.6us
I20260709 13:19:44.323237 22712 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:44.312839 22839 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
W20260709 13:19:44.423911 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 83660.2us
I20260709 13:19:44.310364 22741 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.182029 18965 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.405310 22517 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.447821 19215 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:44.357493 22689 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.409612 22800 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:44.339140 22903 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:44.445634 22826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:19:44.423682 22712 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:44.364421 22887 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.411258 22840 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.442355 22694 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.430116 22917 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:44.458755 22834 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.478147 22415 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.458830 22808 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:44.464370 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 195983us
I20260709 13:19:44.427217 22819 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:44.471948 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:44.471997 22826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.012s	sys 0.000s
I20260709 13:19:44.417891 22916 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:19:44.418195 22867 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.442592 22912 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:44.458789 22820 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:44.487504 22887 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:44.481580 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.472669 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:44.491215 19220 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:44.449110 22873 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:44.511862 22873 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:44.512212 22873 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:44.513087 22873 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.514264 22873 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.454977 22760 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:44.473227 22712 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.524214 22712 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.481138 22694 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.538137 22694 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:44.503806 22476 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.634s	user 0.005s	sys 0.005s
I20260709 13:19:44.538882 22476 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.540843 22476 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:44.545751 22926 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:44.441967 22778 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.547413 22712 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.506191 22846 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.509476 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:44.511030 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:44.557698 19220 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.558172 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.558764 19221 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:44.559494 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:44.560003 19221 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.497310 18965 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 1 to 5, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 5 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:44.526430 22903 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.527925 22840 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:44.528680 22914 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:19:44.529053 22871 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:44.529274 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48433us
I20260709 13:19:44.529912 22931 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.530159 22741 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.531520 22689 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.573333 19221 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:44.540676 22867 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.584221 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:44.579202 19220 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:44.581431 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.586229 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.586395 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.594198 19070 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:44.585888 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.595113 19068 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:44.580557 22476 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.601236 22476 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.594412 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.604468 19113 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:44.606577 18965 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:44.608302 22919 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:44.608825 22919 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.590106 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.609306 22919 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.609642 19221 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:44.610527 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.609022 22903 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:44.611393 22903 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:44.617774 22476 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.612494 22903 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.611073 19221 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 6.
I20260709 13:19:44.621153 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:44.625568 19221 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:44.625972 22878 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
I20260709 13:19:44.582331 22913 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.627550 22913 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:44.629630 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 208860us
W20260709 13:19:44.618937 19066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2024) took 1683 ms (client timeout 2119 ms). Trace:
W20260709 13:19:44.630586 19066 rpcz_store.cc:269] 0709 13:19:42.935746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.935900 (+   154us) service_pool.cc:224] Handling call
0709 13:19:44.618702 (+1682802us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400036954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:44.618864 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592485632}
W20260709 13:19:44.631693 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 202904us
I20260709 13:19:44.626459 22878 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:44.632263 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50888.4us
I20260709 13:19:44.636150 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:44.637342 22939 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.637539 22689 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.637822 22712 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:44.637935 22939 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.638351 22712 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.638906 22712 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.638283 22689 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.640127 22939 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.640974 22689 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.641149 22939 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:44.637696 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.643816 22456 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.643919 19035 leader_election.cc:400] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:44.644294 19035 leader_election.cc:403] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:44.632380 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.645929 19220 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:44.633113 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:44.634893 19071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 1890) took 1929 ms (client timeout 1571 ms). Trace:
I20260709 13:19:44.635049 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:44.647223 19071 rpcz_store.cc:269] 0709 13:19:42.705039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.705165 (+   126us) service_pool.cc:224] Handling call
0709 13:19:44.634693 (+1929528us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b5400057b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:44.634818 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207110400}
I20260709 13:19:44.647742 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:44.653270 19221 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:44.637485 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.658941 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:44.661432 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2079) took 1369 ms. Trace:
I20260709 13:19:44.663955 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.668629 19220 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:44.669894 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:44.666574 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:44.668248 19140 rpcz_store.cc:276] 0709 13:19:43.291603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.707612 (+416009us) service_pool.cc:224] Handling call
0709 13:19:43.742648 (+ 35036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.762783 (+ 20135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.762826 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.763371 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.471193 (+707822us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18002dbc80. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:19:44.577236 (+106043us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:44.577294 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.577395 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.645298 (+ 67903us) raft_consensus.cc:1685] finished
0709 13:19:44.645320 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.661371 (+ 16051us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29662,"spinlock_wait_cycles":43222144,"thread_start_us":105819,"threads_started":1,"wal-append.queue_time_us":870352}
I20260709 13:19:44.634263 22867 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:44.646286 22817 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.693385 22930 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:44.693933 22878 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:44.661373 22713 consensus_meta.cc:287] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 13:19:44.708815 22517 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.663604 22476 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.723289 22850 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.649485 22741 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.646556 18965 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.776832 18965 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:44.778626 22775 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:44.778424 18965 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 4 to 6, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 6 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:44.779892 18965 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.662606 22931 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:44.743036 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 108048us
I20260709 13:19:44.781160 22931 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:44.781584 22931 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.782963 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.783727 22775 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:44.662850 22767 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:44.743391 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 105979us
I20260709 13:19:44.784642 22767 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:44.785094 22767 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.787292 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.747303 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.756345 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.789275 19145 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:44.789954 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:44.790355 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.791071 19145 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:44.756850 19147 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:44.764897 19069 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:44.780715 22817 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:44.797510 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:44.784991 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:44.744446 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:44.799085 19743 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:44.788165 22923 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:44.747217 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:44.803472 19140 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:44.790146 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:44.795869 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.806797 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:44.820763 19110 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:44.823648 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:44.824240 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.824388 19070 raft_consensus.cc:2376] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11. Re-sending same reply.
I20260709 13:19:44.826632 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:44.826903 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.827163 19070 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.837682 19067 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.797128 22867 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:44.826632 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:44.803201 22887 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:44.844089 22887 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.844650 22887 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.844801 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.845556 19071 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:44.846928 19221 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.766166 22713 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.772786 22741 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.850939 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.854718 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.859090 19063 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:44.859463 19066 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:44.855070 19038 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.798569 22912 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:44.846930 22834 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.860308 22834 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:44.860735 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.856722 22929 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:44.856726 22817 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:44.855336 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:44.862370 22834 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.862911 22834 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:44.863379 22834 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.863770 22929 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.862385 22817 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.864565 22929 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:44.865026 22878 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:44.865890 22929 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:44.866205 22817 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.866334 22929 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.863821 22456 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:44.868342 22456 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:44.868677 22456 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:44.846971 22903 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:44.869645 22903 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:44.869904 22877 consensus_meta.cc:287] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:19:44.870045 22903 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.870313 22877 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.872252 22877 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.873731 22929 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.874346 22850 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:44.874774 22850 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.875236 22850 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.876019 22929 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.842499 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:44.848392 22923 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:44.876849 22923 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:44.877274 22923 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.840839 22775 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:44.881767 22775 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.827842 22936 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:44.882154 22775 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.874770 22887 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.884236 22887 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.857319 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.797297 22476 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:44.885854 22476 consensus_queue.cc:1243] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:44.838673 22778 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:44.886059 22767 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:44.885519 22850 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.887219 22931 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.888059 22778 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:44.887565 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 45159.5us
I20260709 13:19:44.888414 22850 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:44.892536 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.770304 22517 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.895104 19110 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.896081 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.903896 19138 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:44.904182 19140 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:19:44.896903 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.905004 19147 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:44.901331 19070 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:44.915931 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:44.931303 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:44.931919 19744 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.933002 22916 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.933492 22916 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:44.935614 22916 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:44.937223 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:44.938868 19216 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.939086 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.940768 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:44.941360 19749 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:44.941979 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:44.942658 19744 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:44.942726 19147 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:44.944417 19742 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:44.944542 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.945308 19071 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:44.888463 22778 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:44.969978 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:44.953445 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 98177.9us
W20260709 13:19:44.969647 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 106292us
I20260709 13:19:44.971444 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.854349 22846 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:19:44.916093 22939 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:44.974769 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:44.917670 22912 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.999265 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:44.957779 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:44.917938 22826 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:44.998976 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:45.001255 19110 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:44.938402 22800 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:44.915429 22887 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.951141 22819 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:45.006311 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:45.009610 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:45.010263 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:44.954054 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:44.971915 22778 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.014180 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.025667 19145 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:45.014773 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:44.943197 22916 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.024334 19751 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:45.029321 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:45.018460 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:45.027565 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:45.023236 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:45.024248 22819 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.953037 22906 consensus_queue.cc:1059] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:19:45.036114 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:45.032898 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:45.021373 19749 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:45.019608 22880 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:45.037087 19138 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:45.072184 22880 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:45.019487 22826 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:45.072685 22880 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.071969 22423 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:45.042816 22819 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.073359 22423 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:45.074644 19742 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:45.074193 22423 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.028934 22873 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.074801 22826 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.075379 22423 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.025182 22887 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.033818 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.078821 19145 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:45.013306 22800 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:45.079228 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 45490.8us
I20260709 13:19:45.079746 22906 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.043380 22916 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:45.082463 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 83583.8us
I20260709 13:19:45.081910 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:45.083163 19744 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:19:45.023929 22669 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:45.081251 22800 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.083775 22669 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:45.084780 19110 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:45.085577 22906 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.085675 22669 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.086279 22906 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:45.086834 22906 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:45.087216 22906 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.088004 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:44.952622 22936 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:19:44.983523 22939 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.093957 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.004973 22415 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:19:45.004057 22929 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:19:45.091763 22897 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.228s	user 0.005s	sys 0.001s
I20260709 13:19:45.004290 22913 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:45.112718 22913 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.113224 22913 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.115123 22913 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:45.115821 22913 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:45.116163 22913 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.116485 22913 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.117640 22873 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.124683 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:45.125348 19216 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:45.126510 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:45.127903 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 502) took 1384 ms. Trace:
W20260709 13:19:45.131364 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 121175us
I20260709 13:19:45.092917 22767 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.132725 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:45.099403 22927 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:45.135710 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.137466 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.010741 22912 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.015815 22919 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.024937 22712 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.174324 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:45.224706 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 50476.1us
I20260709 13:19:45.226284 22939 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.226735 22880 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.170496 22948 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.211858 22953 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.212931 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.211199 22955 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:45.214959 22906 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.215590 22912 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:45.216707 19140 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:45.109620 22947 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.132320 19217 rpcz_store.cc:276] 0709 13:19:43.743767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.743889 (+   122us) service_pool.cc:224] Handling call
0709 13:19:43.770046 (+ 26157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.770243 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:44.898039 (+1127796us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b18003c7480. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6106f823c7 00007f61035949a7 00007f61035a40bf
0709 13:19:44.898193 (+   154us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.127573 (+229380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.127625 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:45.127673 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.127739 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.127843 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":352040,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":114451,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":11218304,"thread_start_us":596266,"threads_started":3,"wal-append.queue_time_us":206069}
I20260709 13:19:45.217867 22741 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:45.216737 22903 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.138224 22927 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:45.225442 22929 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.228696 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:45.145511 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:45.210330 22950 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:45.270175 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.129742 22694 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:45.265972 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:45.268445 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:45.185330 22938 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 13:19:45.286155 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 140676us
I20260709 13:19:45.138674 22689 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:45.232764 22817 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:19:45.263840 22517 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:45.230819 22923 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.266968 22741 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.298040 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.285132 22415 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:45.306146 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:45.306551 19216 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.303705 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.270017 22929 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:45.309655 19068 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:45.316416 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.317668 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.270988 22955 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:45.287464 22952 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.297813 22694 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.325357 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:45.329982 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.328104 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:45.331272 19748 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:45.334265 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.313190 22939 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.325132 22929 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.326434 22935 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.256572 22948 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.335150 22694 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.334059 22689 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:45.344823 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.332203 22936 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.374948 19068 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:45.342133 22954 raft_consensus.cc:2764] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:45.379703 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.342063 22957 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.345814 22415 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:45.385241 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.365592 22964 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.320775 22741 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:45.394012 22956 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:45.418900 22948 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.397312 22689 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.397684 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.421301 19070 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:45.398525 22415 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.399921 22847 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:45.400625 22928 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:45.402467 22456 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.387590 22912 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.412565 22751 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:45.412629 22906 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:45.376631 22927 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.422802 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:45.422900 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.427796 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.449731 19068 raft_consensus.cc:2393] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:45.430528 22800 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.432227 22751 tablet_bootstrap.cc:492] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:19:45.434432 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:45.435734 22882 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.635s	user 0.001s	sys 0.003s
W20260709 13:19:45.436690 22886 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.338s	user 0.005s	sys 0.000s
W20260709 13:19:45.437866 22775 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.002s
I20260709 13:19:45.438177 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:45.456403 19063 raft_consensus.cc:2376] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12. Re-sending same reply.
I20260709 13:19:45.440162 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2055) took 1529 ms. Trace:
I20260709 13:19:45.457374 22751 ts_tablet_manager.cc:1403] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 1.532s	user 0.050s	sys 0.021s
I20260709 13:19:45.426894 22928 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:45.419358 22741 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:45.404770 22819 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.446916 22903 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.450822 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.451231 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.454020 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.425056 22847 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:45.457178 19065 rpcz_store.cc:276] 0709 13:19:43.911307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.027307 (+116000us) service_pool.cc:224] Handling call
0709 13:19:45.439964 (+1412657us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54003a07d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:45.440107 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560830208}
I20260709 13:19:45.449724 22964 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:45.457634 22775 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.465260 19743 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.486686 22928 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.497913 22847 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.498545 22928 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.499042 22847 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.502337 22800 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.502952 22834 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.503007 22800 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:45.495198 22694 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:45.505723 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1764) took 1647 ms (client timeout 2106 ms). Trace:
I20260709 13:19:45.468196 22964 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.506356 22964 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:45.506139 19215 rpcz_store.cc:269] 0709 13:19:43.858764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.887310 (+ 28546us) service_pool.cc:224] Handling call
0709 13:19:45.505534 (+1618224us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002693d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:45.505664 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306814720}
I20260709 13:19:45.507522 19221 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:45.506695 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 365) took 2338 ms. Trace:
I20260709 13:19:45.503752 22800 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.454993 22935 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:45.508464 19144 rpcz_store.cc:276] 0709 13:19:43.168304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.170742 (+  2438us) service_pool.cc:224] Handling call
0709 13:19:43.171131 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.252971 (+ 81840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.253015 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.262539 (+  9524us) log.cc:844] Serialized 26 byte log entry
0709 13:19:43.535523 (+272984us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:43.535574 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.535651 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.436113 (+1900462us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:45.506400 (+ 70287us) raft_consensus.cc:1685] finished
0709 13:19:45.506420 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.506623 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89717,"raft.queue_time_us":85313,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":7038,"spinlock_wait_cycles":77942144,"thread_start_us":220364,"threads_started":1,"wal-append.queue_time_us":709418}
I20260709 13:19:45.509514 22751 raft_consensus.cc:359] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:45.417553 22955 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.506625 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:52590 (request call id 11) took 1524 ms. Trace:
I20260709 13:19:45.468742 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:45.512485 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1953) took 1031 ms. Trace:
I20260709 13:19:45.518949 19221 rpcz_store.cc:276] 0709 13:19:44.481399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.847988 (+366589us) service_pool.cc:224] Handling call
0709 13:19:45.507285 (+659297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.507911 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.512246 (+  4335us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54002693d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:45.512413 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515396352}
I20260709 13:19:45.516924 19072 rpcz_store.cc:276] 0709 13:19:43.982542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.035052 (+ 52510us) service_pool.cc:224] Handling call
0709 13:19:45.506452 (+1471400us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400209754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103584853 00007f610855260a 00007f6101ad87d4 00007f6101ad8762 00007f6101ad8691 00007f6101ad860c 00007f6101ad78c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:45.506537 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275055360}
W20260709 13:19:45.521039 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52390.5us
I20260709 13:19:45.522106 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.545264 19072 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:45.522570 22803 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:45.525058 19184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 2.231s (SENT) [suppressed 38 similar messages]
I20260709 13:19:45.525621 22800 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.525887 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:45.546432 19070 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:45.527232 22694 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.529997 22775 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:45.530125 22887 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:45.530946 22778 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.532481 22913 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.533139 22862 raft_consensus.cc:3055] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:45.539484 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:45.549472 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:45.487641 22819 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:45.558192 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.643370 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:45.630079 19745 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.654749 19147 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.550104 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.619141 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:45.652808 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.658790 19744 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:45.598939 19748 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:19:45.657063 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.467835 22957 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.550730 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:45.663247 19072 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:45.599478 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:45.658131 19144 raft_consensus.cc:2393] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:45.663770 19145 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:45.599476 22912 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.664361 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.617322 22803 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:45.666697 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:45.516685 22751 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:19:45.665176 19747 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:45.665815 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:45.653949 22862 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:45.669683 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:45.671087 19746 raft_consensus.cc:2368] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:19:45.670456 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:45.667352 19749 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:45.672071 19072 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.677449 19110 leader_election.cc:400] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:19:45.677841 19110 leader_election.cc:403] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:45.630514 22929 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.682546 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.694016 22913 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:45.694703 22778 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:45.697584 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:45.698129 19747 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.701622 19072 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:45.701181 22862 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.702575 22862 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.702678 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.703471 19072 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:45.703521 22953 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.704339 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.695990 22751 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:45.716253 22713 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.726223 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.726279 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.734954 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:45.736661 19068 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.738837 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1758) took 1068 ms. Trace:
I20260709 13:19:45.740700 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.757385 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1756) took 1088 ms. Trace:
I20260709 13:19:45.757699 19142 rpcz_store.cc:276] 0709 13:19:44.668829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.671084 (+  2255us) service_pool.cc:224] Handling call
0709 13:19:45.740540 (+1069456us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:45.757332 (+ 16792us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23444224}
I20260709 13:19:45.741179 22803 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.720703 22929 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:45.760675 19069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2047) took 1874 ms (client timeout 1747 ms). Trace:
W20260709 13:19:45.729941 22898 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.616s	user 0.001s	sys 0.005s
W20260709 13:19:45.761085 19069 rpcz_store.cc:269] 0709 13:19:43.886525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.888968 (+  2443us) service_pool.cc:224] Handling call
0709 13:19:45.760499 (+1871531us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540025dd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:45.760608 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440643840}
I20260709 13:19:45.762557 19069 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:45.764478 19064 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:45.745298 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.751317 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:45.765569 19070 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:45.756306 19141 rpcz_store.cc:276] 0709 13:19:44.670374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.670832 (+   458us) service_pool.cc:224] Handling call
0709 13:19:45.738088 (+1067256us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:45.738306 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.738497 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.738527 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.738571 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:45.738613 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.738671 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.738781 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21786496}
I20260709 13:19:45.724423 19145 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:45.730257 22919 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.766956 22927 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:19:45.767287 22751 ts_tablet_manager.cc:1434] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.310s	user 0.012s	sys 0.003s
I20260709 13:19:45.771215 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2077) took 2480 ms. Trace:
I20260709 13:19:45.771531 22929 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:45.772251 22929 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.771462 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1761) took 1025 ms. Trace:
I20260709 13:19:45.774058 19146 rpcz_store.cc:276] 0709 13:19:44.746255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.746454 (+   199us) service_pool.cc:224] Handling call
0709 13:19:45.770705 (+1024251us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b5800190298. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f6108563fc0 00007f610854e929 00007f610854e3d2 00007f6101ac5bd4
0709 13:19:45.770922 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.771129 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.771176 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.771227 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:45.771270 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.771320 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.771412 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22183168}
I20260709 13:19:45.752259 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.733738 19072 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:45.771646 19143 rpcz_store.cc:276] 0709 13:19:43.291031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.339348 (+ 48317us) service_pool.cc:224] Handling call
0709 13:19:43.339672 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.711021 (+371349us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:44.039079 (+328058us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.396350 (+357271us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.416846 (+ 20496us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.417049 (+   203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:44.417102 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.770843 (+1353741us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54002b98d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:45.770894 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.770942 (+    48us) raft_consensus.cc:1685] finished
0709 13:19:45.771029 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.771160 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34816,"prepare.queue_time_us":42118,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":2917,"raft.queue_time_us":42788,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":16437,"spinlock_wait_cycles":719223680,"thread_start_us":568239,"threads_started":3,"wal-append.queue_time_us":305010,"wal-append.run_cpu_time_us":2383,"wal-append.run_wall_time_us":1089046}
I20260709 13:19:45.791358 22694 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:45.793443 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 48258.3us
W20260709 13:19:45.809049 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.800981 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48837us
I20260709 13:19:45.814064 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:45.815447 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.809969 19747 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:45.816200 19143 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:45.817348 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:45.818511 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:45.822786 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.821869 22960 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:45.824301 22871 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:45.825379 19145 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:45.792273 22955 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.832037 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1898) took 1563 ms. Trace:
I20260709 13:19:45.834734 19064 rpcz_store.cc:276] 0709 13:19:44.268208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.285464 (+ 17256us) service_pool.cc:224] Handling call
0709 13:19:45.764332 (+1478868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.764839 (+   507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.831800 (+ 66961us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540025dd50. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:45.831967 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3400341760}
I20260709 13:19:45.837383 19068 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:45.837456 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.838611 19068 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.798209 22964 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:45.843255 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-6f8c498b148c4d5db7c4a7d0e2b24360 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:19:45.843736 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-6f8c498b148c4d5db7c4a7d0e2b24360 on tablet 6f8c498b148c4d5db7c4a7d0e2b24360 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:45.836865 22871 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:45.847007 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:45.847579 19143 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.836859 22602 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.839751 19068 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.855315 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.855923 19144 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:45.841255 22913 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:45.858873 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.859215 19141 raft_consensus.cc:2410] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:45.859467 19144 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:45.858035 19068 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:45.855208 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.862133 19145 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:45.864925 19068 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:45.866878 19068 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.874503 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.875370 19144 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:45.875674 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:45.879379 19143 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:45.889531 22964 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:45.861370 22960 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:45.861173 22919 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:45.864545 22916 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:45.851420 22775 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:19:45.869793 22913 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:45.851917 22871 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.862452 22602 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:45.891664 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.013931 19147 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:46.077939 19143 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:46.079625 19140 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.078167 19141 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:46.082172 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.084916 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:46.092741 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.096868 19143 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.019411 22709 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:46.098482 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.019107 22880 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.019860 22669 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.100839 22913 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.101951 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.102535 19145 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:46.089093 22960 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.105099 22916 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:46.105679 22916 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:46.106491 22960 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:46.090868 22456 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.089231 22919 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.110877 22919 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.110994 22966 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:19:46.101500 22983 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:19:46.098446 22709 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:46.114858 22709 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.115758 22709 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.117527 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.118150 19145 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:46.119624 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:19:45.975042 22985 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:45.959386 22713 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.123986 19147 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:45.999433 22694 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:46.043768 22464 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.127056 19143 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:45.962608 22929 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.143435 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:46.144196 19143 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.123893 22960 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.150452 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:46.151026 19145 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:46.106577 22916 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.128793 22957 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.152694 22960 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:46.160642 22960 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.161432 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:46.164443 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:46.165041 19145 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:46.141193 22464 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.176241 22910 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.185264 22910 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:46.176194 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 1933) took 2319 ms. Trace:
I20260709 13:19:46.185899 19146 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:46.136049 22713 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:46.180851 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.141819 22694 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.186053 19214 rpcz_store.cc:276] 0709 13:19:43.847504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.847619 (+   115us) service_pool.cc:224] Handling call
0709 13:19:43.864607 (+ 16988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.882255 (+ 17648us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:43.882288 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.927122 (+ 44834us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.175825 (+248703us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:44.175868 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.175937 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.513671 (+337734us) raft_consensus.cc:1685] finished
0709 13:19:44.513691 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.166934 (+1653243us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b540036ced0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:46.167162 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56790,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"spinlock_wait_cycles":8029056,"thread_start_us":248315,"threads_started":1,"wal-append.queue_time_us":558123,"wal-append.run_cpu_time_us":1543,"wal-append.run_wall_time_us":1028405}
I20260709 13:19:46.194819 19143 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:46.237854 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2082) took 1285 ms. Trace:
I20260709 13:19:46.238427 19069 rpcz_store.cc:276] 0709 13:19:44.952285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.763242 (+810957us) service_pool.cc:224] Handling call
0709 13:19:45.763487 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.763788 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.763813 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.764192 (+   379us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.873328 (+109136us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:45.873379 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.873465 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.237592 (+364127us) raft_consensus.cc:1685] finished
0709 13:19:46.237615 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.237784 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2943,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":63909,"threads_started":1,"wal-append.queue_time_us":441564}
I20260709 13:19:46.185719 22464 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:46.259739 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.290074 19145 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:46.190054 22669 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:46.294054 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.304363 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.305099 19215 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.303171 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.307192 19214 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.306460 19221 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:46.291131 22957 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.313259 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.315627 19214 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:46.313979 19221 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:46.308701 22984 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:19:46.323518 22602 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:46.325248 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:46.325979 19750 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:46.318143 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.341665 19215 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 7.
I20260709 13:19:46.346868 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.347131 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.362277 19221 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.362644 19214 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:46.348242 19220 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.348807 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.349525 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.349807 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.364171 19217 raft_consensus.cc:2368] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11.
I20260709 13:19:46.350582 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.352670 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.250043 22910 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.307622 22669 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.371657 19219 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:46.374675 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.378650 19218 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:46.387559 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.388478 19217 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:46.379379 22456 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:46.389628 22456 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.392066 22456 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.380267 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.369113 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.397464 19213 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.353618 22602 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.413039 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 401) took 1304 ms. Trace:
I20260709 13:19:46.414048 19072 rpcz_store.cc:276] 0709 13:19:45.108756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.803702 (+694946us) service_pool.cc:224] Handling call
0709 13:19:45.803966 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.811704 (+  7738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.811752 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.820908 (+  9156us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.910785 (+ 89877us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:45.910863 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.911019 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.412774 (+501755us) raft_consensus.cc:1685] finished
0709 13:19:46.412801 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.412969 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12125,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5411,"thread_start_us":63878,"threads_started":1,"wal-append.queue_time_us":347332}
I20260709 13:19:46.358440 22808 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.319931 22957 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:46.419667 19213 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:46.351493 22960 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.422035 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.410187 22910 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.425225 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.427610 19214 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:46.429049 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.431735 19219 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:46.431711 19221 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:46.434175 19216 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:46.435376 19220 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:19:46.462559 22904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.008s	sys 0.038s
I20260709 13:19:46.418411 22808 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:46.468501 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.474506 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.475216 19221 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:46.464706 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:46.464141 22904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.038s
I20260709 13:19:46.435667 22694 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:46.493978 19215 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:19:46.495791 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 293420us
W20260709 13:19:46.499291 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.500118 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.506896 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.507652 19069 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.508889 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.509227 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.509479 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.510499 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.510989 19069 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.511843 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.420401 22602 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.512271 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.515326 19069 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:46.515242 19072 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:46.516396 19069 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:46.485428 22713 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:46.502844 22986 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:19:46.519114 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.519376 19066 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:46.520907 19215 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:46.523016 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.527093 19068 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:46.531181 22991 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:19:46.537506 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.537889 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.503048 22709 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:46.553040 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 263157us
I20260709 13:19:46.555390 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.556962 19068 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:46.530014 22775 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:46.564404 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:46.565750 19038 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.025s
W20260709 13:19:46.566578 19038 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.004s	sys 0.025s
W20260709 13:19:46.559095 22987 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:19:46.578444 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:46.580396 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.581168 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.587749 19143 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:46.590509 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.517347 22808 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.555303 22709 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.610579 19141 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:46.568075 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 612431us
I20260709 13:19:46.569958 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:46.619518 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49675.3us
I20260709 13:19:46.620285 19215 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.621215 22694 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:46.621541 22456 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.590962 22919 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.615079 22957 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:46.616199 22602 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.631767 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.624696 19214 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:46.613795 22900 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:46.627576 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.624229 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:46.629124 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:46.616240 22994 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:46.635828 19219 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:46.622061 22966 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:19:46.609536 22880 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.574710 22775 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.622295 22694 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:46.653206 22694 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:46.653440 19147 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.654091 22694 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.614995 22960 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:46.656587 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:46.626468 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.657861 19221 raft_consensus.cc:2410] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:46.634093 19215 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:46.645169 22840 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.649152 22923 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.668865 22960 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:46.669245 22923 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:46.669453 22960 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.669801 22923 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.649699 19750 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:19:46.671912 22923 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:46.650564 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:46.672646 19138 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.675686 19212 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:46.676096 19212 pending_rounds.cc:85] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 5
W20260709 13:19:46.676226 22995 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:46.633682 22900 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:46.651365 19144 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:46.654419 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.677999 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2084) took 1658 ms. Trace:
I20260709 13:19:46.624018 22808 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.632575 22919 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:46.678264 19147 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:19:46.679124 19141 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:46.678745 19147 pending_rounds.cc:85] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 8
I20260709 13:19:46.679903 19147 pending_rounds.cc:107] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:19:46.639034 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.678264 19144 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:46.637689 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 402) took 1528 ms. Trace:
I20260709 13:19:46.680665 19143 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:46.681766 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.681027 19064 rpcz_store.cc:276] 0709 13:19:45.108994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.835686 (+726692us) service_pool.cc:224] Handling call
0709 13:19:45.835981 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.836332 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.836357 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.841320 (+  4963us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.084818 (+243498us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:46.084854 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.084931 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.637430 (+552499us) raft_consensus.cc:1685] finished
0709 13:19:46.637459 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.637616 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2732,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2084,"thread_start_us":226473,"threads_started":1,"wal-append.queue_time_us":336115}
I20260709 13:19:46.656001 22669 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.680411 19147 raft_consensus.cc:2889] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.682927 22669 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:46.683459 22669 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.684172 22952 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.684526 22952 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:46.685536 22669 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.666810 22935 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.685861 19138 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:46.686214 22935 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.687805 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:46.688277 22935 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:46.689369 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.689961 19144 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:46.688525 19743 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:46.692822 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:46.678362 19070 rpcz_store.cc:276] 0709 13:19:45.019517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.766249 (+746732us) service_pool.cc:224] Handling call
0709 13:19:45.772899 (+  6650us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:45.773307 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:45.917521 (+144214us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.464705 (+547184us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:46.477417 (+ 12712us) log.cc:844] Serialized 52 byte log entry
0709 13:19:46.477547 (+   130us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:46.477579 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.477641 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.677795 (+200154us) raft_consensus.cc:1685] finished
0709 13:19:46.677822 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.677943 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34627,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":1375,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":1706,"thread_start_us":628723,"threads_started":2,"wal-append.queue_time_us":585382}
I20260709 13:19:46.693833 19742 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:19:46.694182 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 398) took 1586 ms. Trace:
I20260709 13:19:46.676311 19212 pending_rounds.cc:107] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:46.694682 19212 raft_consensus.cc:2889] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.695370 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:46.680038 22919 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.655275 22694 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.694566 19063 rpcz_store.cc:276] 0709 13:19:45.108097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.773544 (+665447us) service_pool.cc:224] Handling call
0709 13:19:45.790276 (+ 16732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.790551 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.790586 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.791088 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.852801 (+ 61713us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:45.863861 (+ 11060us) log.cc:844] Serialized 14 byte log entry
0709 13:19:45.864131 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.864409 (+   278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.110847 (+246438us) raft_consensus.cc:1685] finished
0709 13:19:46.110869 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.694002 (+583133us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54002cc250. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:46.694120 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":802,"prepare.queue_time_us":30881,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":18831,"raft.queue_time_us":73,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":10482,"spinlock_wait_cycles":37659392,"thread_start_us":54428,"threads_started":1,"wal-append.queue_time_us":310996}
I20260709 13:19:46.685349 22952 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.654515 22775 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:46.696924 22952 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.671403 22966 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.697566 22966 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:46.698437 22966 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.698894 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.699815 22966 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.700033 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.700618 19145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:46.701349 19145 raft_consensus.cc:606] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:46.666997 22840 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:46.704378 22840 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.660157 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:46.705507 22840 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.705945 22789 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:46.705993 22775 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.706017 22931 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:46.707273 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47215.2us
I20260709 13:19:46.708113 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:46.695501 19143 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:46.709420 19745 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:46.700686 19138 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
W20260709 13:19:46.709379 19071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2079) took 1757 ms (client timeout 1664 ms). Trace:
W20260709 13:19:46.713380 19071 rpcz_store.cc:269] 0709 13:19:44.951626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.104677 (+153051us) service_pool.cc:224] Handling call
0709 13:19:46.709200 (+1604523us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:46.709317 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1192953728}
I20260709 13:19:46.714195 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:46.715917 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:46.666499 22957 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.696612 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:46.720096 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:46.723374 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:46.724107 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.727427 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.727839 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.720811 22910 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.721411 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:46.633152 22929 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:19:46.737751 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.691430 22871 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:46.741598 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:46.757792 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.758163 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.758970 19063 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.760641 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:46.762462 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:46.763231 19212 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.742803 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:46.708148 22789 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:46.724658 22955 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.667119 22880 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.721551 22775 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.721917 22803 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.788898 22803 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.789834 22803 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.791600 22910 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:19:46.796754 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 73436.5us
I20260709 13:19:46.797472 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:46.805330 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.772289 22931 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.786088 22867 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:46.811019 19063 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:46.806859 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:46.785763 22464 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:46.807524 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:46.812011 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:46.817876 19212 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:46.812390 19071 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.733644 22957 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.813874 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:46.823557 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:46.823194 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:46.825635 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 189360us
I20260709 13:19:46.826651 19215 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:46.835965 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:46.809489 22913 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:46.839782 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:46.840713 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:46.843811 19221 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:46.817329 22712 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:46.821882 22910 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:46.843323 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 323552us
I20260709 13:19:46.812841 22867 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:46.845275 19038 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:46.822000 22464 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:46.827867 22775 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:46.846508 22878 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.842998 22709 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:46.826905 22912 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:46.856294 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 235090us
I20260709 13:19:46.842927 22913 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:46.855185 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:46.847609 22867 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.842917 22927 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:46.865448 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:46.881309 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:46.881498 23010 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:46.882225 23010 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.810479 22931 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.827078 22919 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:19:46.835412 22669 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:19:46.844424 22423 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:19:46.843911 22930 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:19:46.888569 19141 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:46.852584 22878 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:46.845431 22778 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:19:46.853341 22916 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.902218 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.903178 19064 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:46.902169 22912 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:46.904757 22997 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:19:46.893043 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 69946.7us
I20260709 13:19:46.897045 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:46.893294 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.906840 22778 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:46.907220 22778 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:46.908517 19066 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:46.898432 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.871209 22913 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.904711 22912 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:46.905437 19070 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:46.882666 23010 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.845216 22789 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.913517 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.893537 22931 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:46.915287 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 60159.8us
I20260709 13:19:46.920363 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.921586 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.919305 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.920051 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:46.915315 22999 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:19:46.909787 22775 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:46.928586 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:46.892016 22927 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.916525 22808 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:46.915704 22912 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:46.916712 22925 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:46.916445 22878 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:46.902228 23004 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:19:46.908035 22778 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.899534 23007 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:19:46.911895 22464 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:46.926558 22602 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:46.950855 22880 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.937853 22789 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:46.973228 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.951571 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 51534.7us
I20260709 13:19:46.964452 19216 raft_consensus.cc:2410] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:19:47.030043 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.965210 22952 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 13:19:47.038679 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 133101us
I20260709 13:19:47.039222 19220 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:47.039603 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:46.959714 23002 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:47.041131 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:46.957297 22778 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:47.047775 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.051270 19035 consensus_peers.cc:597] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:47.051821 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 49055.1us
I20260709 13:19:47.052606 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:47.048434 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:47.049078 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 156813us
I20260709 13:19:46.965032 22464 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.049916 22932 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:47.079197 22932 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.080013 23009 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:47.081328 22932 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:46.965485 22957 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.055047 19110 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:47.066418 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:46.968168 22955 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.965984 22808 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:46.966218 22602 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:46.962262 23007 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:19:46.963200 23011 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:19:47.038877 22803 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:46.965518 22878 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:47.071343 23012 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:19:47.072549 23001 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:19:46.965036 22925 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:46.967473 22927 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:46.969918 22880 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
W20260709 13:19:47.100302 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 192391us
W20260709 13:19:47.103274 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48303.3us
I20260709 13:19:47.043257 22456 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.110219 19219 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:19:46.953856 23013 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 13:19:47.124646 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:47.102483 23014 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:47.085039 23020 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.118057 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.116505 22602 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.076725 22912 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.118311 22423 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.952267 22775 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.124776 19219 pending_rounds.cc:85] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 10
I20260709 13:19:47.099803 22938 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:19:47.120539 22669 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.139698 19219 pending_rounds.cc:107] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:19:47.133167 23014 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:47.134738 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 215262us
I20260709 13:19:46.963145 22900 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.177500 19213 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:47.124161 23022 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.170295 19219 raft_consensus.cc:2889] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:47.176712 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:47.179814 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:47.139334 22927 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:47.176748 23014 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.136845 23017 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:47.136677 22423 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.169984 23019 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.187036 23019 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.189639 23019 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.125784 22456 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.191900 22456 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:47.192480 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57785.6us
I20260709 13:19:47.195792 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:47.197050 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 78219.5us
I20260709 13:19:47.195232 22919 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:19:47.170116 22669 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:47.134716 23021 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:19:47.201946 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.183998 22927 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:47.218367 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 90446us
I20260709 13:19:47.173631 23005 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:47.205257 23017 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.185807 22713 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:47.222597 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.202250 22669 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.220955 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:47.226807 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:47.207010 22900 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.220921 23025 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:47.205964 22932 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:47.219816 22927 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.219012 23013 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.235833 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:47.236603 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56023.1us
I20260709 13:19:47.227640 22713 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.244125 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.263645 22456 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:47.240192 22912 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.239519 23017 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.239300 22713 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.264619 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.243101 22952 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:47.222422 23020 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:47.201198 22808 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.259090 22867 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.228636 23018 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:47.286005 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.238425 23013 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:47.286525 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:47.272125 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 227344us
I20260709 13:19:47.286598 19068 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:47.289325 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.292317 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.238655 23028 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:47.296059 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:47.288812 23007 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:47.280181 23025 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:47.272703 23009 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.302034 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:47.302275 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.274113 22778 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:47.305413 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.305529 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:47.306197 19221 raft_consensus.cc:2376] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11. Re-sending same reply.
I20260709 13:19:47.272181 22456 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:47.283356 23022 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:47.307682 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.204268 22925 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.236143 22932 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.313867 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:47.339042 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.283773 22464 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.308480 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.329559 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.343627 19215 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:47.312532 23028 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:47.237319 23010 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.354020 22867 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.354635 22867 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.355005 23010 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.355408 22931 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.348337 22910 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:47.357378 22931 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.334208 22935 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.233006 22423 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.289019 22938 raft_consensus.cc:3055] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:47.295687 22912 raft_consensus.cc:2764] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:47.301633 23013 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.343834 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:47.370959 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 149954us
I20260709 13:19:47.301893 23033 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.350512 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.351069 23028 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.351982 22932 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.352371 22913 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.360852 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.338652 22919 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:19:47.338418 23019 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:47.346225 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.374076 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.308993 22803 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:47.371493 22938 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:47.397289 19140 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:47.397727 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.398077 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:47.403730 19147 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.403762 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.404430 19035 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:47.359973 23008 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:19:47.361577 22778 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:47.381431 22912 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.399977 19113 leader_election.cc:400] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11.
I20260709 13:19:47.313740 23009 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.377038 23034 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:47.339243 23022 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.411064 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.416930 19113 leader_election.cc:403] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.416085 19147 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:47.400362 22423 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.419303 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:47.425019 19113 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.429433 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.426431 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:47.425834 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:47.407617 22464 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.408735 23044 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.410383 22955 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.390300 23033 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.436486 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.412096 23017 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:47.424441 22960 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.378960 22456 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.453766 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.412731 23041 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:47.491011 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 54610.7us
I20260709 13:19:47.426631 23018 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.431670 23019 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:47.434448 23037 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.502914 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 83684.8us
I20260709 13:19:47.433236 22931 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.453558 23000 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:47.430881 23038 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11.
W20260709 13:19:47.499393 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.433142 22930 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.493443 23036 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.503717 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:47.504907 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 51208.7us
I20260709 13:19:47.503911 23015 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:47.489935 23035 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:47.506978 22912 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:19:47.540807 19072 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.496477 23010 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:47.499119 23017 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.433454 22935 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:19:47.454599 22464 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.532377 19220 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:47.427428 23034 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.533203 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.556681 19214 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:47.556933 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:47.557548 19217 raft_consensus.cc:2376] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10. Re-sending same reply.
I20260709 13:19:47.522922 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:47.522931 19147 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:47.524686 19750 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:47.527561 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.559515 19064 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:47.534116 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.528302 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:47.560240 19067 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.560406 19218 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:47.525833 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.526424 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.561849 19069 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:47.562696 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.563230 19069 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:47.530272 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.558418 19139 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
W20260709 13:19:47.538942 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.539887 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.456238 22910 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:19:47.552800 19220 pending_rounds.cc:85] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 5
I20260709 13:19:47.472527 23029 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.555814 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.522439 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:47.565258 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:47.566038 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:47.704965 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:47.567770 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:47.571012 19220 pending_rounds.cc:107] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:47.705989 19220 raft_consensus.cc:2889] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:47.706106 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 138399us
I20260709 13:19:47.707127 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.540359 23043 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.540701 22930 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.559342 22669 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.577160 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:47.520270 22456 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.510011 23045 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:47.555786 23038 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.519522 23033 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.636255 19212 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:47.538800 23035 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.534626 23015 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.703049 22913 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:47.518253 23009 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.492398 23044 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.568646 23019 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:47.512172 23024 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:19:47.648566 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.649533 22767 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:47.656329 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:47.665278 23017 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.666343 23032 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:47.666898 23034 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.667456 23004 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:47.672255 23022 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.672715 19072 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:47.674887 22957 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.682381 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.684702 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:47.496770 22938 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.617848 19067 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:47.693450 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:47.699724 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.699525 19743 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEARNER]: Advancing to term 11
I20260709 13:19:47.701247 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:47.708093 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:47.708583 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 143418us
I20260709 13:19:47.780699 19220 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:47.782220 19220 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:47.717296 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:47.508935 23037 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.719512 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:47.723577 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.726410 19141 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:47.570274 22602 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.635838 23029 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:47.687750 22775 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.736034 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:47.770777 23004 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.739255 23038 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.644657 23025 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:19:47.720688 22923 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.744591 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:47.720294 23008 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:47.745487 19139 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:47.736223 23014 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 13:19:47.637928 23048 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:19:47.799273 22912 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.724499 22952 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:47.773521 19213 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.743666 23045 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.727077 22930 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.780762 19138 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:47.717106 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:47.760527 22767 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.784616 19220 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.791319 19745 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:19:47.795135 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 112879us
I20260709 13:19:47.825897 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:47.826160 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 109108us
I20260709 13:19:47.765865 23032 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:47.778692 22900 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
I20260709 13:19:47.517663 23000 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:47.776399 23007 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.776675 22957 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:47.799165 22713 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:19:47.812700 19212 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:47.820379 19214 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.738822 23035 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.853161 23000 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.854039 23037 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.847004 23007 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.801040 23029 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.857187 22930 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.858300 23045 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.859467 23007 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.799921 22712 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.860548 22712 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:47.861310 22712 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.862879 22602 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.864898 22669 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.866117 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 579) took 1052 ms. Trace:
I20260709 13:19:47.815541 23008 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.866465 23044 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.866895 23008 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.869941 23004 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.871742 23004 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:47.873870 23051 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:19:47.844957 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 518) took 1040 ms. Trace:
I20260709 13:19:47.874819 19219 rpcz_store.cc:276] 0709 13:19:46.804225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.804345 (+   120us) service_pool.cc:224] Handling call
0709 13:19:47.109778 (+305433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.178778 (+ 69000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.844700 (+665922us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540034d350. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:47.844865 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701173120}
I20260709 13:19:47.850374 19221 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.842370 22464 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.851289 22767 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:47.852027 23053 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:47.846468 22913 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:19:47.812386 22923 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.823895 23014 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.832185 23017 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.866484 19750 rpcz_store.cc:276] 0709 13:19:46.813953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.816978 (+  3025us) service_pool.cc:224] Handling call
0709 13:19:47.865934 (+1048956us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54000e6ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:47.866038 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293357440}
I20260709 13:19:47.834141 23028 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:47.878649 22927 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
I20260709 13:19:47.833335 23019 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.810046 22775 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.834436 22912 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.802333 23015 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.886437 22923 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.875240 22713 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.890107 22767 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.889231 23028 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.892686 22927 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.903172 23014 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.902977 23035 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.904373 22927 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.901060 23028 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:47.905110 23035 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.892320 22840 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:47.892462 23017 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.909428 23038 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.917069 23054 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:47.917448 23054 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:47.918212 23029 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.918185 23054 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.919613 23054 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:47.919752 23013 consensus_meta.cc:287] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.000s
I20260709 13:19:47.920339 23029 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.920408 23013 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.922449 23013 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.923108 23016 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:47.923522 23016 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:47.923784 23017 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.924269 23016 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.925640 23016 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.929049 23032 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:47.930529 23032 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.938390 23043 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.939924 23028 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:47.943001 23028 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:47.801621 19065 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:19:47.981539 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 240594us
I20260709 13:19:47.986079 19064 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:47.769376 19068 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:47.987862 19071 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.787318 19072 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.827404 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:47.839753 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:48.052383 19072 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:48.058671 23043 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.059610 22840 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:48.061772 22840 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.063694 22840 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:48.059590 23043 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.073932 23028 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:48.075001 23028 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.080101 23028 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:48.086725 23008 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.091540 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.088730 23043 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.093392 22789 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:48.102842 19140 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:48.107234 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.107523 22912 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:48.108237 19068 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:48.109030 22778 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:48.110000 22778 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.113034 19142 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:19:48.114758 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 275015us
I20260709 13:19:48.115955 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.122961 23009 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.123438 22713 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.123849 23009 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.127488 23009 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:47.896431 22880 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.229s
I20260709 13:19:48.129568 23017 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.130008 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.112658 22778 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:48.176901 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 98621.9us
I20260709 13:19:48.194293 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.195915 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.196957 19072 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.197129 22778 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.196672 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.199354 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.209870 22778 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:48.216637 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.218127 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.218830 22778 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:48.219718 23045 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.220378 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.220777 23016 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:48.220533 23045 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.221643 23016 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.223580 23045 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.224406 23016 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:48.229908 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.231326 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:48.231984 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 353669us
I20260709 13:19:48.233007 22713 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.233134 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.233721 22713 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.234335 22767 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:48.236289 22713 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.236423 22767 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:48.237046 22952 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:48.237895 22952 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:48.239193 22952 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:48.241523 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.242475 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.245020 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.245806 19138 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:48.246058 19217 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:48.247025 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.247274 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.247375 22775 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:48.248034 19217 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:48.248314 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:48.251430 19143 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:48.251448 23000 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.252382 23000 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.232160 19066 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:48.264628 19065 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:48.286592 23017 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:48.286789 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.293295 19219 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:48.295855 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:48.297976 23008 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:48.337772 23078 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:48.337649 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.338917 23017 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.339565 23017 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.339969 23017 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.310576 23020 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.341406 23020 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.343691 23020 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:48.339864 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 103051us
I20260709 13:19:48.347867 22712 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.348026 23022 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:48.349038 19213 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:48.352026 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.356350 19035 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:48.358307 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.358644 23031 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.359064 19142 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:48.359266 23031 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.360071 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.361034 23015 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:48.362743 23000 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.364132 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:48.364789 19745 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.366914 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:48.367249 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:48.367429 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:48.367655 19746 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:48.368461 19747 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:19:48.370384 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.371213 19218 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:48.371616 19071 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:48.372048 23085 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 13:19:48.373823 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.374514 19139 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:48.375279 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:48.380504 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.381029 23016 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:48.381680 19067 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:48.382952 22931 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:48.383251 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:48.383466 22931 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:48.386966 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.387151 22957 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.387838 19066 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:48.388338 22957 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.384582 22931 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.389732 22931 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.391649 22938 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.975065 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:48.395058 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.395646 22775 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.396389 22775 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.399181 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:48.399405 22423 consensus_meta.cc:287] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.965s	user 0.012s	sys 0.005s
I20260709 13:19:48.399978 19140 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:48.400245 19147 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:48.364791 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:48.364279 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.409240 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:48.400274 19745 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:48.360783 19142 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:48.395087 19113 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:48.408531 18965 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 114) took 29759 ms (client timeout 15000 ms). Trace:
I20260709 13:19:48.396417 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.425850 19143 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:48.433053 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:19:48.408713 22456 consensus_meta.cc:287] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.001s
I20260709 13:19:48.436648 19144 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:48.441457 19146 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:48.442720 19139 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:48.445096 19750 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:48.447011 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.441958 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:48.451313 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 95099.3us
I20260709 13:19:48.448226 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.449690 19147 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:48.454406 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:48.455096 19745 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:48.452958 19219 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:48.456562 19072 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:48.455463 19065 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:48.458945 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:48.459640 19141 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.460362 22712 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:48.461256 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 73985.5us
I20260709 13:19:48.464987 23019 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.465619 23019 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.467762 23019 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:48.468356 23034 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.469194 23031 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.469096 23034 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.469465 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.470474 19220 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:48.470664 19745 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:48.471092 22904 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:48.471658 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:48.472167 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 61507.4us
I20260709 13:19:48.472370 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:48.472851 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:48.473228 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.471141 23034 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.478796 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:48.479396 19742 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.480345 19748 raft_consensus.cc:2368] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
I20260709 13:19:48.482331 19069 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:19:48.486650 19138 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:48.473218 23020 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:48.491968 19143 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:48.471674 22904 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.491357 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:48.500811 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.501534 19220 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:48.505261 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 108994us
I20260709 13:19:48.506811 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.508168 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:48.508919 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.509513 23020 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:48.498200 23019 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.510444 23019 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.510711 23020 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.512033 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.512532 19750 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:48.512593 19221 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:48.513545 22952 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:48.505255 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:48.487236 22775 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:48.520352 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47490.4us
I20260709 13:19:48.517196 19746 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:48.431488 18965 rpcz_store.cc:269] 0709 13:19:18.649310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.649561 (+   251us) service_pool.cc:224] Handling call
0709 13:19:48.408247 (+29758686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:45.413490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:45.414014 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:45.414052 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:19:45.414068 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:45.415262 (+  1194us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:45.415321 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:45.415350 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:45.416351 (+  1001us) tablet.cc:701] Row locks acquired
0709 13:19:45.416366 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:19:45.416505 (+   139us) write_op.cc:270] Start()
0709 13:19:45.416611 (+   106us) write_op.cc:276] Timestamp: P: 1783603185416454 usec, L: 0
0709 13:19:45.416630 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:45.429907 (+ 13277us) log.cc:844] Serialized 4710 byte log entry
0709 13:19:45.908884 (+478977us) op_driver.cc:464] REPLICATION: finished
0709 13:19:46.486788 (+577904us) write_op.cc:301] APPLY: starting
0709 13:19:46.488096 (+  1308us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:46.488438 (+   342us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:46.488582 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:46.549025 (+ 60443us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:46.549374 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:19:46.549445 (+    71us) write_op.cc:312] APPLY: finished
0709 13:19:46.549851 (+   406us) log.cc:844] Serialized 89 byte log entry
0709 13:19:46.550035 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:46.550177 (+   142us) write_op.cc:454] Released schema lock
0709 13:19:46.550224 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:46.550591 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:46.550633 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":140812,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":548070,"apply.run_cpu_time_us":4275,"apply.run_wall_time_us":70516,"num_ops":12,"prepare.queue_time_us":184632,"prepare.run_cpu_time_us":54206,"prepare.run_wall_time_us":253046,"raft.queue_time_us":162489,"raft.run_cpu_time_us":24153,"raft.run_wall_time_us":365069,"replication_time_us":473994,"thread_start_us":721170,"threads_started":4,"wal-append.queue_time_us":265499,"wal-append.run_cpu_time_us":48540,"wal-append.run_wall_time_us":1868957}]]}
I20260709 13:19:48.534941 19742 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:48.539189 19141 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:48.490442 23004 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:48.499797 22904 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.464483 23017 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:48.543529 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:48.549743 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 71206.5us
I20260709 13:19:48.550967 19220 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:19:48.556968 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.558107 22923 consensus_meta.cc:287] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.006s
I20260709 13:19:48.558539 22923 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.561621 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:48.562547 19748 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:48.545580 23004 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:48.563866 23004 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.566140 23019 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:48.519671 22712 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:48.567559 22712 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:48.567943 22712 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:48.573072 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:48.574095 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:48.575311 23009 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:48.577118 22789 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:48.577634 22789 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.578075 22789 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.579195 19145 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:48.578433 23017 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.581064 22778 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:48.582566 22778 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.576772 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:48.583076 22778 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.583760 19748 raft_consensus.cc:2410] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:48.576534 23009 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.584740 23009 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:48.585274 23009 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.587297 22960 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:48.587666 22960 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:48.560672 22923 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:48.595578 23087 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:48.596361 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:48.549640 23015 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.598354 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:48.599916 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:48.601989 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.602319 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.602584 19219 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:48.603484 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.603660 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.604597 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.604554 22840 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:48.605674 22840 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:48.606132 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:48.610306 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 94560.4us
I20260709 13:19:48.618294 19221 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:48.619870 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:48.610133 22952 raft_consensus.cc:2764] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:48.611816 23019 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:48.623226 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.624691 23028 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:48.627265 22456 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:48.588637 22960 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.622700 22840 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.631832 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.637773 23019 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:48.641008 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:48.594632 22712 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.649605 19140 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:48.649549 23019 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.628957 22775 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:48.653146 22775 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:48.654208 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:48.654431 22775 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.655073 22423 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:48.655999 22775 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:48.656577 22423 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.657020 22423 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.633419 22957 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:48.657845 22423 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.658011 22957 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:48.659090 22957 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.649605 19147 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:48.660434 22957 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.657004 22840 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.629699 23028 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.662817 23028 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:48.662839 22840 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:48.666312 19213 raft_consensus.cc:2410] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:48.668138 22904 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.670872 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.671720 22840 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.672493 22912 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:48.675022 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46903.4us
W20260709 13:19:48.675087 23022 consensus_queue.cc:1175] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:19:48.675107 23000 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:48.636158 22456 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.681910 19216 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:48.682817 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.683014 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.684471 19146 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:48.675203 22712 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.690661 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.681766 22456 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.692814 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.689810 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.698246 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.696535 19147 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:48.701697 19141 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:48.707711 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:48.687192 23034 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.695088 22840 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:48.699088 22912 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.697820 22938 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.718448 19748 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:48.709748 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:48.699909 22960 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.730475 19064 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.731034 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.731797 19069 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:48.732224 22778 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:48.723815 22952 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:48.733217 22952 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:48.747608 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.748488 19138 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:48.709383 22878 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:48.756322 19141 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:48.758498 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.759343 19147 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:48.762706 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.765305 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.766898 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.767655 19142 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:48.768078 22929 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:48.769244 19068 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:48.769605 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 74171.1us
I20260709 13:19:48.773106 23017 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:48.773705 23017 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:48.773365 22952 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.774626 23017 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.778276 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.779659 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:48.780156 19143 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.781157 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.783018 23000 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:48.786749 22938 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.788708 22938 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.789224 22938 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:48.789554 22938 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:48.790583 19065 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 7.
I20260709 13:19:48.790428 22938 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.793224 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.798842 23034 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.801653 22904 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:48.802445 22904 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:48.803026 22904 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.761832 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.815299 19072 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:48.784673 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.827555 19069 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:48.818924 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:48.815847 19072 pending_rounds.cc:85] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 4
I20260709 13:19:48.833724 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.834933 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.829632 19072 pending_rounds.cc:107] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:48.847596 19072 raft_consensus.cc:2889] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:48.854677 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.857612 19068 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:48.861027 19070 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:48.861635 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.857244 19144 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:48.859594 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:48.875177 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.831321 23004 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:48.861673 23045 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:48.878651 23045 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.858866 23031 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:48.881258 23031 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.883337 23031 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:48.859083 22878 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.893428 19068 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:48.909832 19072 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.912628 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:48.925940 19140 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:48.898653 23034 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:48.900321 22912 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.911077 22778 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.916265 22904 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:48.956187 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.956947 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 319183us
I20260709 13:19:48.952247 23045 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:48.939221 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:48.991138 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:48.937417 22789 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:48.971786 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:49.014158 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:49.018944 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:49.021121 23032 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.021322 22789 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.021579 23032 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.021961 23032 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.025297 23020 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.037628 23020 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:49.038872 23016 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.038615 23020 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.954461 22912 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:49.054921 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.015012 22840 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:49.050693 22904 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.072319 19072 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:49.061335 22775 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:49.077518 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 362747us
I20260709 13:19:49.039554 23016 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:49.064745 23091 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:49.029656 22778 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.074448 22775 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.065001 22904 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:49.099876 22904 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.099349 22775 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.118904 22912 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.119231 22778 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:49.123306 19143 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:49.119908 23097 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:49.128295 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 361624us
I20260709 13:19:49.132694 22775 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:49.134747 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 99014.6us
I20260709 13:19:49.122897 23004 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.127611 23097 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.094612 22840 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:49.147663 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 115507us
I20260709 13:19:49.097868 23019 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:49.131526 22904 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.161885 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:49.160080 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.145109 23097 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.163231 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:49.165020 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 71134.9us
I20260709 13:19:49.165737 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:49.168004 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 149140us
I20260709 13:19:49.167840 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.169335 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:49.142786 22778 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:19:49.159083 22931 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.175253 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.149097 22912 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:49.179608 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:49.181046 23015 consensus_meta.cc:287] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.583s	user 0.004s	sys 0.007s
I20260709 13:19:49.181504 23015 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.181360 22957 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:19:49.182209 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.170871 22423 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.002s
I20260709 13:19:49.182705 22423 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.182922 23109 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:19:49.183398 23009 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
W20260709 13:19:49.184204 23092 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:49.185200 19145 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:49.185318 23100 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:49.186844 22456 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.189057 22456 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:49.188190 23098 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:19:49.189718 22713 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:49.193362 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:49.193675 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:49.194275 19748 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:49.194408 23109 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:49.194653 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:49.194784 23109 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:49.195571 19746 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:49.195837 23109 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.197254 23109 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.200945 23016 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:49.201675 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:49.202024 19070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 409) took 1914 ms (client timeout 2230 ms). Trace:
W20260709 13:19:49.202436 19070 rpcz_store.cc:269] 0709 13:19:47.287164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.287278 (+   114us) service_pool.cc:224] Handling call
0709 13:19:47.656192 (+368914us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465eee 0000000000375939 00007f61084d91e0 00007f61085a20c4 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:19:49.201834 (+1545642us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b540017f2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:49.201955 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906154368}
I20260709 13:19:49.208119 22938 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.209044 22423 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.210919 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.211571 19218 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.211299 18964 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 5 to 8, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:49.214035 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.214617 19220 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.214814 22931 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.216498 22878 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:49.216784 22931 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.217338 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.218288 23093 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.218452 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.186158 23009 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.218894 23093 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.221186 23009 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.221349 19221 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:49.202391 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:49.234011 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 55996.3us
I20260709 13:19:49.234442 23107 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:49.234743 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:49.235028 23107 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.236455 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:49.237146 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.237732 19066 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:49.238144 23000 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:49.239877 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 72890.1us
I20260709 13:19:49.190184 23020 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.241604 22929 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:49.242134 22929 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.242794 23020 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:49.243764 23095 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:49.244135 22929 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.244760 19063 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:49.245018 23093 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.246634 22960 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.247166 22960 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:49.248111 22960 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:49.251575 22712 consensus_meta.cc:287] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.001s
I20260709 13:19:49.252413 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.253104 19213 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:49.254405 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.255321 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.255602 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.257942 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.258878 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.260866 19218 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:49.262499 19220 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:49.264351 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.268386 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.269320 19220 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:49.272429 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 93551.1us
I20260709 13:19:49.273624 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:49.225241 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.276367 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.277642 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.279618 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.282848 19742 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:49.282922 19070 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:49.283957 18964 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.286949 18964 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.248545 23032 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.288725 22904 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.288831 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:49.290251 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:49.290524 23032 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.291576 23015 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:49.292205 23015 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:49.293150 23119 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.293678 23119 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.293365 23015 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.294508 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.295722 23119 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.295822 19110 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.296597 23035 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:49.296990 23035 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.297312 23035 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.298137 22931 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.298449 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.299326 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.300000 23107 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.273433 23045 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.301203 23045 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.273188 22840 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.302347 22878 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.302680 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.303452 19215 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:19:49.301604 23028 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 13:19:49.305039 23028 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.306999 23028 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.302894 22878 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:49.307674 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.308118 22878 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.309283 23004 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.301604 23031 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.300653 22456 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.279414 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:49.272770 22712 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:19:49.311156 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.316018 19213 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:49.300360 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.319931 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.320109 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.332293 19218 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:49.282131 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:49.301632 23045 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.337090 19069 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:49.339398 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.340021 19220 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:19:49.332147 22904 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:49.354977 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 176712us
I20260709 13:19:49.353428 19066 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.330250 22938 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:49.353152 23028 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.371941 22712 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.370379 22423 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:19:49.361990 23004 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.365901 23097 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.375622 23097 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:49.367072 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:49.368366 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.369120 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.378592 19220 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:49.369952 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49949us
I20260709 13:19:49.379690 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.370342 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.364866 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:49.370779 23017 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.370958 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.371179 22931 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:49.385969 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:49.373883 19139 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:49.381886 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.383054 19212 raft_consensus.cc:2368] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11.
I20260709 13:19:49.379902 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.297317 23016 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.383409 19213 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:49.370474 22923 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:49.316551 23031 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.389073 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.404541 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:49.356439 22904 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.398874 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.362830 22938 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.413650 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:49.413503 19067 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:49.397392 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.419325 19147 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:49.420740 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 52445.3us
I20260709 13:19:49.426458 23028 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:49.427392 19184 leader_election.cc:400] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
I20260709 13:19:49.428644 23028 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:49.412968 23031 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.377421 23032 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:49.421947 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.423097 19067 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:49.431556 22960 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.441390 23114 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:49.441916 23114 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:49.442525 23114 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.443377 19218 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:49.431614 23022 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:49.445010 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47712.1us
I20260709 13:19:49.385855 22423 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.431859 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:49.476251 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 55166.5us
I20260709 13:19:49.441967 19213 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:49.437451 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 259303us
I20260709 13:19:49.478214 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.446379 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.432449 19069 raft_consensus.cc:2368] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13.
I20260709 13:19:49.480804 19066 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:49.486625 19742 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:49.487665 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.488242 19065 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:49.404247 22923 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:49.434581 19067 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.479207 19064 raft_consensus.cc:2376] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11. Re-sending same reply.
I20260709 13:19:49.490983 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.417042 22904 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.493803 19746 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:49.494114 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:49.503014 19742 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.494628 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.500420 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:49.437990 23115 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:19:49.432466 22938 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.491590 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:49.502179 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 55860.1us
I20260709 13:19:49.434738 22712 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.505352 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:49.501354 19220 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:49.506976 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:49.432404 22775 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.515151 19065 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:49.508000 19067 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.480295 22456 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:49.509243 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:49.420939 23017 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.510462 19714 leader_election.cc:400] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13.
I20260709 13:19:49.521425 19714 leader_election.cc:403] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:49.506389 23016 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.506784 22878 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:49.513633 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:49.531978 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.505023 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:49.512840 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:49.517365 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 95518.8us
I20260709 13:19:49.503571 23119 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.509804 19215 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:49.447362 22767 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:19:49.527103 22960 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.527305 22840 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:49.501382 23032 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.532660 19064 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.434266 22931 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.537273 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:49.510469 23028 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.515002 23097 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:49.545043 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 66908.5us
I20260709 13:19:49.544114 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.527626 23013 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:49.520057 22423 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:49.518071 22456 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:49.517706 23102 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:19:49.530506 22957 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:49.536217 22878 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:49.625736 23112 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:19:49.539481 22712 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.420399 18964 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:49.635741 19742 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:49.553166 22775 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:49.639901 19113 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:49.640839 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:49.537904 23019 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:19:49.653661 22712 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.654774 18964 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 8, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 8 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:49.658658 23131 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:19:49.660017 23125 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:19:49.661312 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 138974us
I20260709 13:19:49.657884 23116 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.544206 23022 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:19:49.542891 23119 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.633216 22456 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.674479 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2004) took 1065 ms. Trace:
I20260709 13:19:49.540741 23016 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.633543 22929 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.695676 22929 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.696141 22929 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.609640 22952 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
W20260709 13:19:49.668510 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 133117us
I20260709 13:19:49.631409 22912 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:49.708154 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.637823 23009 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.637629 22878 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.639312 23034 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:49.634269 22957 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.555060 23035 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.675549 19064 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:19:49.643899 22775 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.645183 22923 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.689644 23131 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.690666 22931 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:49.694890 23119 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.683445 19214 rpcz_store.cc:276] 0709 13:19:48.603589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.606852 (+  3263us) service_pool.cc:224] Handling call
0709 13:19:48.618196 (+ 11344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.943554 (+325358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.943582 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.968317 (+ 24735us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.154312 (+185995us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:49.154349 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.154413 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.669202 (+514789us) raft_consensus.cc:1685] finished
0709 13:19:49.669222 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.669340 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6589,"raft.queue_time_us":10668,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":423764,"threads_started":2,"wal-append.queue_time_us":404208}
I20260709 13:19:49.681618 23004 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.686659 23130 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.723768 22957 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.726154 22775 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.741755 23131 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.741601 22923 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:49.743685 23111 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:19:49.725692 22713 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:49.744922 23129 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:49.766929 19216 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:49.712383 22912 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:49.771075 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 89927.6us
I20260709 13:19:49.753010 23106 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.725860 23009 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:49.727574 23034 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:49.784590 19067 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:49.811136 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.813525 19067 pending_rounds.cc:85] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 8
I20260709 13:19:49.813935 19067 pending_rounds.cc:107] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:49.814284 19067 raft_consensus.cc:2889] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.720706 23109 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:19:49.692123 23116 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.800318 23032 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.807911 22929 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.810544 22912 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:49.857702 19113 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:49.860040 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 347271us
W20260709 13:19:49.860194 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 316143us
I20260709 13:19:49.868762 19113 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.821769 23000 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.875068 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:49.876317 23032 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.876441 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.860612 23015 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.873565 23022 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:49.882402 23131 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.816071 18964 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 9, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 9 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:49.885898 23015 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.885283 22931 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:49.886363 18964 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 10, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:49.888262 22712 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.887913 18964 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:49.888980 23139 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.888495 23032 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:49.890010 23122 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 13:19:49.890713 23114 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:49.891181 23137 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:19:49.894158 23013 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:49.894534 23013 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:49.895395 23013 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.881824 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:49.899756 23136 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:49.907336 23032 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.907644 23136 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:49.907869 23032 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.908587 23136 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.909407 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:49.910024 19143 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:49.911739 23032 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.896570 23013 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.919745 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:49.920688 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.921461 19067 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:49.924074 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:49.892800 23114 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.926824 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:49.927506 19143 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.930174 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.931121 19065 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:49.933282 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:49.934490 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:49.935171 19138 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:49.934116 19140 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:49.939174 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:49.939812 19141 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.912571 23016 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.881271 23000 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.943357 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:49.946558 19142 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.944931 19144 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:49.914855 23097 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:49.951349 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 69591.3us
I20260709 13:19:49.886379 23015 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.953513 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:49.953977 19140 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:49.917106 23008 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:49.961195 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:49.962193 19144 raft_consensus.cc:606] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:49.957561 23097 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.959420 22929 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:49.961871 23031 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.962831 19144 raft_consensus.cc:614] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:49.946271 22423 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.964573 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:49.973170 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:49.918651 23032 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:19:49.999096 23097 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:49.999253 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:49.972198 19139 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
W20260709 13:19:49.965265 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 460274us
I20260709 13:19:49.946106 22952 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.923961 22775 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:49.965849 22929 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.981514 19143 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
W20260709 13:19:50.004036 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.010653 19138 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:19:50.011338 19141 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:50.014585 19069 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:50.014819 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.015573 19071 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:49.970877 23141 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:50.017694 23116 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:49.931334 23034 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:49.999284 23031 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.960785 22938 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.001928 23119 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:49.974102 23035 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:49.947052 23009 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.007552 22929 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.028110 23132 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:50.022403 23135 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:19:50.035708 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:49.994459 22423 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.006634 23144 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:19:50.020946 22840 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:50.038292 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.051925 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:50.021188 23141 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:50.043195 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.005892 22904 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.053817 19139 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:49.974927 22957 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.025590 23032 consensus_queue.cc:1243] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:50.060246 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:50.062939 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.066105 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:50.034332 23119 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.068113 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:50.063746 19144 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:50.069762 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:50.068233 19063 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:49.967969 18964 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.079399 19070 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.055205 22840 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.085440 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:50.050434 23031 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:50.070230 23119 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.073148 23116 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.076689 23032 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:50.051834 23114 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:50.095839 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:50.067231 23035 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:19:50.097455 19139 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:50.097287 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.070103 23097 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:19:50.083989 22840 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.099339 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.099869 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:50.101588 19745 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.093698 23015 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.109634 19750 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:50.111893 18964 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:50.114863 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.114217 18964 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.115685 19147 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:50.056608 23132 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.085000 22952 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:50.118024 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.127545 19142 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:50.144140 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.093914 23116 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:50.151371 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.162200 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.165738 19139 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:50.142282 23013 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:50.153115 22960 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:19:50.163545 22878 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.152936 23116 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.148725 22775 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.175621 23146 raft_consensus.cc:2764] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:19:50.168036 23013 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.175877 23152 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:50.150347 23160 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:50.177244 23144 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:50.183527 19745 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:50.176421 23152 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:50.177090 23045 consensus_meta.cc:287] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.000s
I20260709 13:19:50.184641 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.174933 22960 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13.
I20260709 13:19:50.197353 22423 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.193912 22938 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.181849 22456 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.199828 22456 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.201018 23008 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.201515 23008 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.203601 23008 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.203732 23132 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:50.191612 23152 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.201049 22904 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.195274 22957 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.191296 23015 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.205969 23015 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.208050 23015 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.116482 18964 catalog_manager.cc:5697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.197073 22952 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:50.214288 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 128907us
I20260709 13:19:50.125121 23141 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.215718 23141 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.215797 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.216375 19139 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:50.218066 23124 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.677s	user 0.005s	sys 0.000s
I20260709 13:19:50.183975 23163 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:50.182955 23000 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.230692 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.229224 19139 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:50.190363 23160 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:50.210098 18964 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 6 to 9, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 9 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.225621 23163 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.233421 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.166229 23153 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 13:19:50.212385 23116 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.193195 23045 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.242612 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.237641 23015 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.248569 23165 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:50.249076 23165 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:50.248746 23160 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.249996 23165 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:19:50.251660 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.251135 23165 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.234802 22957 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:19:50.240813 23144 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:50.256068 19146 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:50.245975 23153 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:50.245523 23013 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.245800 22878 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.263962 23163 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.264328 22912 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.266466 22912 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.267498 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.285488 23045 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.285157 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.286478 19140 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.282461 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.288008 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:50.293758 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.295476 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.270280 19139 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:50.273890 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.278617 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.256505 23106 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:50.281255 19746 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:50.258345 23144 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.282668 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:19:50.329370 19071 raft_consensus.cc:606] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:50.329816 19071 raft_consensus.cc:614] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:50.301172 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.317296 19144 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:50.259120 23153 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:50.333997 19140 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:50.326910 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.335433 19066 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:50.254215 23015 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.330660 19143 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:50.338794 19139 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:50.338902 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.338910 23153 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.340023 19139 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.340176 19144 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:50.340584 23153 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.328068 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.279103 22775 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.390691 19063 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:50.349205 19144 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:50.342474 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.357223 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:50.396507 19065 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:50.397938 19742 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:50.339198 23161 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:19:50.408304 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.327628 23045 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:50.405069 19063 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:50.410370 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:50.336349 23144 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.414500 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.417557 19067 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:50.418426 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.389823 23132 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:50.303478 22840 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.421705 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.398433 22912 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.403075 23147 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:50.425992 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.426578 19071 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:50.398697 23017 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.421186 23139 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:50.410320 23106 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:50.426242 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.425396 23150 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:50.397617 22775 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.450682 19218 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:50.451069 19218 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:50.452380 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.430220 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.425254 23132 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.433415 23150 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.458628 23150 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.436501 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:50.459256 19144 raft_consensus.cc:606] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:50.459597 19144 raft_consensus.cc:614] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:50.429421 23139 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.461174 23116 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.461769 23139 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.462762 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.463508 19110 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.438577 23119 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.445215 22960 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.445381 19748 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:19:50.445683 23000 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.426299 23147 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.409078 23008 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:19:50.449190 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:50.449785 23149 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.332811 18964 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 8, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 8 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:50.456933 19065 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:50.451799 19218 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.487847 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.489841 19218 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.488399 23147 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.490736 23149 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.488936 19214 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:50.457435 23156 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.492951 22923 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:50.493496 22923 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.493137 23156 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.493949 22923 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.494565 23000 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:50.495244 23170 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:50.495661 23156 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.488552 23022 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:19:50.427940 22912 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.497434 23119 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.463963 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2148) took 1030 ms. Trace:
I20260709 13:19:50.463451 19750 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:50.497972 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:50.433495 23017 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.838420 19717 leader_election.cc:400] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11.
I20260709 13:19:50.842538 19717 leader_election.cc:403] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:50.551321 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.489140 22929 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.844166 19147 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:50.844316 23009 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11.
I20260709 13:19:50.844501 19066 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:19:50.551321 23157 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.357s	user 0.003s	sys 0.000s
I20260709 13:19:50.529856 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2136) took 1037 ms. Trace:
I20260709 13:19:50.535589 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.544013 22840 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:50.465173 23102 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.486030 23139 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:50.849925 23139 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.542454 23000 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:50.534896 23133 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.820s	user 0.002s	sys 0.000s
W20260709 13:19:50.531862 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.841801 19184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.013s
I20260709 13:19:50.451818 22775 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:50.851538 19184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.006s	sys 0.013s
W20260709 13:19:50.851838 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 617756us
I20260709 13:19:50.561843 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:50.532485 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.523416 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.529899 23153 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.542654 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.847806 22929 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.838414 19146 rpcz_store.cc:276] 0709 13:19:49.433811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.433971 (+   160us) service_pool.cc:224] Handling call
0709 13:19:49.434376 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.258449 (+824073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.460700 (+202251us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540018a954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:50.463890 (+  3190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885106432}
W20260709 13:19:50.864113 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.504673 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.849269 23102 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.659675 23132 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:50.643216 19218 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:19:50.544425 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.867144 19745 raft_consensus.cc:2368] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11.
W20260709 13:19:50.840001 23032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.004s	sys 0.012s
I20260709 13:19:50.838971 19748 raft_consensus.cc:2376] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11. Re-sending same reply.
I20260709 13:19:50.847694 19069 rpcz_store.cc:276] 0709 13:19:49.492755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.492891 (+   136us) service_pool.cc:224] Handling call
0709 13:19:50.529603 (+1036712us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54001ba654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:50.529786 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123997952}
I20260709 13:19:50.859339 19144 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:50.869544 19144 raft_consensus.cc:614] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:50.546221 23149 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.500866 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.850324 23139 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.866382 19218 pending_rounds.cc:85] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 9
I20260709 13:19:50.538069 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 1981) took 1213 ms. Trace:
I20260709 13:19:50.874650 19218 pending_rounds.cc:107] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:19:50.573112 22713 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:50.875322 19218 raft_consensus.cc:2889] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.874852 19070 rpcz_store.cc:276] 0709 13:19:49.324832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.324991 (+   159us) service_pool.cc:224] Handling call
0709 13:19:49.338995 (+ 14004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.079888 (+740893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.537818 (+457930us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54001a9354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:50.537986 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702333184}
I20260709 13:19:50.860250 19064 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:19:50.863538 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 186318us
I20260709 13:19:50.866523 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.850751 23017 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.868191 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:50.498386 22912 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:50.460789 23152 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.892922 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:50.893103 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.893957 19063 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:50.489318 22960 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:50.909819 19747 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:50.910483 19744 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:19:50.870442 23028 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.576417 23147 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.886188 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:50.545537 23015 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.889475 19110 leader_election.cc:400] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11.
W20260709 13:19:50.869976 23032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.004s	sys 0.012s
I20260709 13:19:50.888530 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:50.532604 23004 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:50.929687 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.890058 23146 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:50.890074 23017 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.561843 23150 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.896311 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.898099 19072 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:50.898386 23149 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.903363 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:50.903923 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:50.948263 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:50.948837 19064 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:50.948913 19070 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:50.904623 23139 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.887897 22923 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.958547 22923 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.959221 19144 raft_consensus.cc:606] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:50.959676 19144 raft_consensus.cc:614] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:50.905264 19068 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:50.913497 19066 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:50.927868 23156 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:50.926522 23032 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:50.861203 23130 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:50.580508 23144 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:50.891884 23093 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:50.925554 19110 leader_election.cc:403] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:50.862528 23136 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:19:50.887229 22713 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.927762 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:50.873732 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:50.932669 19063 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:50.865645 23153 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:50.937896 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 49432.7us
I20260709 13:19:50.989399 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:50.943557 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.944303 19745 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:50.989898 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:50.937984 23015 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.950224 23149 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.955994 23150 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.964442 23156 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.941237 23004 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.956308 23139 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:50.929598 22840 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.961331 19068 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:50.872241 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 329628us
W20260709 13:19:51.143484 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.024274 23149 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.968178 19070 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:50.969516 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:50.971616 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.944293 22878 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.925822 23028 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:50.989565 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.990154 19142 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:50.993152 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.950591 23163 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:50.950407 23146 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:50.911221 22960 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:50.996326 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 106963us
I20260709 13:19:51.023356 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:50.996096 23013 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:51.031663 23152 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:51.032269 23004 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.033540 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:51.034865 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:50.986378 23143 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.990891 23132 raft_consensus.cc:3055] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:51.140928 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 88696.3us
I20260709 13:19:50.990780 23174 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.966396 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:50.997366 23131 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11.
I20260709 13:19:51.146813 19068 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:51.038209 23020 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.296s
I20260709 13:19:51.406589 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:51.996151 19219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.001s	sys 0.000s
W20260709 13:19:52.042287 19219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.001s	sys 0.001s
I20260709 13:19:52.042425 19138 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.044579 19068 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:51.593658 19067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.028s	sys 0.055s
W20260709 13:19:52.045466 19067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.041s	sys 0.092s
I20260709 13:19:51.962258 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.043525 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:51.175352 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.048115 19146 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:52.097949 19217 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.093964 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 546) took 1008 ms. Trace:
I20260709 13:19:51.469219 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:52.093854 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2168) took 1077 ms. Trace:
I20260709 13:19:52.099139 19063 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:51.052991 23045 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.025941 23156 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.140655 23172 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.094377 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:51.170022 22840 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:51.692276 23149 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:51.142597 23000 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 1.049s
I20260709 13:19:51.558068 22923 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.370836 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.046211 19064 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:52.213275 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2155) took 1306 ms. Trace:
W20260709 13:19:51.956055 22713 consensus_meta.cc:287] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.958s	user 0.007s	sys 0.003s
I20260709 13:19:52.101285 23116 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.144799 23119 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:52.098673 19218 rpcz_store.cc:276] 0709 13:19:51.033064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.033218 (+   154us) service_pool.cc:224] Handling call
0709 13:19:52.041638 (+1008420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.168347 22912 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:52.101367 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 549) took 1065 ms. Trace:
W20260709 13:19:52.048895 19747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 595) took 1528 ms (client timeout 1919 ms). Trace:
I20260709 13:19:52.005215 23102 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.191901 23172 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.097615 23132 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:52.116214 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.519s (SENT) [suppressed 9 similar messages]
I20260709 13:19:52.201547 19066 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:51.261327 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:51.140251 23015 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.167198 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1836) took 1174 ms. Trace:
W20260709 13:19:51.833017 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.440578 23186 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.167116 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:51.171547 23144 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:51.942965 23153 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.193131 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.093700 23097 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:51.167896 23178 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:19:51.955267 23179 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:52.218541 19138 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:52.279367 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1834) took 1287 ms. Trace:
I20260709 13:19:52.093976 23174 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.226034 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:51.407636 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:51.998857 23139 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.169407 23196 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:19:51.605321 23136 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.169327 23160 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:52.101104 23112 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:51.695660 23009 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:51.642972 23147 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:51.467509 19212 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:51.442816 23150 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.467726 23022 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:51.407047 22778 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:52.192364 23152 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:19:52.196417 19146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2167) took 1250 ms (client timeout 1532 ms). Trace:
W20260709 13:19:52.365370 19146 rpcz_store.cc:269] 0709 13:19:50.945656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.954015 (+  8359us) service_pool.cc:224] Handling call
0709 13:19:52.187920 (+1233905us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.235348 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:52.236515 19215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.006s	sys 0.009s
I20260709 13:19:51.522145 23032 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.189803 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2156) took 1282 ms. Trace:
I20260709 13:19:52.370464 19069 rpcz_store.cc:276] 0709 13:19:50.906943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.465931 (+558988us) service_pool.cc:224] Handling call
0709 13:19:52.189677 (+723746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.237504 19213 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:52.097878 23163 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.214151 22775 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:19:52.378726 19716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.003s	sys 0.010s
W20260709 13:19:52.379132 19716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.003s	sys 0.011s
W20260709 13:19:52.246470 19113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.003s	sys 0.007s
W20260709 13:19:52.380396 19113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.003s	sys 0.007s
W20260709 13:19:52.234432 19747 rpcz_store.cc:269] 0709 13:19:50.503627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.504420 (+   793us) service_pool.cc:224] Handling call
0709 13:19:52.031460 (+1527040us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b54005730d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:52.031619 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103674240}
I20260709 13:19:52.212581 23013 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:52.253055 19070 raft_consensus.cc:2410] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:19:52.393180 19070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 439) took 1248 ms (client timeout 1519 ms). Trace:
W20260709 13:19:52.393571 19070 rpcz_store.cc:269] 0709 13:19:51.144664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.260950 (+116286us) service_pool.cc:224] Handling call
0709 13:19:52.393118 (+1132168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.099350 19142 rpcz_store.cc:276] 0709 13:19:50.963547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.963656 (+   109us) service_pool.cc:224] Handling call
0709 13:19:52.040892 (+1077236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.141245 23143 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.188105 23045 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.256534 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2154) took 1350 ms. Trace:
I20260709 13:19:51.468066 22952 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.768s
I20260709 13:19:52.254184 19145 rpcz_store.cc:276] 0709 13:19:50.992792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.992943 (+   151us) service_pool.cc:224] Handling call
0709 13:19:52.167123 (+1174180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.259935 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2002) took 1370 ms. Trace:
I20260709 13:19:52.234645 23131 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.213800 19064 rpcz_store.cc:276] 0709 13:19:50.906712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.949812 (+ 43100us) service_pool.cc:224] Handling call
0709 13:19:52.213208 (+1263396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.279691 19138 rpcz_store.cc:276] 0709 13:19:50.992038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.996976 (+  4938us) service_pool.cc:224] Handling call
0709 13:19:52.279304 (+1282328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.282246 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.280405 19214 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:52.406387 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:52.234652 19219 rpcz_store.cc:276] 0709 13:19:51.036059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.036185 (+   126us) service_pool.cc:224] Handling call
0709 13:19:51.036424 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.036583 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:51.307267 (+270684us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.101033 (+793766us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.101098 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:52.101154 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.101229 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.101318 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66823,"raft.queue_time_us":124882,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10556,"thread_start_us":935567,"threads_started":2,"wal-append.queue_time_us":638547}
I20260709 13:19:52.253887 23194 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:52.230916 22923 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:52.358328 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1835) took 1328 ms. Trace:
I20260709 13:19:52.232303 22713 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.235733 23119 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.234875 23116 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.362664 23150 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.411139 23013 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:52.326598 23188 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.698s	user 0.000s	sys 0.010s
W20260709 13:19:52.366933 19215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.006s	sys 0.010s
W20260709 13:19:52.236570 19216 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.002s	sys 0.015s
I20260709 13:19:52.451785 19140 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:52.452099 19216 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.002s	sys 0.015s
I20260709 13:19:52.277856 23165 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.322499 23144 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.358666 23000 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.397471 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 410) took 2065 ms. Trace:
I20260709 13:19:52.400537 23210 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.288192 23179 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.382170 22778 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:52.402043 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 285840us
I20260709 13:19:52.437470 23102 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.287916 23139 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.376948 23147 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:52.326996 23112 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.468161 23112 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.469242 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 415) took 1917 ms. Trace:
I20260709 13:19:52.458148 23000 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.469614 19143 rpcz_store.cc:276] 0709 13:19:50.551636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.563529 (+ 11893us) service_pool.cc:224] Handling call
0709 13:19:50.563892 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.585184 (+ 21292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.585214 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.585763 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.870172 (+284409us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:50.870210 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.870283 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.466214 (+1595931us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b54004130a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61034ffdbe 00007f610350a930 00007f610350a8d8 00007f610350a858 00007f610350a813 00007f6103509a9c 00007f61093f5626 00007f61093efdd8 00007f61035467cb 00007f61035492c0
0709 13:19:52.468954 (+  2740us) raft_consensus.cc:1685] finished
0709 13:19:52.468977 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.469181 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20862,"raft.queue_time_us":22064,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":47016,"spinlock_wait_cycles":16308480,"thread_start_us":283991,"threads_started":1,"wal-append.queue_time_us":362946}
I20260709 13:19:52.471482 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:52.471517 23000 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.232172 23093 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:52.472311 23093 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.474092 23119 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.474212 23093 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.286075 23097 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.475946 23004 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.364976 23022 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.478976 23022 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.480234 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 526) took 1626 ms. Trace:
I20260709 13:19:52.414453 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 441) took 1257 ms. Trace:
I20260709 13:19:52.411711 23132 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.415132 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:52.417130 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:52.417686 23205 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:52.418763 23130 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:52.419430 23143 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.421301 23045 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:52.422505 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.422842 23153 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.266948 23146 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:52.423748 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.423699 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:52.424324 23197 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.424710 23015 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.425304 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.426223 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:52.427250 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:52.395859 22775 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.404999 19072 rpcz_store.cc:276] 0709 13:19:50.889268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.889944 (+   676us) service_pool.cc:224] Handling call
0709 13:19:50.897936 (+  7992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.944648 (+ 46712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.259749 (+1315101us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5400035a50. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:52.259889 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4546432}
I20260709 13:19:52.412119 19217 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:52.259366 22912 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.432668 19068 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:52.424464 23131 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.278637 23186 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.438609 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 440) took 1293 ms. Trace:
I20260709 13:19:52.323067 23136 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.435752 19141 rpcz_store.cc:276] 0709 13:19:50.992421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.993274 (+   853us) service_pool.cc:224] Handling call
0709 13:19:51.027308 (+ 34034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.147748 (+120440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.147777 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.258428 (+110651us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.995746 (+737318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:51.995803 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.995900 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.320540 (+324640us) raft_consensus.cc:1685] finished
0709 13:19:52.320566 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.320745 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91651,"raft.queue_time_us":91793,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":102069,"thread_start_us":407533,"threads_started":1,"wal-append.queue_time_us":455313}
I20260709 13:19:52.393991 23200 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:52.603982 23153 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.604550 23139 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.605250 23200 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.554157 23000 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.606034 23004 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.606392 23000 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.327486 23160 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:52.361407 23009 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.405367 23202 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.360544 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2019) took 1185 ms. Trace:
I20260709 13:19:52.437587 23194 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:52.454945 19220 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:52.436606 23201 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:52.455653 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.452929 19139 rpcz_store.cc:276] 0709 13:19:50.331804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.341592 (+  9788us) service_pool.cc:224] Handling call
0709 13:19:50.341873 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.426768 (+ 84895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.426796 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.429525 (+  2729us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.796733 (+367208us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:50.796774 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.817500 (+ 20726us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b54002b8ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:50.817571 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.369389 (+1551818us) raft_consensus.cc:1685] finished
0709 13:19:52.369409 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.397394 (+ 27985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4484,"raft.queue_time_us":4899,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2604,"spinlock_wait_cycles":184151296,"thread_start_us":333484,"threads_started":1,"wal-append.queue_time_us":463030}
W20260709 13:19:52.401697 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 307407us
I20260709 13:19:52.625121 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:52.403252 19066 rpcz_store.cc:276] 0709 13:19:50.906459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.966161 (+ 59702us) service_pool.cc:224] Handling call
0709 13:19:52.256469 (+1290308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.404035 23152 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:52.458910 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 229405us
I20260709 13:19:52.483011 23132 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:52.465512 23149 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.482331 19221 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:52.482678 19070 rpcz_store.cc:276] 0709 13:19:51.157375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.413657 (+1256282us) service_pool.cc:224] Handling call
0709 13:19:52.413986 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.414152 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.414176 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.414218 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:52.414254 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.414305 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.414400 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:52.483538 19145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1845) took 1168 ms (client timeout 1532 ms). Trace:
W20260709 13:19:52.642534 19145 rpcz_store.cc:269] 0709 13:19:51.315092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.414894 (+1099802us) service_pool.cc:224] Handling call
0709 13:19:52.483482 (+ 68588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.488227 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2164) took 1622 ms. Trace:
I20260709 13:19:52.489333 19218 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:52.607388 23200 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.608712 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:52.609338 23136 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.644394 19140 rpcz_store.cc:276] 0709 13:19:50.865664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.865781 (+   117us) service_pool.cc:224] Handling call
0709 13:19:50.866100 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.452175 (+1586075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.488009 (+ 35834us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400327b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:52.488171 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3646234368}
I20260709 13:19:52.645218 23020 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:52.645897 19140 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:52.646293 23116 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.484172 23205 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:52.647441 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:52.647825 23179 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.647783 23205 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.649044 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:52.649242 23205 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.649768 22878 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:52.650231 22878 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:52.611070 19069 rpcz_store.cc:276] 0709 13:19:51.157000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.379474 (+1222474us) service_pool.cc:224] Handling call
0709 13:19:52.438547 (+ 59073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.651050 22878 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.652398 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 444) took 1374 ms. Trace:
I20260709 13:19:52.652730 19069 rpcz_store.cc:276] 0709 13:19:51.278169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.651654 (+1373485us) service_pool.cc:224] Handling call
0709 13:19:52.651940 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.652111 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.652135 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.652173 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:52.652203 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.652253 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.652345 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.654255 19069 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:52.488560 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51744 (request call id 33) took 1585 ms. Trace:
I20260709 13:19:52.655043 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:52.655030 19144 rpcz_store.cc:276] 0709 13:19:50.903133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.903258 (+   125us) service_pool.cc:224] Handling call
0709 13:19:52.488389 (+1585131us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54000ff5d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103584853 00007f610855260a 00007f6101ad87d4 00007f6101ad8762 00007f6101ad8691 00007f6101ad860c 00007f6101ad78c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:52.488483 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25266048}
I20260709 13:19:52.657096 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1842) took 1627 ms. Trace:
I20260709 13:19:52.657505 19144 rpcz_store.cc:276] 0709 13:19:51.029926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.656148 (+1626222us) service_pool.cc:224] Handling call
0709 13:19:52.656466 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.656672 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.656708 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.656762 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:52.656807 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.656903 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.657030 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.659525 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1843) took 1629 ms. Trace:
I20260709 13:19:52.659941 19144 rpcz_store.cc:276] 0709 13:19:51.030208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.658598 (+1628390us) service_pool.cc:224] Handling call
0709 13:19:52.658919 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.659131 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.659166 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.659222 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:52.659265 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.659328 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.659465 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.480584 19742 rpcz_store.cc:276] 0709 13:19:50.854002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.860787 (+  6785us) service_pool.cc:224] Handling call
0709 13:19:50.869404 (+  8617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.869765 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.869796 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.922242 (+ 52446us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b2c000f1058. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:19:50.927755 (+  5513us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.141945 (+214190us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:51.142003 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.142078 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.225296 (+1083218us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:52.480014 (+254718us) raft_consensus.cc:1685] finished
0709 13:19:52.480034 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.480155 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4003,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11548,"spinlock_wait_cycles":8013312,"thread_start_us":177736,"threads_started":1,"wal-append.queue_time_us":521829}
W20260709 13:19:52.577868 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.612614 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 445) took 1148 ms. Trace:
I20260709 13:19:52.610818 19138 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:52.511039 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:52.662652 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.554092 19147 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:52.616685 19212 rpcz_store.cc:276] 0709 13:19:51.174690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.276149 (+101459us) service_pool.cc:224] Handling call
0709 13:19:51.467209 (+191060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.360311 (+893102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.360501 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.615300 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2003) took 1725 ms. Trace:
W20260709 13:19:52.478996 23017 consensus_meta.cc:287] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.516s	user 0.011s	sys 0.000s
I20260709 13:19:52.668062 23097 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.623438 23202 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.668426 23017 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.669998 19142 raft_consensus.cc:2368] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:52.670135 23202 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.670439 23017 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.670768 19219 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.671161 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.671608 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.671872 19212 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.488245 22778 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.457482 23165 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:52.673938 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:52.493968 19063 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:52.464867 22840 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:52.674484 23193 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:19:52.674721 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2170) took 1620 ms. Trace:
I20260709 13:19:52.675086 19139 rpcz_store.cc:276] 0709 13:19:51.054000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.624012 (+1570012us) service_pool.cc:224] Handling call
0709 13:19:52.674650 (+ 50638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.676007 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.668095 23152 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.676621 19218 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:52.677067 23152 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:52.677567 23152 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:52.678447 23152 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.489499 23147 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:52.631311 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:52.690171 19141 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.619369 23112 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:19:52.634421 23150 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.635010 23131 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.636355 22912 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.484283 23130 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:52.637022 22775 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.541731 22929 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:52.461576 23028 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.484102 22713 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.639281 23009 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.697921 23139 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:52.720991 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.721189 23139 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:52.721634 23139 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.639608 23172 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.646461 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1841) took 1617 ms. Trace:
I20260709 13:19:52.648123 23020 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:52.661811 19064 rpcz_store.cc:276] 0709 13:19:51.464784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.427005 (+962221us) service_pool.cc:224] Handling call
0709 13:19:52.612552 (+185547us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:52.447590 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 1.03992e+06us
W20260709 13:19:52.662551 19138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1839) took 1633 ms (client timeout 1973 ms). Trace:
W20260709 13:19:52.730423 19138 rpcz_store.cc:269] 0709 13:19:51.028899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.426014 (+1397115us) service_pool.cc:224] Handling call
0709 13:19:52.662481 (+236467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.620710 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.731117 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:52.731827 19217 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.732852 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.734323 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.735217 19217 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:52.663903 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2169) took 1674 ms (client timeout 2116 ms). Trace:
I20260709 13:19:52.666250 19144 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:52.485351 22923 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.666807 19213 raft_consensus.cc:2368] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11.
I20260709 13:19:52.674263 23165 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.677525 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.454984 23204 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:52.630533 23160 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.487033 23163 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.680490 19219 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:52.681206 19063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2157) took 1774 ms (client timeout 2148 ms). Trace:
I20260709 13:19:52.663523 19068 rpcz_store.cc:276] 0709 13:19:50.890499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.890603 (+   104us) service_pool.cc:224] Handling call
0709 13:19:50.905158 (+ 14555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.614017 (+1708859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.615228 (+  1211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:52.767469 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 112481us
I20260709 13:19:52.622648 23197 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:52.686558 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 61538.7us
I20260709 13:19:52.771469 19141 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:52.772336 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2172) took 1598 ms. Trace:
I20260709 13:19:52.772614 19141 rpcz_store.cc:276] 0709 13:19:51.173872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.626260 (+1452388us) service_pool.cc:224] Handling call
0709 13:19:52.772271 (+146011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.672645 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.632370 23174 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:52.694052 19142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1840) took 1664 ms (client timeout 1859 ms). Trace:
W20260709 13:19:52.780498 19142 rpcz_store.cc:269] 0709 13:19:51.029185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.416891 (+1387706us) service_pool.cc:224] Handling call
0709 13:19:52.693800 (+276909us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400121454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:52.693982 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427405568}
W20260709 13:19:52.697532 19071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.010s	sys 0.038s
I20260709 13:19:52.697521 19139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:19:52.457903 23144 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:52.784844 19071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.011s	sys 0.038s
I20260709 13:19:52.785215 19139 raft_consensus.cc:606] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:52.785759 19139 raft_consensus.cc:614] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:52.786441 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.461247 23102 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.699018 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.708148 23153 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.708325 23130 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.694875 23147 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.541966 23141 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.724146 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 109431us
I20260709 13:19:52.724426 19140 rpcz_store.cc:276] 0709 13:19:51.029468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.645410 (+1615942us) service_pool.cc:224] Handling call
0709 13:19:52.645689 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.646245 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.646412 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:52.829088 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 547) took 1765 ms (client timeout 2137 ms). Trace:
I20260709 13:19:52.738693 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1844) took 1592 ms. Trace:
I20260709 13:19:52.741272 19143 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:52.699551 23201 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:52.739092 19147 rpcz_store.cc:269] 0709 13:19:50.989162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.989337 (+   175us) service_pool.cc:224] Handling call
0709 13:19:52.663839 (+1674502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.734313 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:52.755779 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.754585 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.459724 23210 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.766248 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2016) took 1592 ms. Trace:
I20260709 13:19:52.851414 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:52.685572 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57607.9us
I20260709 13:19:52.768165 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:52.768543 19063 rpcz_store.cc:269] 0709 13:19:50.907177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.373600 (+466423us) service_pool.cc:224] Handling call
0709 13:19:52.680854 (+1307254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.774507 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:52.786815 22923 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.791795 23132 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.792042 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:52.756808 23028 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:52.792887 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:52.867749 19742 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:19:52.793571 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:52.800369 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 443) took 1624 ms. Trace:
I20260709 13:19:52.868553 19070 rpcz_store.cc:276] 0709 13:19:51.175728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.641801 (+1466073us) service_pool.cc:224] Handling call
0709 13:19:52.642209 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.669197 (+ 26988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.669231 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.669274 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:52.669304 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.800095 (+130791us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b540020a654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:52.800153 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.800297 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61616000}
I20260709 13:19:52.869284 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:52.796599 19214 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:52.871712 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.872388 19214 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.823172 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:52.873610 19064 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.829572 19144 rpcz_store.cc:276] 0709 13:19:51.146334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.665550 (+1519216us) service_pool.cc:224] Handling call
0709 13:19:52.665880 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.738364 (+ 72484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.738616 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.834707 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:52.874591 19068 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.724560 22929 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:52.829473 19220 rpcz_store.cc:269] 0709 13:19:51.034400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.034550 (+   150us) service_pool.cc:224] Handling call
0709 13:19:52.799493 (+1764943us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400390dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:52.799629 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580813568}
I20260709 13:19:52.833865 23141 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.877832 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.878041 23136 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:52.878578 19220 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.850422 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.880249 19217 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.850471 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:52.881026 19069 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:52.855141 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:52.882187 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 147959us
I20260709 13:19:52.882464 19218 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.792912 22713 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.860152 19140 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:52.883832 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 115739us
I20260709 13:19:52.880295 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:52.861464 19221 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:52.851646 19216 rpcz_store.cc:276] 0709 13:19:51.173749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.276315 (+102566us) service_pool.cc:224] Handling call
0709 13:19:51.276715 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.276934 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:52.455082 (+1178148us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.765836 (+310754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.765900 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:52.765958 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.766043 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.766183 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30873,"prepare.queue_time_us":1047653,"prepare.run_cpu_time_us":2832,"prepare.run_wall_time_us":5010,"raft.queue_time_us":100,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":14582,"thread_start_us":1218297,"threads_started":2}
W20260709 13:19:52.862031 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.865207 19143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1838) took 1836 ms (client timeout 2181 ms). Trace:
W20260709 13:19:52.886101 19143 rpcz_store.cc:269] 0709 13:19:51.028554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.471232 (+1442678us) service_pool.cc:224] Handling call
0709 13:19:52.864992 (+393760us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002b75d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:52.865129 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570041600}
I20260709 13:19:52.866186 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.887959 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:52.888674 19069 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:52.890334 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:52.890733 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:52.893127 19216 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:52.893127 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:52.894212 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.895064 19070 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:52.851570 23202 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.860239 23130 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:52.879122 23189 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.500s	user 0.004s	sys 0.000s
I20260709 13:19:52.898958 19064 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:52.905725 23221 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:52.906278 23221 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:52.907315 23198 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.588s	user 0.002s	sys 0.001s
I20260709 13:19:52.880949 23028 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.891577 23004 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.895792 22713 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:52.983037 23195 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.774s	user 0.000s	sys 0.002s
I20260709 13:19:52.977969 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:53.036190 19214 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:19:53.037046 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2151) took 2136 ms. Trace:
I20260709 13:19:52.959124 23201 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.897361 23174 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:52.978303 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:52.956363 23221 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:53.005421 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.993327 23200 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:52.955513 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2018) took 1781 ms. Trace:
I20260709 13:19:52.878566 23150 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.955694 23009 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.958249 23210 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:52.910647 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:52.965978 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57877.9us
I20260709 13:19:53.030666 23020 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:52.986944 19068 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:52.955435 23015 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:52.767198 23204 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.878571 23136 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:52.907682 23197 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:52.961169 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:52.899943 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:53.083789 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 183920us
I20260709 13:19:53.084517 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:52.909909 19218 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:52.888556 23045 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.887667 23153 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.027796 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:53.028579 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 90810.3us
I20260709 13:19:53.091677 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:53.095671 19143 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:19:53.094501 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:53.098258 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:53.098968 19140 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.048857 23152 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.107445 23152 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.109366 19141 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:19:52.916886 19220 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:53.091496 19212 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:53.039148 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.109406 19035 leader_election.cc:400] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:53.113469 19035 leader_election.cc:403] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.113822 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.042869 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.038260 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.037388 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:53.044597 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 442) took 1887 ms. Trace:
I20260709 13:19:53.116595 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.037416 19071 rpcz_store.cc:276] 0709 13:19:50.893448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.894422 (+   974us) service_pool.cc:224] Handling call
0709 13:19:50.896954 (+  2532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.897151 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:51.029160 (+132009us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.368445 (+339285us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.403667 (+ 35222us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.475916 (+1072249us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b18000cb860. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:19:52.477283 (+  1367us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b18000cb860. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:19:52.998784 (+521501us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.029077 (+ 30293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.029127 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:53.029170 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.029247 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.029361 (+   114us) inbound_call.cc:177] Queueing success response
0709 13:19:53.031718 (+  2357us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
Metrics: {"mutex_wait_us":74392,"prepare.queue_time_us":1414836,"prepare.run_cpu_time_us":164,"prepare.run_wall_time_us":6753,"raft.queue_time_us":101519,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":39668,"spinlock_wait_cycles":667198336,"thread_start_us":1961255,"threads_started":4,"wal-append.queue_time_us":1233259}
I20260709 13:19:52.888077 22923 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.117604 19141 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.109517 19742 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:19:53.118409 19742 pending_rounds.cc:85] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 10
I20260709 13:19:53.118685 19742 pending_rounds.cc:107] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:19:53.119032 19742 raft_consensus.cc:2889] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.900542 23163 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:52.907222 23131 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:53.051306 19070 raft_consensus.cc:2410] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:52.902209 23160 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 13:19:53.050627 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:53.036914 23028 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:53.056753 23187 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.700s	user 0.001s	sys 0.002s
I20260709 13:19:53.056684 23017 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:53.041209 23004 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.057488 23141 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:53.058174 23190 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.695s	user 0.000s	sys 0.003s
I20260709 13:19:53.158054 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.059126 22929 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.046351 19215 rpcz_store.cc:276] 0709 13:19:51.174389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.175508 (+  1119us) service_pool.cc:224] Handling call
0709 13:19:51.375439 (+199931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.411642 (+ 36203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.411681 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.537506 (+125825us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.451812 (+914306us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:52.451855 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.451917 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.892534 (+440617us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:52.955182 (+ 62648us) raft_consensus.cc:1685] finished
0709 13:19:52.955214 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.955412 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35709,"raft.queue_time_us":36345,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":80354,"spinlock_wait_cycles":381675776,"thread_start_us":805934,"threads_started":1,"wal-append.queue_time_us":673876}
I20260709 13:19:53.158463 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.062289 22713 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.064474 19219 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
W20260709 13:19:53.065467 23212 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:19:53.046851 23156 consensus_meta.cc:287] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.000s
I20260709 13:19:53.030851 23146 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:19:53.054168 23000 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:53.055431 23009 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.066111 23020 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.053180 23150 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:52.899484 23032 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
I20260709 13:19:53.070132 23144 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:52.908499 23202 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.048099 23174 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:53.049229 23186 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:53.079682 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.225430 19068 raft_consensus.cc:2410] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:53.085798 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2027) took 1086 ms. Trace:
I20260709 13:19:53.226114 19218 rpcz_store.cc:276] 0709 13:19:51.999575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.897670 (+898095us) service_pool.cc:224] Handling call
0709 13:19:52.909637 (+ 11967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.085452 (+175815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.085748 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.047004 23200 consensus_queue.cc:1243] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:53.026252 19217 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:53.229065 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:52.957304 23102 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.101847 22878 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:53.102236 19142 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:53.102275 23172 raft_consensus.cc:2764] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:53.106127 22912 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:53.238551 23202 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.238729 22912 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:53.106632 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:53.116055 19072 rpcz_store.cc:276] 0709 13:19:51.157673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.661525 (+1503852us) service_pool.cc:224] Handling call
0709 13:19:52.673170 (+ 11645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.673383 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:52.862523 (+189140us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.044313 (+181790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.044362 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:53.044403 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.044461 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.044551 (+    90us) inbound_call.cc:177] Queueing success response
0709 13:19:53.105580 (+ 61029us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b48002dc6d8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61084b3aa1 00007f61084aab37 00007f61084aa9ca 00007f61085a226f 00007f61085a1f37 00007f61085b655c 00007f61085b6508 00007f61085b6488 00007f61085b6443 00007f61085b56ec 00007f61074dfa96
Metrics: {"mutex_wait_us":134522,"prepare.queue_time_us":368639,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":149029,"raft.run_wall_time_us":58889,"spinlock_wait_cycles":24492800,"thread_start_us":222156,"threads_started":2,"wal-append.queue_time_us":105562}
I20260709 13:19:53.031563 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.239753 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:52.887552 23132 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.186463 22840 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:52.991401 23194 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.123677 19035 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:53.132164 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.124468 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2022) took 1161 ms. Trace:
W20260709 13:19:53.243459 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 119852us
I20260709 13:19:53.151248 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.152429 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:53.153733 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 103160us
I20260709 13:19:53.247004 19742 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
I20260709 13:19:53.155529 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.112191 22775 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:53.058259 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2150) took 2165 ms. Trace:
I20260709 13:19:53.249063 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:53.234992 23190 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.006s
I20260709 13:19:53.159241 19141 raft_consensus.cc:2410] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:53.160120 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:53.123611 23191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.009s	sys 0.013s
W20260709 13:19:53.154793 23169 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.026s
I20260709 13:19:53.161674 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.163887 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.165705 19144 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.125521 23013 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.091094 23107 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:19:53.157963 23131 consensus_queue.cc:1243] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:53.125919 23163 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.126196 23152 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.169184 23156 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.172770 23004 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.141810 23017 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:53.161724 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.178434 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.180100 19750 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:53.142304 23165 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:19:53.111058 23045 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.181102 23009 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.182727 23020 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.184453 23150 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.221673 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.221971 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.184932 23144 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:53.224260 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.173924 23160 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:53.166158 23015 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:19:53.188460 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.225725 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 91780.2us
W20260709 13:19:53.223338 23232 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:19:53.237010 23222 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:19:53.237305 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:53.237385 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:53.238221 23139 consensus_meta.cc:287] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.516s	user 0.002s	sys 0.008s
I20260709 13:19:53.238384 23147 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.120664 19064 raft_consensus.cc:2410] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:53.239923 19139 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.173604 22713 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:19:53.120646 19140 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
W20260709 13:19:53.241888 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.248266 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2000) took 2362 ms. Trace:
I20260709 13:19:53.111183 23205 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:53.251071 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 118964us
I20260709 13:19:53.252080 19066 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:19:53.253213 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.253683 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:53.255826 19742 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:53.462294 23160 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.462723 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.463330 19742 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:53.463773 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:53.464318 19066 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.464663 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.465126 19143 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.465795 19140 raft_consensus.cc:2368] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:53.243556 19221 rpcz_store.cc:276] 0709 13:19:51.962694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.892495 (+929801us) service_pool.cc:224] Handling call
0709 13:19:52.914755 (+ 22260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.914985 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:53.029774 (+114789us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.124235 (+ 94461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.124285 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:53.124319 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.124360 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.124429 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10262,"prepare.queue_time_us":115302,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3511,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":16184,"thread_start_us":93155,"threads_started":1,"wal-append.queue_time_us":142461}
I20260709 13:19:53.457953 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.324699 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.249240 19065 rpcz_store.cc:276] 0709 13:19:50.893059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.893170 (+   111us) service_pool.cc:224] Handling call
0709 13:19:50.905997 (+ 12827us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:50.926618 (+ 20621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.926650 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:50.945977 (+ 19327us) log.cc:844] Serialized 52 byte log entry
0709 13:19:51.368707 (+422730us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:51.368746 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.368829 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.704902 (+1336073us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:53.057985 (+353083us) raft_consensus.cc:1685] finished
0709 13:19:53.058006 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.058204 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7846,"raft.queue_time_us":21084,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":12484,"spinlock_wait_cycles":220380928,"thread_start_us":320370,"threads_started":1,"wal-append.queue_time_us":1318750}
I20260709 13:19:53.454470 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.467471 19138 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.468557 19212 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:53.462005 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1842) took 1062 ms. Trace:
I20260709 13:19:53.469372 19219 rpcz_store.cc:276] 0709 13:19:52.399369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.671364 (+271995us) service_pool.cc:224] Handling call
0709 13:19:53.461776 (+790412us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b54001d6354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:53.461915 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19170176}
I20260709 13:19:53.469830 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:53.255822 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:53.470383 19067 rpcz_store.cc:276] 0709 13:19:50.886040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.886154 (+   114us) service_pool.cc:224] Handling call
0709 13:19:50.886483 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.911725 (+ 25242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.911766 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.922466 (+ 10700us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.046136 (+1123670us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:52.046173 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.046246 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.053898 (+1007652us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:19:53.240998 (+187100us) raft_consensus.cc:1685] finished
0709 13:19:53.241017 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.248192 (+  7175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35380,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":10867,"spinlock_wait_cycles":290093312,"thread_start_us":1083079,"threads_started":1,"wal-append.queue_time_us":1301124}
I20260709 13:19:53.473410 19220 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:53.479811 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:53.474416 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.480638 19219 raft_consensus.cc:2376] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12. Re-sending same reply.
I20260709 13:19:53.480841 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.481462 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:53.482110 19220 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.482296 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:53.482661 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 322618us
I20260709 13:19:53.483031 19140 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.483736 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.484354 19140 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.485441 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:53.477547 23188 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:19:53.486123 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.486359 23020 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.243566 22878 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:53.486622 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.486862 23020 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.487238 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.487296 22878 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.487984 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.488445 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.488742 19218 raft_consensus.cc:2410] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:53.252399 23136 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.488984 23153 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:53.489465 23153 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:53.474107 23169 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.020s	sys 0.038s
I20260709 13:19:53.489861 23153 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.472458 23015 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.485913 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.252274 22840 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.490674 23015 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.491335 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.491886 19064 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:53.492131 22840 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:53.492942 19748 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:53.485944 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.493522 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1837) took 2500 ms. Trace:
I20260709 13:19:53.494349 23009 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.478446 23139 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.496389 23139 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.497226 19213 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:53.492650 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.497853 19147 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.497750 19217 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:53.493203 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.391594 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.497982 19064 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:53.612814 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.605402 19066 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:53.391454 19184 connection.cc:256] RPC call timeout handler was delayed by -1.5497230280000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23470000000000002s for a response
I20260709 13:19:53.618468 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.487344 19215 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:53.620594 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.622002 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.562752 19220 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:53.623823 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.252238 23146 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:53.597837 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:53.472834 23191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.009s	sys 0.039s
I20260709 13:19:53.627424 19746 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:53.570753 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:53.562980 23211 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.201s
I20260709 13:19:53.699220 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:53.563400 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 82184.7us
I20260709 13:19:53.701133 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.701759 19215 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:53.702842 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.702754 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:53.703433 19215 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.601897 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.704623 19144 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:53.268380 23000 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:53.479821 23102 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:53.705531 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.706120 19144 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:53.705858 23102 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.706990 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.707671 19144 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:53.626065 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:53.708747 19212 raft_consensus.cc:2368] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
W20260709 13:19:53.633522 23190 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:53.635545 22840 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.709499 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.710563 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.711058 19212 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 8.
I20260709 13:19:53.599473 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.711972 19139 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.712733 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.464119 23194 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.713263 19139 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:53.714133 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.714238 23045 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.714632 19139 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:53.715479 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.718824 23237 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:53.719367 23237 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.688372 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.720258 19063 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:19:53.721040 23146 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:53.721196 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.721557 23237 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:53.721938 23028 consensus_meta.cc:287] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
W20260709 13:19:53.393183 23233 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:19:53.722343 23028 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.722584 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.493141 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.641886 19216 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:53.724145 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.724413 23028 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.724722 19216 raft_consensus.cc:2376] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9. Re-sending same reply.
I20260709 13:19:53.708914 23102 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.725330 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.633196 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.725562 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.644761 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.634822 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.634815 23202 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:53.726382 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.726613 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.726814 23202 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:53.533113 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.687316 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:53.711072 23156 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:53.601675 19744 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:53.727098 19219 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:53.685817 19067 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:53.727962 23202 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.517640 19068 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:53.729200 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.729214 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:53.730280 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 197256us
W20260709 13:19:53.396103 23229 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:19:53.482331 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.367622 23186 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.493857 19145 rpcz_store.cc:276] 0709 13:19:50.993092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.643513 (+1650421us) service_pool.cc:224] Handling call
0709 13:19:52.643947 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.689867 (+ 45920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.689912 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.703692 (+ 13780us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.771875 (+ 68183us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:52.900630 (+128755us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.901002 (+   372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.901096 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.493321 (+592225us) raft_consensus.cc:1685] finished
0709 13:19:53.493340 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.493473 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59897,"prepare.queue_time_us":275033,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":53045,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":5949,"thread_start_us":161733,"threads_started":2,"wal-append.queue_time_us":313551}
I20260709 13:19:53.693229 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.693631 23020 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.694032 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.473542 23172 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:53.478022 23144 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.465588 23163 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:53.634639 23150 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:19:53.237316 23174 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.720579 19140 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:53.765462 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.766053 19140 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:53.726465 19141 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:53.767292 23147 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.713286 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.767952 23147 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.768582 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.728443 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.769416 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.769845 19066 raft_consensus.cc:2393] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 10: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.770052 19140 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
W20260709 13:19:53.392498 23231 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:19:53.392727 23230 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
I20260709 13:19:53.730437 19221 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:53.401459 23204 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.580375 19143 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:53.688537 19142 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:53.480304 23205 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.743454 23028 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.727056 19218 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:53.729368 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.720199 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.795019 19139 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:53.790236 19216 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:53.733413 19071 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:53.736356 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.738354 19138 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:53.796504 19067 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:53.691435 23132 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.720232 23194 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:53.480005 23141 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.391853 23032 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:53.744325 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.742148 19749 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:53.346230 22912 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.609083 23004 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.759230 19113 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:53.803615 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 44460.9us
I20260709 13:19:53.805349 19113 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.806937 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:53.762027 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.767230 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:53.769484 23160 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:53.808365 19141 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:53.686853 19748 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:53.737326 23000 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:53.769196 19065 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:53.792074 19140 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:53.775452 22923 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.326489 22775 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:53.798265 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 308391us
I20260709 13:19:53.745337 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:53.757351 23186 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.740482 23153 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.724165 23146 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.765882 23172 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.730283 19219 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:53.800904 19138 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:53.819986 19064 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:53.811378 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:53.853397 19113 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:53.854095 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:53.854543 23020 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:19:53.854722 22775 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.855656 23020 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:53.855752 23013 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:53.860157 22929 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:53.860520 22929 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:53.769218 23017 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.815779 23004 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.861271 22929 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.862541 22929 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.863655 23004 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:53.814901 23131 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.812887 23015 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.809846 23132 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.870504 19144 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:19:53.871335 19145 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:53.877172 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.878055 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.878229 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.878887 19219 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:53.879122 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:53.879877 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:53.880524 19219 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:53.881234 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.883980 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:53.878389 19035 leader_election.cc:400] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:53.884920 19035 leader_election.cc:403] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.884166 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:53.886974 19146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2171) took 2713 ms (client timeout 1792 ms). Trace:
I20260709 13:19:53.878618 19748 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:53.802048 23194 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:53.887355 19146 rpcz_store.cc:269] 0709 13:19:51.173490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.423454 (+1249964us) service_pool.cc:224] Handling call
0709 13:19:53.886784 (+1463330us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400220454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:53.886912 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185352576}
I20260709 13:19:53.888650 19221 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:53.889319 23015 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:53.886083 19113 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.893608 23177 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:53.806509 23141 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:53.897073 22840 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:53.892691 19072 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
W20260709 13:19:53.899500 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.964936 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 78944.8us
I20260709 13:19:53.901546 19069 raft_consensus.cc:2368] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
I20260709 13:19:53.873354 22923 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:53.874794 23139 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:53.929078 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.899220 23131 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:53.966747 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:53.983748 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:53.856099 23020 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:53.964010 23177 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:53.886672 23150 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.808972 23032 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:53.869248 23102 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:19:53.978454 22923 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:53.982966 23131 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.886166 23221 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:19:54.012210 19215 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
W20260709 13:19:53.979543 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 357588us
I20260709 13:19:54.000914 23132 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.021591 23131 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.992695 23015 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:54.022246 23141 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:54.023121 23244 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:19:54.058786 23201 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.059325 23201 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:54.062522 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2023) took 1002 ms. Trace:
I20260709 13:19:54.062975 19072 rpcz_store.cc:276] 0709 13:19:53.060403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.240200 (+179797us) service_pool.cc:224] Handling call
0709 13:19:54.062287 (+822087us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54002cc754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:54.062447 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884573056}
I20260709 13:19:53.902060 23013 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:19:54.024925 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:53.991891 23139 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:54.037282 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.068740 19215 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:54.056241 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.069725 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.070638 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.071997 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.029387 23132 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.057013 19064 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:19:54.039088 23015 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:54.064785 19072 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:19:54.080171 19072 pending_rounds.cc:85] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 6
I20260709 13:19:54.080422 19072 pending_rounds.cc:107] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:19:54.014708 23242 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10.
I20260709 13:19:54.010843 22923 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.084024 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 554) took 1542 ms. Trace:
I20260709 13:19:54.084547 19213 rpcz_store.cc:276] 0709 13:19:52.541517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.755572 (+214055us) service_pool.cc:224] Handling call
0709 13:19:54.083784 (+1328212us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b540035c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:54.083952 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520278784}
I20260709 13:19:54.085855 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.076336 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.008929 23205 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:54.017861 22878 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:54.080646 19072 raft_consensus.cc:2889] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.072788 19219 raft_consensus.cc:2368] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11.
I20260709 13:19:54.090020 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.091312 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.092446 22878 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.094949 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2011) took 1321 ms. Trace:
I20260709 13:19:54.095465 19063 rpcz_store.cc:276] 0709 13:19:52.773770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.869055 (+ 95285us) service_pool.cc:224] Handling call
0709 13:19:54.094747 (+1225692us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b540025d854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:54.094879 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955537152}
W20260709 13:19:54.099886 23235 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.498s	user 0.000s	sys 0.001s
I20260709 13:19:54.100113 22878 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:54.104445 23205 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.104936 23205 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:54.105378 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.107309 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.108074 19216 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:54.111002 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.111608 19215 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:54.111901 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.100865 22778 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.117161 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.128471 19213 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:54.134677 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:54.135040 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:54.133335 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.142736 19748 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:54.158221 19749 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.158625 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.142159 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:54.136842 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.151340 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.135695 19216 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 8: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:54.134394 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:54.164742 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.135129 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.079672 23132 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.169785 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.170732 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.171211 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.077540 22840 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.081561 23015 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.173918 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:54.172976 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.131152 23247 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:54.186975 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:54.172358 19038 leader_election.cc:400] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9.
I20260709 13:19:54.060389 23201 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.178257 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2041) took 1140 ms. Trace:
I20260709 13:19:54.180575 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.105402 23205 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.193137 19212 rpcz_store.cc:276] 0709 13:19:53.037432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.169264 (+1131832us) service_pool.cc:224] Handling call
0709 13:19:54.178182 (+  8918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.148170 22778 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:54.194780 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 316497us
I20260709 13:19:54.195204 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.202245 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.202730 19215 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:54.131367 23144 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:54.079517 22775 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:19:54.171900 23248 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.187219 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.207913 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2042) took 1170 ms. Trace:
I20260709 13:19:54.197124 19144 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:54.211683 19215 rpcz_store.cc:276] 0709 13:19:53.038399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.174151 (+1135752us) service_pool.cc:224] Handling call
0709 13:19:54.207855 (+ 33704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.067839 23020 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.213714 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:54.214547 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.241057 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.242542 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.243003 19212 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:54.243183 19216 raft_consensus.cc:2376] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10. Re-sending same reply.
I20260709 13:19:54.244135 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.244894 19212 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:54.203157 23160 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.245532 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.245956 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.246529 19035 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.248433 19212 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:54.249478 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.250272 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.111878 23177 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.208426 23204 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.213711 23247 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:54.291087 23243 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:54.290933 23247 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.291675 23243 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:54.241617 23172 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.214116 23201 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.256691 22778 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.297736 22778 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.255323 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.243350 23186 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:54.262507 23245 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:19:54.299196 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 43965.2us
I20260709 13:19:54.246306 23139 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.299937 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.214423 23248 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:54.300851 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.301081 23248 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.264145 23152 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.270905 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:54.271648 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:54.304045 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.305444 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.305853 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.306563 19215 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:54.273414 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1838) took 2011 ms. Trace:
I20260709 13:19:54.307089 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 559) took 1208 ms. Trace:
I20260709 13:19:54.304400 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.307466 19214 rpcz_store.cc:276] 0709 13:19:52.262142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.272521 (+2010379us) service_pool.cc:224] Handling call
0709 13:19:54.272837 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.273051 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.273078 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.273131 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.273165 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.273224 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.273332 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.308293 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.273834 23153 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.275242 23032 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:54.277545 23177 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:54.302273 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.309432 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1839) took 2025 ms. Trace:
I20260709 13:19:54.318678 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.318869 19214 rpcz_store.cc:276] 0709 13:19:52.284436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.308628 (+2024192us) service_pool.cc:224] Handling call
0709 13:19:54.308913 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.309072 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.309095 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.309135 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.309176 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.309249 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.309365 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.307528 19215 rpcz_store.cc:276] 0709 13:19:53.098610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.248112 (+1149502us) service_pool.cc:224] Handling call
0709 13:19:54.307038 (+ 58926us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.319766 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.311164 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.311475 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.320812 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:54.313948 23163 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.003s
I20260709 13:19:54.311700 23009 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.255930 23160 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.322619 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.326162 19214 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:54.326809 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1841) took 1967 ms. Trace:
I20260709 13:19:54.327117 19214 rpcz_store.cc:276] 0709 13:19:52.359937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.325714 (+1965777us) service_pool.cc:224] Handling call
0709 13:19:54.326014 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.326550 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.326750 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.328260 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:54.324285 19749 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:54.330075 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:54.330231 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 132800us
I20260709 13:19:54.331771 19141 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:54.321784 19216 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:54.333029 19144 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:54.333042 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.334301 19141 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:54.336280 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.338382 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.338541 19144 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:54.340723 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 206707us
I20260709 13:19:54.343205 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:54.346706 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.347692 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.317013 23165 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.318392 23000 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:54.356221 23000 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:54.356703 23000 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.335245 23163 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.360261 19219 raft_consensus.cc:2368] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:19:54.343268 23153 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.361308 23163 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:54.318459 23150 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.362774 23150 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:54.363229 23150 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:54.364151 23150 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.317740 23256 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.353812 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.353966 23009 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.337311 23004 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.361402 23153 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.364862 23160 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:54.365754 19142 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:54.337333 23242 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:54.420255 23242 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:54.421362 23242 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.292797 23243 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.424154 22840 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:54.379027 23165 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.424633 22840 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:54.424790 23165 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.425516 22840 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.426458 22840 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.369230 22923 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.370110 22878 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.312016 23172 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.363350 23131 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.440307 23131 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.441114 19141 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:54.372977 23028 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:54.350996 23221 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.442034 23221 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.442414 23221 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.443023 23000 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.443814 19219 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:54.444957 23172 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.445148 23000 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.445396 23172 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:54.445653 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1858) took 1363 ms (client timeout 1772 ms). Trace:
I20260709 13:19:54.403991 23205 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:19:54.446053 19217 rpcz_store.cc:269] 0709 13:19:53.082562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.230098 (+147536us) service_pool.cc:224] Handling call
0709 13:19:54.445500 (+1215402us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54001d6854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:54.445602 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591069952}
I20260709 13:19:54.446552 19220 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:54.447329 19217 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.447531 23205 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:54.447904 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1851) took 2002 ms. Trace:
I20260709 13:19:54.440315 22923 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:54.448451 22878 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.449787 19218 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:54.450344 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1853) took 1757 ms. Trace:
I20260709 13:19:54.331471 23201 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.318437 22929 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.450592 22878 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.450917 22929 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.451361 22929 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.453143 23017 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.378611 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1849) took 1951 ms. Trace:
I20260709 13:19:54.457568 19215 rpcz_store.cc:276] 0709 13:19:52.427681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.341882 (+1914201us) service_pool.cc:224] Handling call
0709 13:19:54.356654 (+ 14772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.378175 (+ 21521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.378221 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.378283 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.378336 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.378412 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.378545 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.444425 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1850) took 2016 ms. Trace:
I20260709 13:19:54.458588 19219 rpcz_store.cc:276] 0709 13:19:52.427950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.443208 (+2015258us) service_pool.cc:224] Handling call
0709 13:19:54.443510 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.444185 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.444374 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.459244 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1855) took 1665 ms. Trace:
I20260709 13:19:54.459633 19215 rpcz_store.cc:276] 0709 13:19:52.794304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.458501 (+1664197us) service_pool.cc:224] Handling call
0709 13:19:54.458771 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.458926 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.458959 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.458997 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:54.459032 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.459087 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.459191 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.460198 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 556) took 1416 ms. Trace:
I20260709 13:19:54.363276 19144 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:54.460602 19219 rpcz_store.cc:276] 0709 13:19:53.043868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.459302 (+1415434us) service_pool.cc:224] Handling call
0709 13:19:54.459583 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.459757 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.459929 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.459972 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:54.460003 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.460059 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.460149 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.385644 19216 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.385459 23256 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:54.399006 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 52452.2us
I20260709 13:19:54.412974 23153 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.417914 23152 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.351279 23255 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:54.418535 23132 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.431310 19214 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:54.429549 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.462495 19744 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:54.445246 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 530) took 1337 ms. Trace:
I20260709 13:19:54.463625 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 557) took 1415 ms. Trace:
I20260709 13:19:54.450515 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.448228 19217 rpcz_store.cc:276] 0709 13:19:52.445178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.446902 (+2001724us) service_pool.cc:224] Handling call
0709 13:19:54.447169 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.447680 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.447843 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.464933 19218 rpcz_store.cc:276] 0709 13:19:52.693334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.449242 (+1755908us) service_pool.cc:224] Handling call
0709 13:19:54.449517 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.450138 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.450296 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.462632 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 561) took 1336 ms. Trace:
I20260709 13:19:54.469466 23201 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:54.471271 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.506400 19219 rpcz_store.cc:276] 0709 13:19:53.126417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.461743 (+1335326us) service_pool.cc:224] Handling call
0709 13:19:54.461987 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.462146 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.462368 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.462411 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:54.462444 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.462496 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.462584 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.507664 19217 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:54.486992 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.509734 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 80267.2us
I20260709 13:19:54.508950 19217 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.524755 19215 rpcz_store.cc:276] 0709 13:19:53.047714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.460470 (+1412756us) service_pool.cc:224] Handling call
0709 13:19:54.460733 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.463219 (+  2486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.463271 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.463329 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:54.463373 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.463446 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.463568 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.509565 19750 rpcz_store.cc:276] 0709 13:19:53.107663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.109645 (+  1982us) service_pool.cc:224] Handling call
0709 13:19:53.109936 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.472092 (+362156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.445032 (+972940us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b540059f6d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:54.445193 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156055936}
W20260709 13:19:54.532058 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 81604.8us
W20260709 13:19:54.533835 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 202867us
W20260709 13:19:54.534212 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 63043.4us
I20260709 13:19:54.531123 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.536269 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.512632 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.535211 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.470708 23256 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.552426 19216 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:54.556623 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.469218 23028 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:54.557725 19216 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:54.558768 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.560712 19140 raft_consensus.cc:2368] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
W20260709 13:19:54.538769 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 227368us
I20260709 13:19:54.533253 23215 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.569128 19749 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.533032 23102 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.571106 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.536296 22923 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.470392 23248 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.583993 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:54.558564 23141 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.545193 22778 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.545887 23177 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:54.533061 23201 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.585073 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:54.590320 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:54.580787 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.536448 22878 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:19:54.588248 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.582453 19216 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:54.590885 19749 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:54.592054 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 419) took 1733 ms (client timeout 1846 ms). Trace:
I20260709 13:19:54.592000 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.593286 19138 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:54.592623 19147 rpcz_store.cc:269] 0709 13:19:52.858922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.880085 (+ 21163us) service_pool.cc:224] Handling call
0709 13:19:54.591871 (+1711786us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400220e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:54.591999 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409094528}
I20260709 13:19:54.595489 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:54.589517 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 253304us
I20260709 13:19:54.596115 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:54.605655 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.609432 19068 pending_rounds.cc:85] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 5
I20260709 13:19:54.609776 19068 pending_rounds.cc:107] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:54.610054 19068 raft_consensus.cc:2889] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:54.613512 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.614943 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.618005 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.577144 23102 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.624069 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.625087 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.625952 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.576383 23160 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.657435 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.627247 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.596210 19743 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:54.615763 19067 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:54.659732 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.661093 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:54.656083 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:54.656177 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 64269.5us
I20260709 13:19:54.662612 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:54.663369 19066 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.666556 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.667186 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.672907 19216 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:54.587495 23215 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.587186 23141 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.594254 23205 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.677052 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.539186 23255 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.679406 19063 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:54.678718 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.680495 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.683246 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.700965 19065 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:54.678786 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.570417 23028 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.694764 19749 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:19:54.581698 23032 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:19:54.590858 23177 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:54.664990 23247 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:54.567556 23163 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:19:54.704193 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.680239 23186 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:54.704916 19216 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:19:54.715312 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.705271 19066 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:19:54.655417 23102 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.585532 22923 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.684482 22778 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.708045 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.589028 23015 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.665513 23144 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.686333 23174 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.677843 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.724481 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:54.726488 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 182034us
I20260709 13:19:54.726873 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.727988 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.709043 23169 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.709311 23177 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.712632 23004 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:54.696548 23141 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.687044 23202 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.695853 23136 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.720924 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.703768 23268 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:54.718075 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 185175us
I20260709 13:19:54.732344 19143 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:54.742712 19038 leader_election.cc:400] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11.
I20260709 13:19:54.744014 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.716802 23215 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:54.725324 23247 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:54.711443 22929 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.754858 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:54.760357 19221 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:54.735229 23144 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.731208 23269 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:54.740439 23268 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.768644 23132 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.747213 23242 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:54.761314 23202 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.749125 23131 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.741043 23270 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:54.776757 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48880.4us
I20260709 13:19:54.747443 23004 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:54.778012 19069 raft_consensus.cc:2368] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:54.746956 23136 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:54.789424 23275 log.cc:927] Time spent T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:54.770810 23009 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.791055 22923 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.777580 23268 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:54.786085 23236 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 1.547s	user 0.003s	sys 0.007s
W20260709 13:19:54.809681 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 105570us
I20260709 13:19:54.785425 23202 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.795885 23131 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.813897 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:54.792516 23000 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:54.813889 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.761686 23215 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:54.810741 23260 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.597s	user 0.008s	sys 0.000s
I20260709 13:19:54.796741 23270 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.832901 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:54.831569 23132 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.837908 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:54.837996 23132 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.839010 23136 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.839650 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.818949 23202 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.793872 23280 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:19:54.820288 23248 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:54.823719 23131 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.832156 23242 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:19:54.798158 23146 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:54.845880 23132 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:54.888731 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.846153 23255 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.850703 23215 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:54.851567 23273 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:54.901196 23146 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:54.844554 23160 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.842289 23247 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.901580 23146 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:54.901736 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1836) took 2664 ms. Trace:
I20260709 13:19:54.901731 23160 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.902828 23160 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.903288 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:54.840270 23200 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.853530 23280 consensus_queue.cc:1243] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:54.902192 19212 rpcz_store.cc:276] 0709 13:19:52.236957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.304698 (+2067741us) service_pool.cc:224] Handling call
0709 13:19:54.305026 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.310317 (+  5291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.310343 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.324946 (+ 14603us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.575919 (+250973us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:54.575953 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.576011 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.901510 (+325499us) raft_consensus.cc:1685] finished
0709 13:19:54.901537 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.901679 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4912,"raft.queue_time_us":5011,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2043,"thread_start_us":221392,"threads_started":1,"wal-append.queue_time_us":372982}
I20260709 13:19:54.835870 23270 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.845052 22775 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.855079 23015 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.834414 23169 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.857149 23004 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.865985 23284 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.860246 23172 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.934376 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:54.868542 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2066) took 1040 ms. Trace:
I20260709 13:19:54.865761 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:19:54.867908 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 180682us
I20260709 13:19:54.887339 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:54.863240 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.892815 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:54.935638 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.869801 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.935051 19219 rpcz_store.cc:276] 0709 13:19:53.827627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.507849 (+680222us) service_pool.cc:224] Handling call
0709 13:19:54.508296 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.533763 (+ 25467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.533791 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.557661 (+ 23870us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.814400 (+256739us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.814456 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.814527 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.868284 (+ 53757us) raft_consensus.cc:1685] finished
0709 13:19:54.868310 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.868473 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5019,"raft.queue_time_us":27321,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":16532,"thread_start_us":223820,"threads_started":1,"wal-append.queue_time_us":284354}
I20260709 13:19:54.937142 19147 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:54.937644 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.895146 19146 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:54.938644 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:54.897795 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.899082 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1861) took 1021 ms. Trace:
I20260709 13:19:54.941025 19138 rpcz_store.cc:276] 0709 13:19:53.877389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.877535 (+   146us) service_pool.cc:224] Handling call
0709 13:19:54.593070 (+715535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.593785 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.898901 (+305116us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400220e50. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:54.899027 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644872064}
I20260709 13:19:54.904603 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:54.942634 19066 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:54.935523 19142 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:54.910815 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 166890us
W20260709 13:19:54.911901 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.854027 23153 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.936069 19070 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:54.957135 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.957773 23153 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:54.958189 19070 raft_consensus.cc:2410] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:54.831636 23288 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.918232 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.958755 23288 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.959231 19068 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:54.959290 23288 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.960382 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.861193 23028 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:54.961383 23028 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.961927 23028 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.964303 23028 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:54.858439 22929 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:54.922405 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:54.928289 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:54.831792 23000 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.828401 23201 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:54.915974 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:54.844755 23186 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.966624 23186 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.967126 23186 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.973799 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:54.974848 19070 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:54.975952 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.977695 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:54.978355 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.845322 23136 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 13:19:54.983946 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 76101.6us
W20260709 13:19:54.980294 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 142876us
I20260709 13:19:54.982398 19144 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:54.991005 19066 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:19:54.993177 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:54.993657 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:54.996028 19139 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:54.996273 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:54.997162 19063 raft_consensus.cc:2368] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:54.860796 23221 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:54.928212 23132 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.999157 19184 leader_election.cc:400] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
I20260709 13:19:55.067109 19184 leader_election.cc:403] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:54.935979 23284 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:54.866156 23165 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:54.917482 23200 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.992247 23017 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.992165 22923 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.979832 22775 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:54.902393 23146 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:54.998435 23028 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:19:55.001643 23292 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.003957 23136 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.992440 23256 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.042786 19065 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:55.007302 23201 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:55.045131 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:55.098924 19065 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:55.099471 19750 raft_consensus.cc:2410] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:55.068975 23296 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.047073 19142 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:19:55.058423 23172 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.059509 23204 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:55.043988 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 303584us
W20260709 13:19:55.064071 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 70514.9us
I20260709 13:19:55.064649 19066 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:55.067655 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:55.069658 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 70681.6us
I20260709 13:19:55.075549 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.127117 19144 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:19:55.066375 23020 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.073338 23302 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11.
I20260709 13:19:55.083125 19071 raft_consensus.cc:2368] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:55.084026 23165 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.087188 19064 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.131170 23200 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.131532 23102 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.104839 23141 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.133560 23102 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.134310 19068 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.134392 23202 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.117554 23204 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.071210 23284 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.138028 23177 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.139997 23177 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:55.072984 23017 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:55.141219 23017 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.142693 19067 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:55.143150 23204 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.145015 23204 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.150422 23131 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.099649 19065 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:55.115553 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.115669 19072 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.157878 19065 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.114959 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.133797 23141 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:55.118291 23299 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:55.120121 23256 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.168578 23141 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:55.168732 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53881.9us
I20260709 13:19:55.100037 23136 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:55.170291 23221 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:55.170372 23136 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.170545 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.070703 23132 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.099912 23201 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:55.082446 23186 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.125247 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:55.109748 23146 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.128985 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:55.152029 19066 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:55.107697 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 88974.7us
W20260709 13:19:55.175642 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 46750.9us
W20260709 13:19:55.129417 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 190824us
I20260709 13:19:55.176456 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.176537 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.173058 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.153561 19146 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:55.180143 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.181396 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.166435 23268 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:55.174872 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49704.7us
I20260709 13:19:55.182207 19139 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:55.187804 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.189771 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.190529 19139 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:55.191350 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:55.191479 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.185204 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.173653 23144 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.193070 23204 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:55.193518 23204 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.193922 23204 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.183604 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.197715 19744 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:55.198256 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:19:55.198783 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.199836 19038 leader_election.cc:400] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:19:55.200157 19038 leader_election.cc:403] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.202911 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:55.198791 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.204370 23295 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.200778 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.213415 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:55.214413 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.172211 23194 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.211985 23020 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:19:55.216956 23247 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:55.217274 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.217809 23020 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:55.218298 23020 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:55.219099 23020 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.220095 23284 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.220960 23301 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:55.222311 23301 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:55.223845 23287 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:55.224215 23287 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:55.226178 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.226568 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.185833 23221 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.234506 19743 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:55.231284 19065 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:55.187472 23256 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:55.232453 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.190146 23028 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:55.186213 23141 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:55.218037 23169 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.238306 19065 pending_rounds.cc:85] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 7
I20260709 13:19:55.220566 23020 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.206241 23177 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.228061 23004 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.249946 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:55.213248 23144 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.225311 22840 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.210837 23102 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.216579 23200 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:55.248735 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.190133 23302 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:19:55.259922 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.262571 23256 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:55.263055 23256 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:55.263868 23256 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.248934 23013 consensus_queue.cc:1059] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:55.265784 23013 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:55.266089 23013 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:55.269274 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.269941 19217 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:55.272584 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.249037 23141 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.275167 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.249497 23169 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:55.231794 23296 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:19:55.255427 22840 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:55.270148 23295 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.249917 19065 pending_rounds.cc:107] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:55.277122 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.241122 23194 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:19:55.248340 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49636.2us
I20260709 13:19:55.253931 23247 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:55.280465 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:55.281445 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.215693 22923 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.281399 19212 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:55.256616 23028 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:55.255074 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 62966.3us
I20260709 13:19:55.288347 19065 raft_consensus.cc:2889] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:55.311764 19110 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:55.282297 23169 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.316745 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.286304 22840 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.325842 19139 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.289319 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.331357 23009 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:55.331873 23009 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.332080 19221 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:55.269330 23102 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:55.336833 19140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2194) took 1203 ms (client timeout 1541 ms). Trace:
W20260709 13:19:55.337262 19140 rpcz_store.cc:269] 0709 13:19:54.133190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.134717 (+  1527us) service_pool.cc:224] Handling call
0709 13:19:55.336636 (+1201919us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54000febd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:55.336774 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901109632}
I20260709 13:19:55.338519 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.339069 19140 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.285002 23200 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:55.340612 23200 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.352200 19139 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:55.289494 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.241510 23201 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.290899 23294 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:55.291492 23281 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:55.370275 23281 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.370646 23201 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.370555 23136 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.372300 23281 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:55.292827 19068 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:55.293740 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.294924 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.295107 23017 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.296293 23132 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.297477 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.298329 23268 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.272380 23202 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:55.278861 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.336843 23102 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.255059 22929 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:55.389976 19138 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:55.266870 23013 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.276827 23141 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.312917 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:55.394413 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 81576.9us
I20260709 13:19:55.376916 23136 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:55.303892 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.268918 23153 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:19:55.397907 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 94104us
I20260709 13:19:55.400236 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.292635 23160 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.318317 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.258528 23287 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.321192 22923 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.288226 23295 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:55.321662 23186 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:55.321979 23028 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.323987 23131 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.322018 23284 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:55.369426 23294 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.378898 19221 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:55.382701 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 85304.8us
I20260709 13:19:55.397053 23132 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.418139 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:55.301791 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:55.419395 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 133612us
I20260709 13:19:55.384253 19217 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.427691 19038 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.386050 19140 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:55.388790 23204 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.395337 19110 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:55.288512 19219 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.433516 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:55.402431 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.337491 23288 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.385667 23221 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.436033 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.417515 19212 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:55.429675 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.408706 22923 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.411038 23302 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.315940 23270 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.439388 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:55.439576 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.446401 19746 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:55.441504 19217 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:55.416524 23136 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.448338 19142 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:55.415416 23287 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.410775 23295 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.416086 23312 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.450814 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.409317 23202 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:55.453280 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.434334 23102 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.435873 23172 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:55.456462 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 105203us
I20260709 13:19:55.457468 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.448371 23194 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.461263 19145 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:55.462338 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.456053 23132 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:55.479434 23132 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.479796 23132 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.447476 23020 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:55.441205 22923 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:55.483353 23267 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.746s	user 0.002s	sys 0.000s
I20260709 13:19:55.485306 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.466822 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.465736 19216 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:55.461499 19219 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:55.468209 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:55.469067 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.407887 23247 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:55.469386 23317 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:19:55.470003 23309 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:19:55.445659 23281 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:19:55.448422 23296 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:55.477793 23294 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.478287 23160 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:55.490839 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.449098 23302 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.463841 23172 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:55.495183 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.506397 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.506448 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.508975 23017 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:55.509202 23255 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:19:55.509523 23302 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:55.511011 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.512187 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.512274 23000 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.513501 19071 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.515419 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.458513 23292 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:55.505934 23172 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:55.516649 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1865) took 1190 ms. Trace:
I20260709 13:19:55.517043 19143 rpcz_store.cc:276] 0709 13:19:54.326389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.326554 (+   165us) service_pool.cc:224] Handling call
0709 13:19:54.326800 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.741994 (+415194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.516438 (+774444us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54001798d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:55.516598 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932211072}
I20260709 13:19:55.512709 19144 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:55.502233 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.476722 23004 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.502245 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.491603 23256 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:55.525535 19216 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:19:55.515094 22840 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.527400 23215 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.528368 23215 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.529121 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.529645 19140 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.530306 23215 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.531114 23281 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:55.531455 23281 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:55.532250 23281 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.533510 23281 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.524971 22960 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:55.540982 23102 consensus_queue.cc:1175] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "55991c1f7f474a9888725d00438d8a83" responder_term: 9 status { last_received { term: 8 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:55.541972 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2071) took 1713 ms. Trace:
I20260709 13:19:55.542352 19215 rpcz_store.cc:276] 0709 13:19:53.828977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.526475 (+697498us) service_pool.cc:224] Handling call
0709 13:19:54.526790 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.719617 (+192827us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:54.812044 (+ 92427us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.928417 (+116373us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.928464 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.928502 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.541770 (+613268us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400100254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:55.541812 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.541924 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58423,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":32750,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":443002240,"thread_start_us":197677,"threads_started":2,"wal-append.queue_time_us":193808}
I20260709 13:19:55.543743 23009 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.544170 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.532032 23295 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.547720 23295 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.549817 23256 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:55.550701 23256 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.553236 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.553835 19215 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:55.540630 23172 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.554565 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.555101 19215 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:19:55.555879 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.556130 23169 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:55.498596 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 103372us
I20260709 13:19:55.525591 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.504561 23248 consensus_queue.cc:1059] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:55.556808 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.565677 19221 raft_consensus.cc:2410] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:55.562621 19717 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:55.565872 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:55.561839 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.571341 19140 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:55.571564 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.572454 19216 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:55.564466 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1883) took 1401 ms. Trace:
I20260709 13:19:55.563105 19110 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:55.572844 19140 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:55.574244 19213 rpcz_store.cc:276] 0709 13:19:54.162987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.170457 (+  7470us) service_pool.cc:224] Handling call
0709 13:19:55.564254 (+1393797us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540034ce54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:55.564403 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948667776}
I20260709 13:19:55.576073 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.571373 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.563541 19143 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:55.580245 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.580595 19184 leader_election.cc:400] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:55.581051 19184 leader_election.cc:403] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.520637 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.582307 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:55.582837 19219 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:55.583076 19067 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:55.585955 19219 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:55.589684 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.593220 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.594827 19215 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:55.595043 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:55.595940 19219 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:19:55.596506 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 75960.6us
I20260709 13:19:55.597846 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:55.558377 22929 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.602541 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.595592 19213 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:55.610713 19140 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:55.604350 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.611191 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.616437 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.606980 19746 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:55.617467 19065 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.623986 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.624442 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.625144 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.571043 23172 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.628330 19064 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:55.593824 23146 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:55.593607 23280 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.593907 23287 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.637400 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.601495 23268 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:55.626140 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:55.623168 23201 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.626575 19071 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:55.601771 23211 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:55.633937 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:19:55.629011 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48588.7us
I20260709 13:19:55.636955 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.641114 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:55.646734 19064 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:19:55.647483 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.647971 19064 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.642380 19067 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:19:55.644269 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.651080 19184 leader_election.cc:400] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:55.651440 19184 leader_election.cc:403] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:55.635692 23323 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.654563 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.654695 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.655102 19071 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.657526 23132 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:55.658177 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:55.658820 19065 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:55.659173 19145 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:55.659606 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.570501 22923 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.660634 19140 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:55.667763 23323 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.660571 23294 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:19:55.668569 23201 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:55.663105 19071 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:55.674598 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:55.675357 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.676286 19071 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.667157 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:55.670917 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.632126 23000 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.637339 23302 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:55.677271 19065 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:55.625612 23255 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:55.627331 23248 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:19:55.660499 23132 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:55.679318 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 75057.5us
I20260709 13:19:55.689659 19064 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:55.642333 23268 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:55.691751 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.695701 19071 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.693958 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.667906 23160 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
W20260709 13:19:55.699783 19214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1888) took 1375 ms (client timeout 1655 ms). Trace:
I20260709 13:19:55.667346 22840 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:55.704859 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.708781 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:55.699798 19070 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
W20260709 13:19:55.700366 19214 rpcz_store.cc:269] 0709 13:19:54.324922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.327986 (+  3064us) service_pool.cc:224] Handling call
0709 13:19:55.699668 (+1371682us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540034a8d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:55.699741 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235115392}
I20260709 13:19:55.709893 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:19:55.702644 19141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1868) took 1373 ms (client timeout 1828 ms). Trace:
W20260709 13:19:55.710443 19141 rpcz_store.cc:269] 0709 13:19:54.329064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.342980 (+ 13916us) service_pool.cc:224] Handling call
0709 13:19:55.702510 (+1359530us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b54002a7e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:55.702602 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223381760}
I20260709 13:19:55.711459 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:55.694257 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.710034 19214 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:55.689939 23015 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.690318 23028 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:55.715392 19141 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:55.729825 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 96327.5us
I20260709 13:19:55.720259 19140 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:55.733608 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.737445 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:55.739274 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:55.740788 19141 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:55.742259 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 61142.7us
I20260709 13:19:55.743985 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:55.703318 23268 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:55.745081 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:55.747799 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.746820 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.711794 23248 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:55.751596 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.751827 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:55.753281 19071 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:55.755935 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:55.714572 23017 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:55.743479 23000 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:19:55.749763 23248 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:55.757226 23295 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.757664 23288 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.712134 23009 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:55.749555 23132 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:55.765033 23136 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.766360 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:55.766860 23243 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.767935 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.773484 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:55.728598 23169 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:55.775499 23278 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.923s	user 0.005s	sys 0.000s
I20260709 13:19:55.776710 23204 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.782239 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.783828 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2034) took 1166 ms. Trace:
W20260709 13:19:55.784921 19069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2178) took 1166 ms (client timeout 1541 ms). Trace:
I20260709 13:19:55.786054 19066 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:55.727982 22923 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:55.743377 23313 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:55.741240 23141 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:55.745533 23028 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:55.795612 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:55.750450 23015 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.041826 19064 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:56.042841 19072 rpcz_store.cc:276] 0709 13:19:54.617206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.617752 (+   546us) service_pool.cc:224] Handling call
0709 13:19:55.783646 (+1165894us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b5400036954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:55.783761 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142493440}
I20260709 13:19:56.043200 19110 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.040838 19214 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:56.040266 19069 rpcz_store.cc:269] 0709 13:19:54.618684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.658444 (+ 39760us) service_pool.cc:224] Handling call
0709 13:19:55.784725 (+1126281us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540025c954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:55.784849 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250941312}
I20260709 13:19:56.045014 19216 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:56.042265 19140 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
W20260709 13:19:56.045428 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 279109us
I20260709 13:19:55.941944 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.961402 19063 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:55.880911 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:55.746078 19141 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:55.922163 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.055120 19213 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:56.056568 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.057241 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.058290 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.058787 19217 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.062537 19221 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:56.064095 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.065832 19216 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:56.067490 23169 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:56.073017 22840 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:56.096838 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 361026us
I20260709 13:19:56.074278 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.074880 23287 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:56.076013 23132 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:56.077481 23323 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.077632 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.103610 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.041864 23015 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.084563 19068 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.084641 19217 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:56.068329 22923 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.061532 23313 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:56.080487 23160 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.090724 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 552) took 3604 ms. Trace:
I20260709 13:19:56.056849 23017 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.084309 23247 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:56.097864 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.111907 19220 rpcz_store.cc:276] 0709 13:19:52.486735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.447689 (+1960954us) service_pool.cc:224] Handling call
0709 13:19:54.447973 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.448304 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.448332 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.448778 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.681964 (+233186us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:54.682000 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.682076 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.775125 (+1093049us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b24001df018. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003239c4 00007f6100321acb 00007f61004dcdc9 00007f61004dca55 00007f61004dc09d 00007f610310e10e 00007f610312588c 00007f6103124bb6 00007f61031247d8 00007f610312e221
0709 13:19:56.087243 (+312118us) raft_consensus.cc:1685] finished
0709 13:19:56.087269 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.090657 (+  3388us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1086,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3006,"spinlock_wait_cycles":18013952,"thread_start_us":232364,"threads_started":1,"wal-append.queue_time_us":368343}
I20260709 13:19:56.105788 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.096499 23169 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.116564 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.118796 19113 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.114701 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.121752 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:56.125455 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 141875us
I20260709 13:19:56.127272 19038 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.128202 19038 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:56.107817 23015 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.107712 23163 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:56.113248 23205 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.112419 23295 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:56.113622 23017 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.106389 23136 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.135558 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.136487 23165 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.125352 23169 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.126830 22923 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.115628 23247 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.115265 23197 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:56.143067 23270 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.148532 23292 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.164340 23268 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.153052 22960 raft_consensus.cc:3055] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.159297 19217 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:56.128134 23323 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.136868 19214 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:56.193742 19751 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.130764 23255 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:56.129020 22840 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.175336 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.092756 23248 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.174245 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.132030 23332 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:56.133880 23163 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:56.170063 23205 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.135489 19139 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:56.183195 19746 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.132748 22775 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:56.171208 23139 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.182942 23165 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.198800 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:56.159209 23132 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.132921 22912 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:19:56.131886 23315 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:19:56.194700 22960 raft_consensus.cc:740] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:56.210376 19748 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.136732 23313 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.118664 23028 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.201553 23280 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.202510 23255 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.205708 23205 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.201845 23332 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:56.216440 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 86790.3us
I20260709 13:19:56.220191 19751 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:56.200521 23330 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:19:56.225685 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 51695.4us
I20260709 13:19:56.209007 23339 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.217607 23280 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.202786 23292 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.221019 23204 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:56.229351 23211 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.237320 22960 consensus_queue.cc:260] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.218286 23146 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:19:56.212529 23139 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.224272 23332 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:56.243189 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.250952 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 123537us
I20260709 13:19:56.251667 23102 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:56.260574 23330 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:56.261631 23330 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:56.261976 23330 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:56.262818 23330 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.264019 23330 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.240646 23015 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.270933 23015 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.233458 23280 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.271605 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.275360 23247 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:56.251443 23169 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.278409 19221 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:19:56.213244 23243 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:56.231186 19113 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.245322 23204 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.230443 23141 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.277541 23139 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:56.284281 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53202.7us
I20260709 13:19:56.288120 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.286047 23204 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.288573 23131 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:56.305744 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 96167.3us
I20260709 13:19:56.308352 23139 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:56.308921 23139 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.309324 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.310278 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.311004 19144 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.311100 23348 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:56.311870 23348 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.312651 19144 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:56.313294 23139 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:56.314077 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:56.314535 19144 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:56.315085 19749 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:56.317518 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.317821 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.318435 19139 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.307245 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.284799 23009 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.285764 23015 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.290006 22960 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.322487 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.323185 19144 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:56.304563 23201 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.240927 23165 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.254900 23211 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.336702 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.337674 23243 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.344826 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.325719 23139 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.344995 23015 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.345315 23242 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:56.358455 23242 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:56.359275 23242 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:56.359747 23242 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.304297 23255 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:56.342598 23132 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.349139 23313 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:19:56.356396 23169 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:56.387037 23353 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.387717 23353 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.327564 23009 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.388634 23353 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.392387 23353 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.362147 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:56.394680 23336 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:56.395217 23336 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:56.396267 23336 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.397601 23313 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:56.398677 23313 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:19:56.412604 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 67893.7us
I20260709 13:19:56.414769 19139 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:19:56.417462 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.420969 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:56.421659 19217 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:56.344230 23243 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:56.424100 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 116941us
I20260709 13:19:56.399715 23313 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.397779 23336 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.428013 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:56.442066 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.400971 23352 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:56.426302 23211 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.426633 23197 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:56.456840 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 549) took 1251 ms. Trace:
I20260709 13:19:56.444171 23356 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:56.360632 23242 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.450974 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 1899) took 1170 ms. Trace:
I20260709 13:19:56.477183 19212 rpcz_store.cc:276] 0709 13:19:55.280515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.316537 (+ 36022us) service_pool.cc:224] Handling call
0709 13:19:56.450786 (+1134249us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b540032dcd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:56.450898 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229510016}
I20260709 13:19:56.442945 19139 raft_consensus.cc:2410] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:56.455719 23355 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:56.452486 23131 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:19:56.458760 23205 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:56.465278 23343 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:19:56.457952 23201 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:19:56.457252 19743 rpcz_store.cc:276] 0709 13:19:55.205780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.205904 (+   124us) service_pool.cc:224] Handling call
0709 13:19:56.456704 (+1250800us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b54006234d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:56.456799 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26467072}
I20260709 13:19:56.442480 23015 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:56.447746 23352 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:56.480424 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53539.5us
W20260709 13:19:56.484126 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.492442 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.445433 23139 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:19:56.470573 23009 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:56.487898 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 74290.8us
I20260709 13:19:56.487488 23015 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.494897 23352 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.476842 23197 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.497406 23348 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:56.519556 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.534621 23280 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.536356 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1875) took 1336 ms. Trace:
I20260709 13:19:56.512053 23015 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:56.545791 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 47747.8us
I20260709 13:19:56.547313 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.536775 19142 rpcz_store.cc:276] 0709 13:19:55.199906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.201099 (+  1193us) service_pool.cc:224] Handling call
0709 13:19:55.201359 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.448784 (+247425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.536135 (+1087351us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540010e854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:56.536302 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567361280}
W20260709 13:19:56.556296 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 63419us
I20260709 13:19:56.536618 23280 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.566306 19070 raft_consensus.cc:1240] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:56.569979 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.570871 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.572779 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:56.573434 19063 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:56.573925 23358 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:56.575205 23358 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:56.577047 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.578141 23000 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.581642 23268 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.557891 23332 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.584141 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.585011 23313 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:56.585381 23313 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:56.585669 23332 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.586077 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.586165 23313 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.587340 23313 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.589411 23365 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:56.593001 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:56.564036 23361 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.567659 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.613235 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 433) took 1627 ms. Trace:
I20260709 13:19:56.613682 19138 rpcz_store.cc:276] 0709 13:19:54.986032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.986169 (+   137us) service_pool.cc:224] Handling call
0709 13:19:54.986524 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.390468 (+403944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.612977 (+1222509us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54002b7fd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:19:56.613164 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927256448}
W20260709 13:19:56.615913 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 48309.9us
I20260709 13:19:56.586212 23332 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.567027 23102 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:56.619220 23332 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.624364 23242 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:56.625865 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.634987 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.627919 23367 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.621537 23205 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:56.618824 23361 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:56.629438 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.635568 19067 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.629802 23359 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.630684 23165 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:56.631263 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.632226 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1885) took 1393 ms. Trace:
I20260709 13:19:56.640729 23367 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.641336 23355 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:56.641422 18964 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 115) took 20577 ms (client timeout 15000 ms). Trace:
I20260709 13:19:56.643661 19751 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.643971 23004 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:56.645061 19063 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.635223 23332 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.632776 23280 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.617439 23204 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.619099 23152 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.663039 23165 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.636010 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:56.672574 19748 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:56.653082 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:56.673223 19072 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:56.656308 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:56.658844 19145 rpcz_store.cc:276] 0709 13:19:55.239287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.515191 (+275904us) service_pool.cc:224] Handling call
0709 13:19:56.632012 (+1116821us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540018a454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:19:56.632161 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328007424}
I20260709 13:19:56.651728 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.664369 19065 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:56.675333 19068 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.617668 23017 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.671789 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:56.676636 19139 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:56.681064 23204 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:56.662652 18964 rpcz_store.cc:269] 0709 13:19:36.063777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.064061 (+   284us) service_pool.cc:224] Handling call
0709 13:19:56.641321 (+20577260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:52.277461 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:52.392547 (+115086us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:52.404601 (+ 12054us) write_op.cc:435] Acquired schema lock
0709 13:19:52.411239 (+  6638us) tablet.cc:662] Decoding operations
0709 13:19:52.414996 (+  3757us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:52.415070 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:52.415095 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:19:52.416353 (+  1258us) tablet.cc:701] Row locks acquired
0709 13:19:52.416394 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:19:52.416581 (+   187us) write_op.cc:270] Start()
0709 13:19:52.416727 (+   146us) write_op.cc:276] Timestamp: P: 1783603192416499 usec, L: 0
0709 13:19:52.416745 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:52.481172 (+ 64427us) log.cc:844] Serialized 5474 byte log entry
0709 13:19:53.045528 (+564356us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f61004800ac 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b
0709 13:19:54.263614 (+1218086us) op_driver.cc:464] REPLICATION: finished
0709 13:19:54.595089 (+331475us) write_op.cc:301] APPLY: starting
0709 13:19:54.655249 (+ 60160us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:54.723237 (+ 67988us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:54.731965 (+  8728us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:54.862827 (+130862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:54.994125 (+131298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:19:54.997973 (+  3848us) write_op.cc:312] APPLY: finished
0709 13:19:55.013409 (+ 15436us) log.cc:844] Serialized 101 byte log entry
0709 13:19:55.013590 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:55.013732 (+   142us) write_op.cc:454] Released schema lock
0709 13:19:55.013809 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:55.014244 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:55.014273 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":314852,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":331197,"apply.run_cpu_time_us":10741,"apply.run_wall_time_us":419128,"num_ops":14,"prepare.queue_time_us":1194048,"prepare.run_cpu_time_us":72526,"prepare.run_wall_time_us":1462431,"raft.queue_time_us":349678,"raft.run_cpu_time_us":45158,"raft.run_wall_time_us":328780,"replication_time_us":1824134,"spinlock_wait_cycles":62439680,"thread_start_us":1932419,"threads_started":4,"wal-append.queue_time_us":691670,"wal-append.run_cpu_time_us":50303,"wal-append.run_wall_time_us":2934377}]]}
I20260709 13:19:56.681558 23017 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.664748 23355 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.683432 23197 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.684456 23355 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.685542 23367 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.685738 23352 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.688011 23152 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.690624 23152 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:56.691020 22775 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:56.691419 22775 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:56.692132 22775 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.676604 19071 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:19:56.693252 22775 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.666999 23280 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:19:56.695407 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 471328us
I20260709 13:19:56.696344 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.698164 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.699482 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:56.699671 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.701925 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.703234 19071 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:56.704694 19067 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:56.707283 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.708950 22923 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:56.709201 23345 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:56.710147 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.710202 22923 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:56.710776 22923 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:56.711784 22923 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.702622 23295 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:19:56.714114 23295 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.714522 23295 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:56.715442 23295 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.716452 19213 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:56.670773 23361 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.731578 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:56.732728 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:56.717948 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:56.721930 19067 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:56.718247 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.718523 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.735641 19214 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.659945 23359 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.717391 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:56.733505 19216 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:56.725471 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.743287 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:56.719643 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.747256 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.748278 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:56.706002 23336 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:56.707175 23004 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.749987 23169 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:56.718135 23205 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.750352 23361 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.752171 23248 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.752802 19717 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:56.753571 23352 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.677222 23353 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:19:56.790849 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:56.791003 23353 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:56.791443 23353 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.716838 23295 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.757513 19066 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:56.794590 23292 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:56.758370 23359 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:56.745510 23197 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:56.797392 23197 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.798424 19748 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:19:56.799466 23197 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:56.799996 23197 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.802186 23163 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.803406 23163 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.760268 23336 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:56.805197 23336 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:56.745777 23204 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:19:56.774243 23169 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.817667 23131 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.818701 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.819499 19147 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:56.757539 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:56.760948 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 64669.1us
I20260709 13:19:56.763243 19214 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:19:56.821646 19066 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:56.822062 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.822973 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.823622 19147 raft_consensus.cc:2368] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:56.717900 23174 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.763934 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:56.770506 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 45155.9us
W20260709 13:19:56.771580 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.694957 23280 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.770749 19068 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:56.743016 23202 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.742375 23367 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.840152 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:56.843820 19746 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:56.776732 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:19:56.778311 23369 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:19:56.778971 23374 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:56.781780 23358 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:56.783823 23368 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:56.774088 23247 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:56.784101 22960 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.788229 23165 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.774358 23102 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.777556 23205 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.772118 23004 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:56.790108 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:56.769733 22923 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:56.825963 19142 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:56.882495 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.883251 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.883926 19142 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.830005 19063 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:56.885476 23186 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.885870 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:56.886154 23186 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.886679 19063 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:56.832170 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:56.849171 23313 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:56.832644 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.800379 23197 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:56.845806 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 81964.6us
I20260709 13:19:56.834705 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.847618 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:56.850008 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:19:56.851146 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 74493.7us
I20260709 13:19:56.850272 19038 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.902208 19068 raft_consensus.cc:2368] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:56.902921 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.853453 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.817821 23017 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:56.909157 19143 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:56.910125 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.911123 19143 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:19:56.854192 23358 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:56.912261 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:56.913008 19065 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.914835 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:56.915818 19212 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:56.860319 19144 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.792285 23353 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.864245 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:56.818200 23131 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:56.892503 19063 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:56.861241 23330 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.861167 23301 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.889118 23004 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.852751 19145 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:56.849038 23174 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:56.930958 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 96331.4us
W20260709 13:19:56.919631 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.931615 19218 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:19:56.931963 19218 pending_rounds.cc:85] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:56.932163 19218 pending_rounds.cc:107] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:19:56.932255 19113 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:56.920106 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 69886.7us
I20260709 13:19:56.832352 19071 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:56.921612 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:56.932708 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 68573.6us
I20260709 13:19:56.922112 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.932404 19218 raft_consensus.cc:2889] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.899495 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:56.849999 23367 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.850111 23202 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:56.938866 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.939517 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.944520 19142 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:56.940630 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:56.894565 23247 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:56.877573 23153 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:19:56.961357 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.954463 19746 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:56.951282 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:56.957844 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:56.919518 22960 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.967233 19142 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:56.966159 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.968364 19035 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:56.948696 23242 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.971040 19213 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:56.953001 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:56.972631 19144 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:56.931126 23009 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:56.975013 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:56.975731 19067 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:56.980108 19067 pending_rounds.cc:85] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 5
I20260709 13:19:56.980356 19067 pending_rounds.cc:107] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:56.980583 19067 raft_consensus.cc:2889] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.949369 23287 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:56.978873 19750 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:56.932720 23186 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:56.956724 23313 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:57.002490 19065 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:56.970121 23353 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.007957 19216 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:56.974359 23352 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:56.977947 23032 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:56.974198 23359 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.982434 23141 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.940034 23301 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.020609 23197 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:56.967264 23177 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:57.024127 23280 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.014518 23352 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.964134 23347 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:19:57.092106 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 123825us
I20260709 13:19:57.004267 23330 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:57.038555 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.008672 23281 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:57.014923 23288 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:57.037135 23032 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:56.977988 23247 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:57.044507 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 112318us
I20260709 13:19:57.030596 23205 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:19:57.078852 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.080354 19743 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.999619 23160 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:57.018165 23348 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.090785 23301 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:57.093984 19145 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:19:57.094225 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.099483 23287 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:56.972100 23332 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.000953 23009 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.093092 23352 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:57.102583 23015 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 13:19:57.165661 23015 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.168488 19141 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:57.098744 22775 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:57.169312 22775 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:57.170177 22775 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.171483 22775 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.095916 19221 raft_consensus.cc:2410] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:19:57.098369 23281 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:57.174465 23242 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.174780 23009 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.174522 23281 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.117553 23288 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:57.095211 23330 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:57.131783 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:57.132822 18959 maintenance_manager.cc:419] P 1b2c4f6d390c49c387cc446ceb8d00e4: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033402
W20260709 13:19:57.202432 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 70737.6us
I20260709 13:19:57.203899 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:57.143750 23202 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.144462 23032 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.145538 23367 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:57.153174 23378 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:57.155478 23132 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:57.157639 23131 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.158390 23174 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:57.165812 23336 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:57.128742 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.176614 23281 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:57.209975 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 208020us
I20260709 13:19:57.213104 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:57.216276 19751 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:57.218760 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.229943 19146 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:57.245865 19219 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:57.230376 19138 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:57.176940 23376 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:19:57.190181 23013 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.192996 23205 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:57.207892 23330 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.207476 23292 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.247756 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.213653 23353 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:57.244383 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1907) took 1744 ms. Trace:
I20260709 13:19:57.249712 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.183926 23004 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.251324 19218 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:57.266638 19218 pending_rounds.cc:85] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 5
I20260709 13:19:57.266922 19218 pending_rounds.cc:107] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:57.267195 19218 raft_consensus.cc:2889] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.253739 23388 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.256841 19749 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:57.248325 23313 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:57.240484 23132 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:57.260632 19215 rpcz_store.cc:276] 0709 13:19:55.500155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.595543 (+ 95388us) service_pool.cc:224] Handling call
0709 13:19:55.595830 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:55.596149 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.596175 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:55.596691 (+   516us) log.cc:844] Serialized 52 byte log entry
0709 13:19:56.784087 (+1187396us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b1800480ee0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:19:56.959225 (+175138us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:56.968940 (+  9715us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.979043 (+ 10103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.979112 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.241279 (+262167us) raft_consensus.cc:1685] finished
0709 13:19:57.244170 (+  2891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.244327 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9859,"prepare.queue_time_us":49613,"raft.queue_time_us":15256,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":34104,"spinlock_wait_cycles":10486400,"thread_start_us":174920,"threads_started":1,"wal-append.queue_time_us":1534756}
I20260709 13:19:57.254016 23131 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:19:57.249948 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:57.256616 23205 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:57.244787 23243 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.208709 23015 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.278362 19143 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:57.241238 23389 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:57.271070 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.271970 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.134313 23287 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.261803 23353 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.283169 23287 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.284454 23004 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.176761 23288 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.230634 23242 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:57.275329 19746 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:57.229125 23165 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:19:57.288244 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:57.288595 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:57.289264 23131 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.289703 23131 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.289769 19746 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 10: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:57.179891 23358 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.283226 23353 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.258155 23146 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:19:57.274066 23292 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.260955 23359 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:19:57.262171 23352 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.308825 19141 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:57.290097 23131 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.317377 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:57.319743 23132 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.321202 23132 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.306762 23355 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:57.322124 23355 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:57.322924 23355 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.324528 23355 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.328552 23313 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.342554 23205 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.343712 23205 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.306581 23292 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:57.350507 23395 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:57.353636 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:57.357813 23141 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:57.351920 23389 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:19:57.363612 19140 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.021s
I20260709 13:19:57.364010 23337 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.364557 23337 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.366701 23337 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.369303 23336 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.359877 22878 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:57.370456 22878 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:57.370854 22878 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.371750 23348 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:57.372195 23348 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.373116 23388 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:57.374385 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:57.374563 23242 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:57.364018 19140 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.000s	sys 0.022s
I20260709 13:19:57.377841 23352 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.378124 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.387213 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.389268 19146 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:57.389725 19751 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:57.390004 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.390846 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.391395 19144 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:57.391579 19184 leader_election.cc:400] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:57.391950 19184 leader_election.cc:403] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.392261 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.392822 19142 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:57.399935 23330 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.402477 23330 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:57.391167 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:57.407855 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:57.410135 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.359665 23358 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.410523 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:57.414270 19746 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:57.429190 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:57.412823 23302 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.412374 23152 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.412966 23009 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.405035 23401 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:19:57.430063 23032 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.412705 23330 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:57.442658 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:57.456163 23131 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.458662 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:57.459292 19751 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:57.461407 23366 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.872s	user 0.000s	sys 0.004s
I20260709 13:19:57.466156 19751 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:57.467964 23292 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.470223 23165 raft_consensus.cc:3055] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:57.470610 23165 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:57.470468 23353 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.471421 23165 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.471876 23004 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:57.472533 23353 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.473241 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.474560 19218 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:19:57.474922 19218 pending_rounds.cc:85] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 4
I20260709 13:19:57.475144 19218 pending_rounds.cc:107] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:19:57.475394 19218 raft_consensus.cc:2889] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.476745 19219 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:57.477535 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.482959 19145 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:19:57.484067 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:57.487061 23353 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.487516 23353 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.472738 23165 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.490273 23353 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.439801 23287 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:19:57.497565 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.498369 19142 raft_consensus.cc:2410] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:57.498855 23169 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:57.499743 23255 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:57.500133 23255 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:57.500941 23255 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.502089 23255 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.503679 23131 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.506470 23348 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.513583 19141 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:57.442128 23160 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.526257 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:57.526708 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.527047 19140 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.450690 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:57.527601 19142 raft_consensus.cc:2410] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:19:57.528374 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:57.478430 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.529342 19212 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:57.530258 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:57.530841 19749 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.531224 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:57.532756 19212 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:57.535610 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.444900 23152 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:57.539640 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 89019.5us
I20260709 13:19:57.539588 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:57.525197 23102 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.527283 23348 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.532505 22912 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.531672 23361 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.548972 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:57.551081 19140 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:57.532696 23315 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.447431 23302 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:19:57.557788 23247 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:19:57.557957 22912 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.537817 23313 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:57.559151 19751 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.560074 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:57.594466 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:57.565441 19749 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:57.555116 23160 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:57.568008 23361 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.598444 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:57.555236 23102 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.538962 23355 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:57.574187 23315 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.575680 23332 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.581525 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:57.606571 19071 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.584899 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.585682 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:57.588724 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:57.608593 19141 raft_consensus.cc:2368] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10.
W20260709 13:19:57.591848 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.545826 23169 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.611083 23169 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.611474 23169 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.611582 23302 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:57.612159 23302 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:57.553293 23204 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.617103 19146 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:19:57.609364 23315 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.622185 19751 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:19:57.626979 19065 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 9.
I20260709 13:19:57.599074 23281 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.637754 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:57.643460 19749 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:19:57.638947 19714 leader_election.cc:400] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10.
I20260709 13:19:57.644028 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:57.644366 19714 leader_election.cc:403] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.646731 19071 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:57.595467 23177 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:19:57.650681 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:57.657591 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:57.660499 23348 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:57.626327 23102 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.684701 22878 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.627542 23355 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:57.669797 19070 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:57.669771 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:57.670892 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.672982 19068 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:19:57.675086 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.730945 19064 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:57.667531 23281 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:57.676049 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.676636 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.671856 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.651422 22775 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:57.651787 23339 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 9. Current term is 10.
I20260709 13:19:57.668956 23348 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.637846 23204 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.662070 22912 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:57.661250 23280 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:19:57.677929 23000 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.595598 23287 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:19:57.681020 23301 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:57.613920 23174 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:19:57.600019 23313 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.757798 23313 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.685941 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.758528 19071 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:19:57.760202 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:57.761217 19749 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:19:57.763168 23408 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 13:19:57.763258 19214 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:57.658656 23017 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:57.706050 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:57.731093 19072 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:57.769798 19070 raft_consensus.cc:2410] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:19:57.742467 23332 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.733464 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:57.739921 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.741146 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:57.773588 19212 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.737782 19066 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:19:57.745807 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:57.775111 19066 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:57.751933 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.776214 19213 raft_consensus.cc:2410] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:19:57.752508 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:57.760433 23287 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.652220 23177 consensus_queue.cc:1243] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:57.732939 23294 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.771966 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.787987 19138 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
W20260709 13:19:57.732784 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 63113.5us
I20260709 13:19:57.746193 23348 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.778380 19070 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:57.780300 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 178300us
I20260709 13:19:57.774892 23146 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.703474 23160 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.751200 23301 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:57.799154 19069 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:57.790691 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:57.803293 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.805799 19068 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:57.806553 19147 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:57.804706 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.808501 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.814507 23394 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.747769 22775 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.810253 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:57.822281 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:57.781231 23247 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:57.828568 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.825429 19070 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:57.780534 23017 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:57.787591 23000 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.827564 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:57.837893 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:57.838881 19140 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:57.797844 23332 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:57.813740 23102 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:57.815155 23352 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.835642 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.819733 23365 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.797415 23401 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:57.786715 23205 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:57.786613 23287 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.802512 23294 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.828236 23247 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:57.852514 23352 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.787102 23174 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:57.860786 23174 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:57.861621 23174 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.837062 23271 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.775475 23355 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.841415 23361 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.844903 23102 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.887796 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.888674 19215 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:57.851459 23032 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:57.827854 23394 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.898427 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:57.901031 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:57.903687 19212 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:57.824239 23281 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.872625 23174 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:57.918051 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 98922.6us
I20260709 13:19:57.895871 23102 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:57.923758 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:57.859211 23365 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.929471 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:57.919811 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:57.844672 23000 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.934844 19038 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:57.866958 23417 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:19:57.921114 23280 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:57.921271 22878 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.868069 23271 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.851871 23301 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.942329 23352 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.948195 23013 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.948334 23177 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.948966 23361 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:57.977401 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 53737.2us
I20260709 13:19:57.972950 23268 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.981853 19184 leader_election.cc:400] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:19:57.914772 23017 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.969412 23313 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.984264 23301 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.973258 23204 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:57.974334 23415 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:57.977394 23013 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.926477 23247 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.929291 23332 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:57.997289 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:57.983321 23248 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.984165 23425 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:57.974431 23169 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.022554 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.023955 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:57.991187 23361 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:58.025518 19749 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:58.025673 19143 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:58.027485 19065 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:57.999557 23013 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.031652 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.042312 19065 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:58.015331 22775 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.015390 23405 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.987488 23268 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.025005 23248 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.049670 18968 catalog_manager.cc:5697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:58.051569 23255 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.002s
I20260709 13:19:58.052642 23271 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:57.991446 23313 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:57.998723 23415 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:19:58.030002 23413 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:19:58.057935 23411 log.cc:927] Time spent T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:19:58.058635 23420 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:58.024696 23416 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:58.056406 23287 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.015683 23032 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:58.024549 23424 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:19:58.073608 23248 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.074283 23013 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.077507 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.104086 19065 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
W20260709 13:19:58.095625 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.059823 19221 raft_consensus.cc:2368] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13.
I20260709 13:19:58.070372 18968 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 4 to 7, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:58.102005 23427 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:19:58.101079 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 77882.5us
W20260709 13:19:58.070484 23412 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:19:58.097535 23202 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.114832 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.116923 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.117561 19212 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:58.116346 23000 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.119467 23013 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.121236 23202 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.101166 23394 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.123205 23202 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.124302 23169 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.128131 23348 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.117066 19218 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:58.129861 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:58.136830 23000 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:58.137295 23000 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.137651 23000 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.106434 23361 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.138090 23348 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:58.138252 23315 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
I20260709 13:19:58.138688 23315 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.141626 23202 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:58.142174 23202 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.113600 23365 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.059504 23405 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.144868 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:58.145444 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.144155 23202 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.152714 23313 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.154488 23315 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.155637 23000 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.115753 23287 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.145941 23268 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.160423 23337 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.166641 23337 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.167263 23337 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.159665 23177 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:58.168183 23287 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.174360 23415 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.184391 23144 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:58.191238 23144 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:58.193246 23144 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.194222 23287 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.194768 23000 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.195279 23405 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:19:58.197799 23435 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.003s
I20260709 13:19:58.197480 23102 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.188616 23337 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:58.194224 23407 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.639s	user 0.005s	sys 0.000s
I20260709 13:19:58.202783 23337 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:58.204080 23406 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.631s	user 0.001s	sys 0.002s
I20260709 13:19:58.249735 18968 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 6 to 8, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 8 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:58.253151 18968 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 9, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 9 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:58.254992 18968 catalog_manager.cc:5697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 6 to 9, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 9 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:58.259160 18968 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 8, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:58.265618 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.272858 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.274039 19063 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:19:58.277593 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.278467 19064 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:58.281136 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.282233 19064 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:58.283739 18968 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:58.286732 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 442953us
I20260709 13:19:58.287617 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.288780 19063 raft_consensus.cc:2393] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:58.297279 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.308133 19139 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
W20260709 13:19:58.305476 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 144287us
I20260709 13:19:58.313897 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:58.318946 19216 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:58.320076 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.321291 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.328271 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.329157 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:58.329545 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:58.330233 19743 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:58.330443 19138 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.332989 19751 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: [7.8-12.10]
I20260709 13:19:58.335613 19745 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Advancing to term 13
I20260709 13:19:58.337299 23132 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.337527 23139 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.338218 23132 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.338613 23139 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.339144 22912 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:58.339656 23004 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.340517 23004 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.341300 23139 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.341967 23139 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.333531 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:58.342861 23139 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.335517 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:58.345575 19750 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:58.329223 19213 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:58.337499 19749 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:58.355636 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.348594 19066 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:58.353505 19146 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:19:58.350582 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.356804 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.351142 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:58.354878 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:58.346163 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.354415 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:58.349715 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.286923 18968 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 4 to 7, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.356685 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.353615 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.490330 19750 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:58.361692 19038 leader_election.cc:400] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13.
I20260709 13:19:58.355767 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:58.494946 19038 leader_election.cc:403] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:58.346005 23139 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.351675 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.357219 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.347810 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:58.363083 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:58.361225 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:58.498488 19142 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.347076 23102 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.355114 23004 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.374784 23152 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.348125 22923 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.362102 23132 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.362705 23015 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.375567 23174 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.504551 19138 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:58.339663 22912 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:58.506014 19139 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:58.506846 23169 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:58.346728 22775 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 13:19:58.508132 19143 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
W20260709 13:19:58.515252 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.371834 23287 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:58.520538 23139 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:58.521380 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.521600 23288 raft_consensus.cc:2764] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:58.371301 23177 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:19:58.522181 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 161223us
I20260709 13:19:58.523990 19745 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:58.524120 19221 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.525658 19215 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:19:58.526151 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:19:58.526262 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 214225us
I20260709 13:19:58.525014 19145 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:58.531594 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.532554 19138 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:58.534395 23401 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.372311 23301 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:58.546669 19212 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.525048 19140 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:58.547748 19748 raft_consensus.cc:2410] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:58.528050 18968 catalog_manager.cc:5697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 8. New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.547778 23330 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.548444 23132 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.554136 23132 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.552390 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:58.517202 23280 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:58.536732 23144 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.561517 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:58.558574 19213 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:19:58.565383 23204 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:58.565955 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 204703us
I20260709 13:19:58.560607 23330 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.568216 23247 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.533104 23442 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:58.571143 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.562299 19219 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:58.574184 19141 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:58.575168 19144 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:19:58.593379 19143 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.597381 23339 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.601965 23205 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:58.602403 23339 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.602710 23205 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.611801 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:58.588980 23288 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:58.615737 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:58.617175 23313 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:58.618468 23313 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:58.621156 23330 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.622623 23301 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.625461 23442 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.626732 22912 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.598133 23177 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.627848 23442 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.629366 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:58.630412 23177 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.632700 23009 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.586621 23004 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:58.625602 23393 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:58.620752 23313 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:58.637866 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 101448us
I20260709 13:19:58.627928 22912 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.645334 19212 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:58.604671 23339 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.642982 23287 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.661670 23433 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:58.639930 23009 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.662321 23433 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.640524 23301 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.663607 23287 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.655319 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.664438 23433 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.664674 19218 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:19:58.578763 22923 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.658265 23401 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13.
I20260709 13:19:58.660739 23017 consensus_queue.cc:1059] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:58.661459 19142 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:58.646548 23280 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.666558 23004 raft_consensus.cc:3055] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:58.666980 22923 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.666982 23004 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:19:58.668236 23280 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.575953 23015 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.668159 23004 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.669376 23004 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.670343 23015 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:19:58.670255 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54606us
I20260709 13:19:58.671546 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:58.672477 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:58.673146 23202 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:58.674094 19220 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:19:58.589551 23169 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.662336 23009 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.676271 23169 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.674474 19221 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:19:58.677167 23132 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.677475 23174 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.677829 23132 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.677914 23174 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.678303 23132 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.678691 23132 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.680632 23004 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:58.681064 23004 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.682036 19218 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:19:58.682780 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:19:58.701104 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 66187.1us
I20260709 13:19:58.682814 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.682890 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:58.701973 19214 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:58.702086 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:58.703039 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:58.704176 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:58.704365 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.688781 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.705343 19217 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:58.705256 19214 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:19:58.706151 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.706532 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.707252 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.708300 19217 raft_consensus.cc:2410] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:58.691514 23393 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:58.696033 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:58.710098 23393 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.710523 23393 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:58.710574 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:58.711026 23393 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.711336 19750 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:58.701321 19212 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.701099 19218 pending_rounds.cc:85] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:58.712853 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:58.716619 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.717206 19219 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:19:58.718463 19146 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.719223 19219 raft_consensus.cc:1240] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:58.714118 23416 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.720705 23394 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.720801 23416 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.721110 23205 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:58.721194 23394 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.714444 23163 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:58.721733 23394 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.721868 23163 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:58.722352 23163 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.714818 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:58.724124 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:58.713605 19218 pending_rounds.cc:107] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:19:58.725361 19218 raft_consensus.cc:2889] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:58.726527 23271 raft_consensus.cc:2764] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:58.634159 18968 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 5 to 10, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:58.727994 23204 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.728415 23204 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.728786 23204 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.729507 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:58.721310 23416 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.690793 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:58.691548 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.707150 19748 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:58.707268 19214 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:19:58.730927 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:58.730317 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.734802 19113 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:58.736594 23015 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.736981 23015 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.734436 19141 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:58.737658 19143 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:19:58.737946 19212 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:58.737317 23015 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.658458 23313 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.734359 23004 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.739928 22923 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:58.740749 23442 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.754046 22878 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.753122 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:58.747387 23313 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.744451 23401 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:19:58.761732 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.751353 22923 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.767315 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.769433 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.773073 19063 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:19:58.774005 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.777011 23401 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.779278 23401 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.779944 19065 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:58.780850 23405 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.781478 23405 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.783565 23405 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.785935 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:58.786696 19072 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:58.787271 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:58.766474 18968 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:58.754621 22878 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.799278 19212 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:58.799708 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.799834 19717 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:58.799165 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.800359 22878 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.800684 19069 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:58.754545 23163 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.768222 22923 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:58.800853 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 141551us
I20260709 13:19:58.800352 19067 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:19:58.801038 19071 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:19:58.766978 23330 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.808743 19717 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:58.818683 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 68430.6us
I20260709 13:19:58.818984 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.803442 23274 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:58.825380 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.826771 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:58.828445 19748 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:58.830276 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:58.827877 19067 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:19:58.821429 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.833412 19216 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:19:58.768781 23394 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.814780 23330 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.839249 23302 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:58.840380 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 53165.8us
I20260709 13:19:58.841066 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:58.833789 19216 pending_rounds.cc:85] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:19:58.820068 23339 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:58.847162 19216 pending_rounds.cc:107] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:19:58.850494 19216 raft_consensus.cc:2889] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:58.796545 23009 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.859970 23009 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.860751 19072 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:58.861868 23302 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:58.862754 23302 consensus_queue.cc:1243] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:58.863082 23367 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.863545 23367 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.863911 23367 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.837270 19038 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:58.867877 23313 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.869191 23268 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.869577 23268 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.869963 23268 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.871770 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:58.872571 23401 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.873283 23401 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:58.873163 23242 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:58.873842 23401 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:58.833935 23358 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:58.874825 23401 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.875677 23358 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.875964 18968 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.877817 23358 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.877885 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:58.877527 18968 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:19:58.802974 23393 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.849642 23339 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.853834 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:58.857945 23163 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.857672 23294 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.879199 19064 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:19:58.882596 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.890403 19067 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:19:58.879140 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:58.849671 23330 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.883392 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:58.895025 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:58.888348 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:58.879457 23353 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:58.908751 19748 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:58.889228 23339 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:58.926473 19065 raft_consensus.cc:2410] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:58.911556 19214 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:19:58.927593 19214 pending_rounds.cc:85] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 8
I20260709 13:19:58.927871 19214 pending_rounds.cc:107] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:19:58.928133 19214 raft_consensus.cc:2889] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:58.891014 23017 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.878484 23358 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:58.932687 19146 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:58.908313 23353 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:58.934419 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:19:58.883841 22878 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:19:58.950101 19143 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:58.952090 23000 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:58.954365 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.955142 19146 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:58.956965 23353 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:58.957235 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.960146 23367 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:58.962801 23367 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:58.963461 23401 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.964005 23401 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:58.965997 23401 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:58.966822 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:58.980324 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:19:58.984050 19748 raft_consensus.cc:2368] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:19:58.986649 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:58.889437 23102 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:58.931429 23017 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.936002 22912 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:58.998636 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 262311us
I20260709 13:19:58.936015 23405 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.993809 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.994082 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:58.993510 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.036123 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.046130 19143 raft_consensus.cc:2393] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:58.942603 23015 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.042296 19067 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 10: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:58.997011 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.047411 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:59.051391 19139 raft_consensus.cc:2368] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:59.046228 19214 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:19:59.043387 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.044485 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.055701 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:19:59.056835 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.058746 19220 raft_consensus.cc:2410] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:19:59.056205 19215 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:19:58.944665 23139 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:19:59.032763 23274 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:59.068163 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.039149 23017 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.078936 19140 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:59.054831 22912 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:59.079454 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 145095us
I20260709 13:19:59.082352 23000 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.051118 23015 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.052793 23288 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.050802 23394 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.060496 23405 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.091910 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:59.089222 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:59.077144 18968 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.067149 23367 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.047329 23416 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.098656 23416 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:59.099488 19219 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:19:59.101290 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.101935 19219 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:19:59.102586 23337 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:19:59.102807 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.103233 23337 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.105437 23288 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.107805 23288 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.109241 23000 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.062076 23204 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.111327 23000 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.112488 23204 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.113150 23367 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.113487 23393 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:59.113574 23367 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.114187 19146 raft_consensus.cc:2368] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
W20260709 13:19:59.114419 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.115648 23004 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.117802 23004 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.118521 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:59.119073 19215 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.121933 23174 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.123982 23013 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.124636 23013 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.127035 23013 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.130864 19142 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:59.133834 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.128963 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:59.135319 19067 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:59.140308 19749 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:19:59.141299 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:59.143656 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:59.144227 19138 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.142838 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:59.148743 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:59.142807 23415 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:59.153700 19216 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:19:59.157936 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 61345.9us
I20260709 13:19:59.158775 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:19:59.159003 23457 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:19:59.160199 23454 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:19:59.160954 23160 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:59.161514 23160 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:59.162081 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107792us
I20260709 13:19:59.162513 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.164434 19212 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:19:59.130390 23358 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:59.088130 22912 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.177903 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.183830 19221 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:19:59.169181 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:59.186535 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:19:59.197114 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 103974us
I20260709 13:19:59.160733 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:19:59.095284 23405 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.092080 23132 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.149119 23313 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:59.208199 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:59.169269 23163 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.178684 23358 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.213704 18968 catalog_manager.cc:5697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:59.221146 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 60404.4us
I20260709 13:19:59.220352 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:59.236614 18968 catalog_manager.cc:5697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.225178 23153 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.153550 23353 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.243986 18968 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 5 to 6, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 6 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.218333 23015 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:59.248943 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107711us
I20260709 13:19:59.250463 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:59.218812 23163 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:59.226306 23358 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.258133 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:19:59.258713 19748 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.260375 19184 leader_election.cc:400] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:59.261945 19184 leader_election.cc:403] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:59.265054 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:19:59.291462 19110 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:19:59.263563 19184 leader_election.cc:400] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:19:59.279510 19749 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:59.303977 19184 leader_election.cc:403] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:59.249357 23205 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:59.309244 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 46618.1us
I20260709 13:19:59.280287 19071 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:59.260948 23163 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.254650 23015 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:59.283556 23442 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.277477 18968 catalog_manager.cc:5697] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 5, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 5 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:19:59.290606 19138 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:59.249131 23242 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:19:59.306409 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 119968us
I20260709 13:19:59.308825 19139 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:59.316179 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:19:59.354142 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.280426 23337 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.225430 23274 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.392338 23004 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:59.394927 23174 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:59.395582 23174 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:59.372345 23139 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:19:59.373066 23393 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:59.378823 23315 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:59.362797 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:59.379848 23455 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:19:59.380311 23165 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:19:59.380988 23466 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:59.381315 23460 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.411034 19212 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:19:59.381721 23205 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.274137 23160 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.308641 23146 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:59.316640 23144 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:59.317183 23302 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.375905 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:19:59.355561 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:59.413658 19212 pending_rounds.cc:85] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 9
I20260709 13:19:59.348716 23015 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:59.433122 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 57328.8us
I20260709 13:19:59.434477 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.421578 19748 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:19:59.432331 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:59.441538 19212 pending_rounds.cc:107] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:19:59.441955 19212 raft_consensus.cc:2889] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.438545 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:19:59.450650 19139 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:59.453930 23146 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:59.454600 23146 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:19:59.455669 23146 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.457003 23336 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.457067 23144 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.459129 23336 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.459589 23336 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.461954 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.463023 19212 raft_consensus.cc:2410] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:59.463901 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:59.464476 19212 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.309268 23470 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:19:59.459762 23144 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:59.534116 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:59.529968 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 150304us
I20260709 13:19:59.534655 23163 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.362670 23013 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:59.413017 23460 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.414357 23294 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.537204 18968 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 5 to 6, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 6 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:19:59.548166 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 283245us
W20260709 13:19:59.522420 23268 consensus_meta.cc:287] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.002s
I20260709 13:19:59.420238 23337 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:19:59.542804 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:59.471815 22923 consensus_meta.cc:287] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.647s	user 0.003s	sys 0.007s
I20260709 13:19:59.565500 18968 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 1 to 7, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 7 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.546708 19184 leader_election.cc:400] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:19:59.469063 23000 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.434707 23315 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:19:59.561087 19067 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:19:59.568558 19068 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:19:59.569455 19145 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:59.580308 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:59.573305 23467 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.573194 23013 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.573777 23348 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:19:59.590760 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:59.581130 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.568194 19184 leader_election.cc:403] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:59.589779 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:59.548198 23460 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.607381 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:19:59.596274 19068 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
W20260709 13:19:59.612164 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 65625.1us
I20260709 13:19:59.596235 19217 raft_consensus.cc:2368] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15.
I20260709 13:19:59.568557 23000 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.657935 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:19:59.658165 19215 consensus_meta.cc:287] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 13:19:59.659746 19215 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:19:59.663996 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:59.570552 22923 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.567394 23268 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.632951 23000 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.664008 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:59.689232 19143 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.671002 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:19:59.633261 23367 consensus_meta.cc:287] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:19:59.672899 19068 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:19:59.636567 23466 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:59.571175 23294 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.688512 19145 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:59.656469 23144 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.733323 23205 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:59.734885 19144 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:19:59.669773 23353 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:19:59.687834 23160 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.693007 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:19:59.722719 23480 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:59.723783 23474 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:19:59.724265 23348 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:59.765127 23476 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:19:59.729099 23456 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.376s	user 0.001s	sys 0.001s
I20260709 13:19:59.664585 23174 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:19:59.766973 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:19:59.767630 19147 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.768721 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1949) took 1196 ms. Trace:
I20260709 13:19:59.771070 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:19:59.771659 19219 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.661391 23132 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:19:59.767024 23359 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:19:59.773536 23359 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.763375 23480 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:19:59.774415 23144 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.775686 23480 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.777711 23315 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.809111 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:19:59.809866 19068 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.735275 23336 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:19:59.732577 23367 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:19:59.848641 23473 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.259s	user 0.004s	sys 0.000s
I20260709 13:19:59.850709 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:59.747516 23205 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:19:59.856140 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:19:59.838205 23486 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.856905 23475 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.780742 23160 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.872929 23475 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.896019 23467 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:19:59.896620 23467 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.873342 23205 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:59.898283 23205 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:19:59.899724 23459 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:19:59.899490 23205 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.901351 23205 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.878644 23486 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:19:59.921214 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2102) took 1098 ms. Trace:
I20260709 13:19:59.875120 23466 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:19:59.925181 19069 rpcz_store.cc:276] 0709 13:19:58.822847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.822965 (+   118us) service_pool.cc:224] Handling call
0709 13:19:58.844991 (+ 22026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:58.861649 (+ 16658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.861684 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:58.862325 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 13:19:59.045000 (+182675us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:59.045044 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.045115 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.920951 (+875836us) raft_consensus.cc:1685] finished
0709 13:19:59.920975 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.921131 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8100,"raft.queue_time_us":20153,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":182258,"threads_started":1,"wal-append.queue_time_us":1056431}
I20260709 13:19:59.997309 19065 raft_consensus.cc:2410] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:59.852011 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:00.253804 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2240) took 1073 ms. Trace:
I20260709 13:20:00.259490 19066 rpcz_store.cc:276] 0709 13:19:59.180235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.851762 (+671527us) service_pool.cc:224] Handling call
0709 13:20:00.253725 (+401963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:59.769179 19213 rpcz_store.cc:276] 0709 13:19:58.572388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.582136 (+  9748us) service_pool.cc:224] Handling call
0709 13:19:58.616714 (+ 34578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.659565 (+ 42851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.659599 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.660098 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.914812 (+254714us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:58.914864 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.914952 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.768474 (+853522us) raft_consensus.cc:1685] finished
0709 13:19:59.768501 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.768637 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42297,"raft.queue_time_us":45751,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":254267,"threads_started":1,"wal-append.queue_time_us":329892}
I20260709 13:20:00.265890 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:00.001380 22923 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:00.268478 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 532360us
I20260709 13:20:00.279014 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:00.267896 19749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.026s	sys 0.043s
W20260709 13:20:00.280761 19749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.026s	sys 0.043s
I20260709 13:20:00.239939 23416 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:00.284245 19212 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.810s	user 0.014s	sys 0.021s
I20260709 13:20:00.287149 19212 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
W20260709 13:20:00.279207 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.013s	sys 0.071s
W20260709 13:20:00.289269 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.013s	sys 0.071s
I20260709 13:20:00.262498 23393 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:00.264124 23348 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.267354 23367 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.307665 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.311192 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.312531 19066 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.312676 19069 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:00.281078 23204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.041s	sys 0.042s
W20260709 13:20:00.300375 19072 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.030s	sys 0.059s
W20260709 13:20:00.314978 19072 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.030s	sys 0.060s
I20260709 13:20:00.281446 23491 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:00.326308 19035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.010s	sys 0.013s
W20260709 13:20:00.326608 19067 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.735s	user 0.015s	sys 0.010s
W20260709 13:20:00.330667 19143 consensus_meta.cc:287] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.641s	user 0.015s	sys 0.003s
I20260709 13:20:00.333598 19143 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
W20260709 13:20:00.324093 23204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.041s	sys 0.043s
I20260709 13:20:00.327705 19067 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:00.338158 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2243) took 1096 ms. Trace:
W20260709 13:20:00.313253 23339 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.378s	user 0.020s	sys 0.017s
W20260709 13:20:00.327842 19035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.010s	sys 0.013s
I20260709 13:20:00.338565 19067 rpcz_store.cc:276] 0709 13:19:59.241374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.589136 (+347762us) service_pool.cc:224] Handling call
0709 13:20:00.338100 (+748964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.341977 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:00.323009 23348 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:00.343860 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:00.324054 22923 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:00.292541 23416 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:00.344813 19717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.059s	sys 0.068s
I20260709 13:20:00.327090 23488 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:00.349390 19717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.059s	sys 0.068s
I20260709 13:20:00.347610 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2229) took 1288 ms. Trace:
I20260709 13:20:00.308028 23393 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.334636 23481 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:00.348898 19140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.020s	sys 0.041s
W20260709 13:20:00.355510 19140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.020s	sys 0.042s
I20260709 13:20:00.359018 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:00.362186 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:00.351579 23153 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.097s	user 0.013s	sys 0.015s
I20260709 13:20:00.369242 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1954) took 1065 ms. Trace:
I20260709 13:20:00.348374 23359 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.362749 19143 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:00.344460 23144 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.363426 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:00.333125 23491 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.347401 23475 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.375861 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:00.367000 23469 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.007s
I20260709 13:20:00.368513 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:00.352088 22923 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.379364 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2228) took 1336 ms. Trace:
I20260709 13:20:00.374794 23463 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:00.347095 23339 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.381524 19071 rpcz_store.cc:276] 0709 13:19:59.042900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.043136 (+   236us) service_pool.cc:224] Handling call
0709 13:19:59.046992 (+  3856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.348764 (+301772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.379135 (+1030371us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54002cc254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:00.379309 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535978240}
I20260709 13:20:00.367902 23153 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.388244 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 573) took 1095 ms. Trace:
I20260709 13:20:00.388414 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:00.389453 19745 raft_consensus.cc:2368] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:00.389658 23102 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:00.390497 23339 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.390990 23416 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.356082 23348 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.364588 23481 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.398887 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:00.409384 23163 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.366096 23004 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:00.416451 19219 consensus_meta.cc:287] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.644s	user 0.018s	sys 0.008s
I20260709 13:20:00.442350 19219 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:20:00.413805 19066 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:00.419907 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:00.383955 22912 consensus_meta.cc:287] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.170s	user 0.016s	sys 0.006s
I20260709 13:20:00.423511 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:00.460661 19143 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:00.380645 23144 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:00.369617 19140 rpcz_store.cc:276] 0709 13:19:59.299564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.299669 (+   105us) service_pool.cc:224] Handling call
0709 13:19:59.401475 (+101806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.547777 (+146302us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:59.608823 (+ 61046us) log.cc:844] Serialized 14 byte log entry
0709 13:20:00.357066 (+748243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.357114 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:00.363085 (+  5971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.364810 (+  1725us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.364981 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1123,"prepare.queue_time_us":40767,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1246,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5051,"spinlock_wait_cycles":227072,"thread_start_us":643081,"threads_started":1}
I20260709 13:20:00.431012 19069 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:00.434208 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.464962 19071 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.385314 23160 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.435580 23416 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:00.425076 23442 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.062s	user 0.007s	sys 0.011s
I20260709 13:20:00.476444 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.469092 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2107) took 1542 ms. Trace:
I20260709 13:20:00.375767 23488 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:00.436187 23330 consensus_meta.cc:287] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.531s	user 0.018s	sys 0.005s
W20260709 13:20:00.428663 23017 consensus_meta.cc:287] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.295s	user 0.003s	sys 0.016s
I20260709 13:20:00.422824 23463 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.472693 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.467787 23500 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:00.479954 23339 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:00.490139 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:00.490296 23339 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.490746 19069 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:00.490963 22923 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.491537 22923 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:00.491580 23463 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.492130 22923 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.490162 23500 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.493237 23017 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.494422 23500 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.495097 23268 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.495268 23017 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.495599 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:00.496783 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.496968 23330 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.497401 19066 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.499297 23330 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.500124 19743 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:00.462268 23313 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:00.483081 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:00.482964 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:00.415730 19746 rpcz_store.cc:276] 0709 13:19:59.284238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.284359 (+   121us) service_pool.cc:224] Handling call
0709 13:19:59.298605 (+ 14246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.308742 (+ 10137us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:59.554933 (+246191us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.956575 (+401642us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.260755 (+304180us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.260992 (+   237us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.263007 (+  2015us) log.cc:844] Serialized 14 byte log entry
0709 13:20:00.268024 (+  5017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.268110 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.379185 (+111075us) raft_consensus.cc:1685] finished
0709 13:20:00.379203 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.379309 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4677,"prepare.queue_time_us":417033,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":10272,"raft.queue_time_us":162995,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":9866,"spinlock_wait_cycles":7096064,"thread_start_us":503417,"threads_started":2,"wal-append.queue_time_us":314122}
I20260709 13:20:00.463310 19744 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:00.477614 19063 rpcz_store.cc:276] 0709 13:19:58.927055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.932190 (+  5135us) service_pool.cc:224] Handling call
0709 13:19:58.972618 (+ 40428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.051149 (+ 78531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.051179 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.051634 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.189171 (+137537us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:59.189228 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.189317 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.468793 (+1279476us) raft_consensus.cc:1685] finished
0709 13:20:00.468824 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.469022 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":489,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":137099,"threads_started":1,"wal-append.queue_time_us":995292}
I20260709 13:20:00.504498 19143 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.491756 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:00.521819 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:00.522158 19067 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:00.522666 19138 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:20:00.523618 19146 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:20:00.483673 23442 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:00.462508 23004 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.573411 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.486019 23470 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:00.465890 22912 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.476011 23144 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.588047 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:00.588541 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 503) took 1443 ms. Trace:
I20260709 13:20:00.589095 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:00.588904 19069 rpcz_store.cc:276] 0709 13:19:59.132535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.522050 (+1389515us) service_pool.cc:224] Handling call
0709 13:20:00.575336 (+ 53286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.575534 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.575574 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.575621 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:00.575652 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.575713 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.575837 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.590655 23268 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:00.591049 23268 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.591400 23268 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:00.593873 23496 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:20:00.594130 22923 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:00.594492 23015 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.057s	user 0.013s	sys 0.004s
I20260709 13:20:00.595098 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 574) took 1243 ms. Trace:
I20260709 13:20:00.594880 23015 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:00.595575 23302 consensus_meta.cc:287] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.152s	user 0.009s	sys 0.010s
I20260709 13:20:00.596067 23302 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:00.596413 23339 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.597333 23481 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.598141 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:00.598891 19141 raft_consensus.cc:606] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:00.595486 19749 rpcz_store.cc:276] 0709 13:19:59.351316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.351471 (+   155us) service_pool.cc:224] Handling call
0709 13:19:59.351753 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.689740 (+337987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.689796 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.722794 (+ 32998us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.281199 (+558405us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:00.281243 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.281321 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.594903 (+313582us) raft_consensus.cc:1685] finished
0709 13:20:00.594923 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.595042 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95485,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":834075,"threads_started":2,"wal-append.queue_time_us":645492}
I20260709 13:20:00.605403 19217 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:00.609537 19143 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:00.612032 19218 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
W20260709 13:20:00.572660 19147 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.017s
I20260709 13:20:00.573355 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:00.574571 19063 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:00.612278 19221 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:20:00.612987 19147 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
W20260709 13:20:00.588387 23358 consensus_meta.cc:287] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.304s	user 0.010s	sys 0.018s
I20260709 13:20:00.658465 19147 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:20:00.595988 23460 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.971s	user 0.019s	sys 0.007s
I20260709 13:20:00.660188 23339 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.661279 23478 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:00.662277 23502 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:20:00.677497 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:00.699846 19069 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:00.524829 23313 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.586027 23330 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:00.572090 19066 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:20:00.704013 19070 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:00.717319 19071 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:00.718015 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2114) took 1062 ms. Trace:
I20260709 13:20:00.718444 19071 rpcz_store.cc:276] 0709 13:19:59.655624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.419073 (+763449us) service_pool.cc:224] Handling call
0709 13:20:00.717948 (+298875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.612049 23500 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:00.728193 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:00.729012 19071 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:00.661331 23499 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:00.607002 23470 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.709510 23393 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.738652 19143 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.738454 23500 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:00.767563 23405 consensus_meta.cc:287] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.531s	user 0.014s	sys 0.007s
I20260709 13:20:00.767997 23405 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:00.747057 23000 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.996s	user 0.006s	sys 0.014s
I20260709 13:20:00.687117 23358 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.769791 19064 raft_consensus.cc:2368] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
W20260709 13:20:00.757798 19068 consensus_meta.cc:287] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.940s	user 0.017s	sys 0.000s
I20260709 13:20:00.770584 19068 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:20:00.771450 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2117) took 1105 ms. Trace:
I20260709 13:20:00.745692 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:00.759645 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:00.774013 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:00.771828 19068 rpcz_store.cc:276] 0709 13:19:59.665868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.751865 (+ 85997us) service_pool.cc:224] Handling call
0709 13:20:00.771396 (+1019531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.698825 23460 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.780663 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:00.783556 19212 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:00.783617 19219 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:20:00.784888 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:00.785053 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:00.788044 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:00.788555 19213 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:00.790256 19069 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
W20260709 13:20:00.780099 18968 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.001s	sys 0.016s
W20260709 13:20:00.793421 18968 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.001s	sys 0.016s
I20260709 13:20:00.726065 23330 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.708958 23478 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.798971 19748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 575) took 1215 ms. Trace:
I20260709 13:20:00.778898 23153 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:00.801793 19748 rpcz_store.cc:276] 0709 13:19:59.583892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.584060 (+   168us) service_pool.cc:224] Handling call
0709 13:19:59.584401 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.682438 (+ 98037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.682484 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.731445 (+ 48961us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.285494 (+554049us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.285538 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.285607 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.798696 (+513089us) raft_consensus.cc:1685] finished
0709 13:20:00.798724 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.798899 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":232362,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":33471,"thread_start_us":558481,"threads_started":2,"wal-append.queue_time_us":631336}
I20260709 13:20:00.804663 19139 raft_consensus.cc:2368] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15.
W20260709 13:20:00.799449 19186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.004s
I20260709 13:20:00.725888 23339 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:00.805459 19186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.014s	sys 0.004s
W20260709 13:20:00.807497 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 442241us
I20260709 13:20:00.809919 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:00.815037 19069 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:00.815802 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2242) took 1586 ms. Trace:
I20260709 13:20:00.816210 19069 rpcz_store.cc:276] 0709 13:19:59.229262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.797420 (+1568158us) service_pool.cc:224] Handling call
0709 13:20:00.814810 (+ 17390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.815503 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.815727 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.758841 23359 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:20:00.811316 19215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.008s	sys 0.013s
W20260709 13:20:00.824812 19215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.008s	sys 0.013s
W20260709 13:20:00.790454 19184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.014s
W20260709 13:20:00.828313 19184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.005s	sys 0.014s
I20260709 13:20:00.820386 19069 pending_rounds.cc:85] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 6
I20260709 13:20:00.829015 19069 pending_rounds.cc:107] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:00.829331 19069 raft_consensus.cc:2889] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.830045 19143 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:00.836722 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:00.841114 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 66992.9us
I20260709 13:20:00.843952 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:00.804773 23153 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.804000 23348 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:00.825352 23205 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.923s	user 0.003s	sys 0.014s
I20260709 13:20:00.871415 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2113) took 1216 ms. Trace:
I20260709 13:20:00.871856 19065 rpcz_store.cc:276] 0709 13:19:59.655348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.855862 (+200514us) service_pool.cc:224] Handling call
0709 13:20:00.871188 (+1015326us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54001b8354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:00.871349 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155376896}
I20260709 13:20:00.779129 23000 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.881714 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:00.902910 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:00.903908 19748 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:00.790596 23499 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:00.919194 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2111) took 1264 ms. Trace:
I20260709 13:20:00.870118 23153 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.919852 19065 rpcz_store.cc:276] 0709 13:19:59.654773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.878943 (+1224170us) service_pool.cc:224] Handling call
0709 13:20:00.918563 (+ 39620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.918766 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.918803 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.918857 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:00.918900 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.918968 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.919107 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.870272 23488 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.931653 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2235) took 1793 ms. Trace:
I20260709 13:20:00.927623 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:00.927157 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:00.937461 19143 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:20:00.936647 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 657623us
I20260709 13:20:00.936964 19068 rpcz_store.cc:276] 0709 13:19:59.137840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.782750 (+1644910us) service_pool.cc:224] Handling call
0709 13:20:00.783130 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.931235 (+148105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.931271 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.931328 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:00.931368 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.931444 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.931566 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105315,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":16881,"thread_start_us":131427,"threads_started":1}
I20260709 13:20:00.953068 23515 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:00.953701 23515 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.955744 23515 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.956455 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:00.956022 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:00.957901 19147 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:00.958874 19147 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:00.960702 19746 raft_consensus.cc:2368] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15.
I20260709 13:20:00.940533 23242 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:00.940572 23144 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.925503 23358 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.981208 19063 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:00.982589 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:00.926122 22912 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:00.983359 19214 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:00.989012 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:00.981223 23359 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.957649 23146 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:00.991859 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:00.963563 23394 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.993296 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2118) took 1327 ms. Trace:
I20260709 13:20:00.988427 23163 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:00.985491 23467 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.088s	user 0.016s	sys 0.001s
I20260709 13:20:00.974339 23274 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:00.995452 23498 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:20:00.990144 23359 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.966096 23499 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.964937 23313 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:00.993759 19068 rpcz_store.cc:276] 0709 13:19:59.666150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.945698 (+1279548us) service_pool.cc:224] Handling call
0709 13:20:00.982453 (+ 36755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.988531 (+  6078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.988559 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.992907 (+  4348us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:00.992945 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.993131 (+   186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.993244 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.981554 22923 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.968961 23405 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:00.999109 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:00.995565 23481 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:01.002146 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 165526us
I20260709 13:20:01.013595 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:01.014652 19214 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:01.016541 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:00.990525 23489 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:01.007550 23359 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.022411 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.003571 23274 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:00.993685 23348 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:20:01.018636 19035 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:01.017357 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 117551us
I20260709 13:20:01.026674 23205 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:01.056476 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2144) took 1671 ms (client timeout 2100 ms). Trace:
I20260709 13:20:01.013237 23146 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:01.011987 23470 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.036455 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1968) took 1309 ms. Trace:
I20260709 13:20:01.057861 19035 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:01.024101 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1461949839999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 13:20:01.056933 19218 rpcz_store.cc:269] 0709 13:19:59.368864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.401377 (+ 32513us) service_pool.cc:224] Handling call
0709 13:20:01.039681 (+1638304us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001ea0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.039803 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2659698048}
I20260709 13:20:01.013237 23481 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:01.060642 19216 rpcz_store.cc:276] 0709 13:19:59.726804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.303165 (+576361us) service_pool.cc:224] Handling call
0709 13:20:00.328654 (+ 25489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.361613 (+ 32959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.361633 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.361658 (+    25us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:00.361675 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.027131 (+665456us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b5400075dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:01.027173 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.036399 (+  9226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75410304}
I20260709 13:20:01.070518 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:01.064831 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:01.026722 23330 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.073669 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:01.003360 23163 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:01.003214 23467 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:00.350328 19072 rpcz_store.cc:276] 0709 13:19:59.059127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.059248 (+   121us) service_pool.cc:224] Handling call
0709 13:19:59.080375 (+ 21127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.128087 (+ 47712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.128119 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.128648 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.529698 (+401050us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:00.315846 (+786148us) log.cc:844] Serialized 14 byte log entry
0709 13:20:00.347320 (+ 31474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.347392 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.347432 (+    40us) raft_consensus.cc:1685] finished
0709 13:20:00.347444 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.347555 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40981,"raft.queue_time_us":46964,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":10647,"thread_start_us":1157525,"threads_started":2,"wal-append.queue_time_us":746714}
I20260709 13:20:01.036248 22912 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:01.073486 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:01.073580 23405 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:01.077148 19218 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:01.077582 23522 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.077996 23174 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.066393 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:01.040207 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1958) took 1471 ms. Trace:
I20260709 13:20:01.098315 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2142) took 1732 ms. Trace:
I20260709 13:20:01.098734 19221 rpcz_store.cc:276] 0709 13:19:59.365754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.366242 (+   488us) service_pool.cc:224] Handling call
0709 13:19:59.379510 (+ 13268us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:00.614912 (+1235402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.098061 (+483149us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540034c454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:01.098259 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2809168640}
I20260709 13:20:01.081365 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:01.054711 23460 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.063019 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.063494 23274 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.015635 22923 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:01.058995 23503 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:20:01.070051 23358 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.039966 23499 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:20:01.074887 23481 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:01.151190 23519 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:01.094429 22912 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:01.097803 23486 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.153581 22912 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.093535 23530 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.109197 23205 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:20:01.156147 23510 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:20:01.157011 23271 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:01.157420 23271 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:01.158097 23467 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.158365 23271 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.158715 23405 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.159138 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:01.159641 23271 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.101557 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:01.105046 19147 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:20:01.098647 19144 rpcz_store.cc:276] 0709 13:19:59.556065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.556476 (+   411us) service_pool.cc:224] Handling call
0709 13:20:01.027552 (+1471076us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540017acd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.027707 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319541504}
I20260709 13:20:01.093297 23144 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.106498 23174 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:01.113641 23504 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:20:01.114459 23507 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:20:01.162837 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2244) took 1901 ms. Trace:
I20260709 13:20:01.163885 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.164134 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.193162 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.165452 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.194285 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.165140 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.166728 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:01.162672 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.190680 19069 rpcz_store.cc:276] 0709 13:19:59.262072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.819737 (+1557665us) service_pool.cc:224] Handling call
0709 13:20:00.820154 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:00.891541 (+ 71387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.891585 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:00.892312 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 13:20:00.990717 (+ 98405us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:01.091607 (+100890us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.157481 (+ 65874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.157555 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.162605 (+  5050us) raft_consensus.cc:1685] finished
0709 13:20:01.162625 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.162756 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67451,"raft.queue_time_us":148527,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":20757,"thread_start_us":128624,"threads_started":2,"wal-append.queue_time_us":141190}
I20260709 13:20:01.195560 19066 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:01.201992 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.202605 23174 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:01.162084 23163 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:01.203204 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:01.203792 19147 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.205567 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:01.206305 19144 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:01.207031 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:01.209028 23205 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.209462 23205 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:01.209899 23205 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.105046 23522 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:01.213413 19184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.730s (SENT) [suppressed 36 similar messages]
I20260709 13:20:01.161172 23517 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:01.160825 23405 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.220022 23348 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:01.228003 23339 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.227923 23348 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.228701 22923 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.116559 23358 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:01.093616 23146 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:01.225543 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:01.236272 19146 raft_consensus.cc:2368] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:01.235606 23358 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:01.237717 23268 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:20:01.188557 23144 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:01.252362 19147 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:20:01.253453 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.255219 19147 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:01.256210 19113 leader_election.cc:400] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15.
I20260709 13:20:01.256485 19147 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.257558 23516 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:01.258260 23516 consensus_queue.cc:1243] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:01.232127 23517 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:01.256562 19113 leader_election.cc:403] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:01.257007 23460 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:20:01.257426 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 44038.1us
I20260709 13:20:01.450349 19750 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:20:01.452032 23153 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
I20260709 13:20:01.451041 23144 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:01.269909 23268 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:01.482617 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 226525us
I20260709 13:20:01.456831 19214 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:01.457100 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 565) took 1073 ms. Trace:
I20260709 13:20:01.486311 19750 rpcz_store.cc:276] 0709 13:20:00.383239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.310084 (+926845us) service_pool.cc:224] Handling call
0709 13:20:01.450101 (+140017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.456741 (+  6640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.457036 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:01.461555 19184 leader_election.cc:400] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:01.487172 19184 leader_election.cc:403] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:01.461810 23146 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:01.462044 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.462350 23348 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:01.463013 23524 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
I20260709 13:20:01.492471 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.470732 23153 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.452955 23163 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.494539 23174 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:20:01.491478 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:01.498912 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:01.492528 23144 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.501593 19747 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:01.497534 23163 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.494963 23483 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:20:01.505852 23483 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:01.506146 23516 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:01.506322 23483 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:01.506779 23516 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:01.507565 23483 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.507810 23516 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.509473 23515 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.510169 23515 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:01.511489 23515 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.489337 23484 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15.
I20260709 13:20:01.510231 23268 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.521385 23174 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.522080 23174 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.565146 23481 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.567124 23491 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:01.567386 23481 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:01.568033 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2148) took 2198 ms (client timeout 2165 ms). Trace:
W20260709 13:20:01.568434 19217 rpcz_store.cc:269] 0709 13:19:59.370022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.629929 (+259907us) service_pool.cc:224] Handling call
0709 13:20:01.567828 (+1937899us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b540036ced4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.567957 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102892416}
I20260709 13:20:01.569576 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:01.570007 23358 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:01.570835 19139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 1959) took 1995 ms (client timeout 1609 ms). Trace:
W20260709 13:20:01.571205 19139 rpcz_store.cc:269] 0709 13:19:59.575354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.591230 (+ 15876us) service_pool.cc:224] Handling call
0709 13:20:01.570627 (+1979397us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400189054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.570745 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2751513984}
I20260709 13:20:01.571991 23358 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.572559 23358 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:01.573036 23358 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:01.573426 23358 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:01.573432 19070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2231) took 2482 ms (client timeout 3017 ms). Trace:
W20260709 13:20:01.574548 19070 rpcz_store.cc:269] 0709 13:19:59.090989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.133770 (+ 42781us) service_pool.cc:224] Handling call
0709 13:20:01.573259 (+2439489us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.573352 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324186496}
I20260709 13:20:01.605126 23517 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:01.489684 23460 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.664605 23153 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.677642 23500 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.677795 23205 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.606835 22912 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.684000 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:01.685257 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.685840 19139 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:01.686674 19142 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:20:01.688298 19064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2232) took 2558 ms (client timeout 1730 ms). Trace:
W20260709 13:20:01.679821 23359 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.001s
W20260709 13:20:01.689627 19064 rpcz_store.cc:269] 0709 13:19:59.129581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.131320 (+  1739us) service_pool.cc:224] Handling call
0709 13:20:01.685906 (+2554586us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400036454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.688199 (+  2293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3725876992}
I20260709 13:20:01.680905 23174 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:01.681170 23483 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.676057 23274 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:01.823451 19218 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:01.693805 23144 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:01.691270 23153 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:01.827864 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:01.827294 23163 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:01.827230 19019 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 45271.2us
I20260709 13:20:01.783710 23013 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:01.833853 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 156138us
I20260709 13:20:01.692788 23359 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:01.839300 19745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 563) took 2799 ms (client timeout 1822 ms). Trace:
W20260709 13:20:01.839612 19745 rpcz_store.cc:269] 0709 13:19:59.037005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.037106 (+   101us) service_pool.cc:224] Handling call
0709 13:20:01.836466 (+2799360us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540049f054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.836599 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3069861248}
W20260709 13:20:01.835583 23505 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.861s	user 0.003s	sys 0.009s
I20260709 13:20:01.844234 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 507) took 1414 ms. Trace:
I20260709 13:20:01.844666 19068 rpcz_store.cc:276] 0709 13:20:00.429688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.057514 (+627826us) service_pool.cc:224] Handling call
0709 13:20:01.076784 (+ 19270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.253324 (+176540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.253354 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.253391 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:01.253422 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.844000 (+590578us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540020a654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:01.844041 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.844176 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405590272}
I20260709 13:20:01.835170 23460 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:01.840251 23536 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:20:01.841826 23271 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.864815 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:01.834873 23153 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.870637 19063 raft_consensus.cc:2368] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:01.865265 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.870812 19068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:01.875036 19068 raft_consensus.cc:606] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:01.875371 19068 raft_consensus.cc:614] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.875960 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.858062 23013 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:01.877061 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.879086 19072 raft_consensus.cc:2410] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:01.886216 23004 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.888094 23153 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.890986 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.891839 19070 raft_consensus.cc:2410] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:01.892647 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.893285 19070 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:01.893040 23013 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.894143 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.895120 23013 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.895200 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:01.859776 23484 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:20:01.896040 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.896382 23484 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:01.896750 23484 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:01.897259 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.897792 23484 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.898343 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.899044 23484 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.899360 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:01.900058 19071 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:01.901122 23499 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.901445 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.902212 19063 raft_consensus.cc:2368] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:01.901851 23499 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.902954 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.874740 23271 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:01.869755 23294 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.870095 23205 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:01.869529 23527 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.908595 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.914793 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.916909 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.900771 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.923375 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:01.918640 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:01.901162 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:01.925956 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:01.913429 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 808756us
W20260709 13:20:01.919344 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 817775us
I20260709 13:20:01.923520 19071 raft_consensus.cc:2368] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:20:01.910715 23000 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.930378 19072 raft_consensus.cc:2368] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:01.935730 19068 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:01.932389 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:01.961234 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:01.981622 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:01.912218 23538 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:01.985596 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:01.986451 19750 raft_consensus.cc:2368] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
W20260709 13:20:01.986722 23523 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.974s	user 0.006s	sys 0.000s
I20260709 13:20:01.987388 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:01.987802 19067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2246) took 2314 ms (client timeout 2098 ms). Trace:
W20260709 13:20:01.988240 19067 rpcz_store.cc:269] 0709 13:19:59.672962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.341764 (+668802us) service_pool.cc:224] Handling call
0709 13:20:01.987598 (+1645834us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003093d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.987714 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412951424}
I20260709 13:20:01.988633 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:01.989739 19067 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:01.990111 23268 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.990643 23268 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:01.993049 23491 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:01.993773 23509 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.900s	user 0.006s	sys 0.002s
I20260709 13:20:01.995227 23000 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.995657 23000 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:01.996011 23000 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.998597 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2112) took 2343 ms. Trace:
I20260709 13:20:02.001688 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:01.911646 23359 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.007592 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.002135 19065 rpcz_store.cc:276] 0709 13:19:59.655044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.921301 (+1266257us) service_pool.cc:224] Handling call
0709 13:20:01.996978 (+1075677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.997141 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.997167 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.997203 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:01.997233 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.997280 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.998435 (+  1155us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003093d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:01.998539 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425141504}
I20260709 13:20:01.919615 23337 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:01.904825 23499 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:01.907799 23271 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.016264 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.018803 19071 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.914768 23274 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:01.992810 23268 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:01.915571 23527 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:01.918418 23358 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:01.916290 23330 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:20:02.058565 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.063834 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.032641 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:02.065099 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 76540.3us
I20260709 13:20:02.067219 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.072705 19217 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:20:02.018532 23483 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.073765 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.074366 19217 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.074263 23483 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.058382 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.031667 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.071729 19220 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:02.077163 19221 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:02.077761 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.077905 23483 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.078079 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.080293 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.081425 19220 raft_consensus.cc:2410] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:02.080531 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:02.089514 19217 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:02.090445 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.091003 19217 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:02.095861 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.096393 19064 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:02.017819 23337 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:02.101377 19071 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:02.039278 23513 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:02.040999 23174 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.107354 19219 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:02.020301 23205 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.113140 19747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 566) took 1087 ms. Trace:
I20260709 13:20:02.117524 23337 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.118710 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.124810 19747 rpcz_store.cc:276] 0709 13:20:01.025708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.036687 (+ 10979us) service_pool.cc:224] Handling call
0709 13:20:02.112937 (+1076250us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400572454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:02.113060 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928782720}
I20260709 13:20:02.108436 23268 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:02.120684 23499 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:02.128023 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.129457 19220 raft_consensus.cc:1217] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-13.10]   Dedup: 7.8->[11.9-13.10]
I20260709 13:20:02.129980 19220 pending_rounds.cc:85] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 8
I20260709 13:20:02.130349 19220 pending_rounds.cc:107] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:20:02.130646 19220 raft_consensus.cc:2889] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:02.126937 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.138644 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.139321 19219 raft_consensus.cc:2376] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13. Re-sending same reply.
I20260709 13:20:02.126578 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.141269 19217 raft_consensus.cc:2376] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13. Re-sending same reply.
I20260709 13:20:02.142763 19035 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.138401 23102 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.139071 23174 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.145323 19221 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:02.145491 19070 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:02.146631 23174 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:02.146816 19216 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:02.158602 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.123894 23513 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.159397 19217 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:02.152630 23102 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.150950 23268 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:20:02.171904 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.127225 23205 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.175941 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.176462 19212 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:02.176678 19144 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:02.177407 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.177615 23513 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.178032 19143 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:02.142089 23499 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.183216 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:02.185341 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:02.186121 19145 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.193035 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.194695 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.195780 19139 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:02.202364 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.174022 23484 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.207842 19214 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:02.183271 23527 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.230288 23205 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.237077 23358 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:02.261173 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 79016.8us
I20260709 13:20:02.285619 23268 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.223291 23484 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.309044 23491 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.351971 23470 raft_consensus.cc:993] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:02.355693 23470 raft_consensus.cc:1081] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:02.357975 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.369336 19145 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:02.409778 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.466665 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:02.434206 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.467386 19220 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.476249 19113 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.465482 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:02.482851 19143 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.364790 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.484959 19217 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:02.485980 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.486858 19217 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:02.487217 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.478857 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:02.498718 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 232410us
W20260709 13:20:02.454156 23553 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:20:02.502928 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 475) took 2096 ms. Trace:
I20260709 13:20:02.502928 23348 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.500423 19035 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:02.471884 23015 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.504235 19141 rpcz_store.cc:276] 0709 13:20:00.406367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.660407 (+254040us) service_pool.cc:224] Handling call
0709 13:20:00.660772 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.735842 (+ 75070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.735886 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.735941 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:00.735988 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.502696 (+1766708us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54003101d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:02.502742 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.502873 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172129536}
I20260709 13:20:02.506502 23015 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.442221 23004 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.497043 23470 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:02.510524 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:02.515573 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.517755 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2150) took 2986 ms. Trace:
I20260709 13:20:02.499897 23516 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:02.520731 19143 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:02.512354 23102 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:02.521775 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 259513us
I20260709 13:20:02.518106 19215 rpcz_store.cc:276] 0709 13:19:59.525658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.867323 (+341665us) service_pool.cc:224] Handling call
0709 13:19:59.887725 (+ 20402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.925407 (+ 37682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.925441 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.925866 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.825330 (+899464us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:00.825387 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.505303 (+1679916us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5400268ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:02.505373 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.505433 (+    60us) raft_consensus.cc:1685] finished
0709 13:20:02.505450 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.511630 (+  6180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":923,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":132,"spinlock_wait_cycles":85671168,"thread_start_us":899084,"threads_started":1,"wal-append.queue_time_us":949437,"wal-append.run_cpu_time_us":2797,"wal-append.run_wall_time_us":1363755}
I20260709 13:20:02.508868 23015 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.517455 23470 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.520090 23359 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:02.521507 23004 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:02.510233 23348 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.532651 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:02.526186 23015 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.525197 23499 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.529089 23470 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.543339 23359 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:02.544389 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:02.523953 23516 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.550774 23516 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.551782 23004 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.553447 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:02.557132 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 78354.8us
I20260709 13:20:02.527788 23294 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:20:02.558269 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.569273 19113 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.560192 19035 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.561285 23359 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:02.562382 23000 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:20:02.563205 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:02.563338 19747 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:02.566143 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:02.566748 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.567067 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:02.572626 19113 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.573017 19750 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:02.573480 23515 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:02.573796 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.572656 19144 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:02.574195 23515 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:02.574625 19113 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.576664 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.577786 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.580031 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.579612 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.581188 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.581534 19147 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:02.582603 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.552412 23484 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.586846 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.586985 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:02.594122 19145 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:02.587538 19750 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:02.587680 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:02.558698 23527 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.594983 19750 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:02.593472 19141 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:02.598973 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.599454 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:02.599779 19066 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:02.576685 23516 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.576323 23004 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:02.602140 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:02.604151 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.605137 19071 raft_consensus.cc:2368] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:02.580097 23359 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.596676 19217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:02.609117 19217 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.602706 19749 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:02.575512 23515 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.596527 23271 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:02.572309 23000 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.609512 19217 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.584650 23146 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:02.604468 23516 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:02.621670 23516 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.622040 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 1979) took 1844 ms. Trace:
I20260709 13:20:02.611075 23566 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:02.622444 19213 rpcz_store.cc:276] 0709 13:20:00.777523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.805696 (+ 28173us) service_pool.cc:224] Handling call
0709 13:20:00.835498 (+ 29802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.916383 (+ 80885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.916429 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.917049 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:20:01.222471 (+305422us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:01.240462 (+ 17991us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.240716 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.240819 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.619849 (+1379030us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b180049e700. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:20:02.621772 (+  1923us) raft_consensus.cc:1685] finished
0709 13:20:02.621855 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.621981 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13693,"prepare.queue_time_us":17571,"prepare.run_wall_time_us":35,"raft.queue_time_us":107675,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":33483,"spinlock_wait_cycles":126781056,"thread_start_us":304972,"threads_started":1,"wal-append.queue_time_us":335588}
I20260709 13:20:02.624007 23566 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:02.584622 23415 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.596339 22878 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.607669 19750 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.612327 23004 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:02.618307 23013 raft_consensus.cc:1064] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:02.633162 19071 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:20:02.627422 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52853.1us
I20260709 13:20:02.602994 23484 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:02.635212 23484 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:02.626638 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.629631 23102 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:02.626995 23315 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.630249 19750 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:02.630936 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.607069 23205 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:02.638408 23484 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.639042 23102 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.625185 23566 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.629336 23271 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:02.653806 23205 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.654620 23271 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.656028 23205 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.639246 23513 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:02.631443 23415 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.657773 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.660118 19750 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:20:02.661804 19750 pending_rounds.cc:85] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 11
I20260709 13:20:02.626817 19217 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.662189 19750 pending_rounds.cc:107] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:20:02.663064 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.663450 19750 raft_consensus.cc:2889] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:02.664400 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 68502.1us
I20260709 13:20:02.669523 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.669380 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.662156 23513 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.673069 19217 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:02.670567 23499 raft_consensus.cc:2764] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:02.664863 22878 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.673396 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:02.685601 19220 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:02.667636 23570 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:02.660663 23315 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.684329 23513 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.666606 23015 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.679071 23515 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:02.686183 23359 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:02.719686 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:02.701551 23000 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:02.703613 23570 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:02.689664 22878 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.714917 23499 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:02.715242 23515 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.721784 23348 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:02.738672 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 67125.4us
I20260709 13:20:02.729259 23146 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:02.731331 23499 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:02.741216 23575 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:20:02.741888 23499 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.730772 23271 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.722498 23359 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.734040 23515 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.781559 23499 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.798269 23478 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.799175 23499 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.721608 23004 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.782847 23146 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:02.808614 23174 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:02.810405 23359 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.804339 23478 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.814078 23526 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.849s	user 0.012s	sys 0.039s
I20260709 13:20:02.816805 23415 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:02.822074 22878 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:02.845212 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 98808.9us
I20260709 13:20:02.829780 23570 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.830237 23013 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.833590 23315 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:02.785346 23271 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.834129 23522 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:02.836480 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:02.829380 23573 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:20:02.847424 19110 leader_election.cc:400] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15.
W20260709 13:20:02.847391 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 188721us
I20260709 13:20:02.848785 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.860370 19110 leader_election.cc:403] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:02.849488 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.861081 19221 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.851924 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.857369 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.860323 19220 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:20:02.849159 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.862398 19213 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:02.848937 23516 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.870431 23516 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.851363 19113 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.866137 23015 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.863190 19216 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:02.874089 19138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:02.874687 19138 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.875039 19138 raft_consensus.cc:614] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:02.877904 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.874593 19221 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:02.880318 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.873852 23470 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.881563 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.883011 23522 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.883142 23578 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:02.886219 23578 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:02.886684 23578 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.883041 22912 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:02.887820 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.888442 19213 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:02.857199 23359 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.884119 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:02.890061 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.879359 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:02.884311 19221 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
W20260709 13:20:02.900563 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 58268us
I20260709 13:20:02.900962 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.901343 23516 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.901859 23015 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:02.849792 23478 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.902429 23359 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.903075 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.933506 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.933746 19214 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:02.903309 19146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c875508da24d49ae8496600c3e674b63"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:02.842518 23174 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.874099 23415 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.935004 19146 raft_consensus.cc:606] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:02.858964 23513 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:02.931236 23526 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:02.942844 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:02.907114 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.908335 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.910365 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.913864 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.942639 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.913865 23515 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:02.917100 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:02.947033 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 227412us
I20260709 13:20:02.917448 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2247) took 1053 ms. Trace:
I20260709 13:20:02.930395 23015 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:02.923262 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.960335 19071 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:02.961279 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.902487 23470 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:02.928920 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.962387 19069 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:02.932641 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53392.4us
I20260709 13:20:02.963416 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:02.936992 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.937712 19063 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:02.905783 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.964717 19217 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.940687 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.941282 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:02.941149 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50182us
I20260709 13:20:02.969233 19065 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:02.929950 23582 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:02.971434 19220 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:02.972286 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:02.949927 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:02.948494 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 99354.3us
I20260709 13:20:02.921901 19213 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:02.953752 19035 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:02.953167 19064 rpcz_store.cc:276] 0709 13:20:01.864110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.864287 (+   177us) service_pool.cc:224] Handling call
0709 13:20:02.917232 (+1052945us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540024b654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:02.917370 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505537920}
I20260709 13:20:02.958325 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:02.920539 23578 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:02.970346 23470 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:02.975900 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:02.974165 19747 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:02.929697 23315 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:20:02.980580 19110 connection.cc:256] RPC call timeout handler was delayed by -1.9701537599999028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
I20260709 13:20:02.940791 23522 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:02.940225 23583 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:02.984089 19184 leader_election.cc:400] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:02.965574 23015 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.984824 19216 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:02.932430 22912 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:20:02.986320 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:02.985119 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 621) took 1985 ms. Trace:
I20260709 13:20:03.005693 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:03.019989 19218 rpcz_store.cc:276] 0709 13:20:00.999555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.117374 (+117819us) service_pool.cc:224] Handling call
0709 13:20:01.194664 (+ 77290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.824065 (+629401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.984764 (+1160699us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540034b554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:02.985057 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445412224}
I20260709 13:20:03.000639 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:03.023227 19745 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:03.027920 19069 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:03.032393 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:02.971030 23582 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.006346 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:03.035269 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.994673 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.010660 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.033325 19747 raft_consensus.cc:2368] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15.
I20260709 13:20:02.994277 23000 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:20:03.010071 19110 connection.cc:256] RPC call timeout handler was delayed by -1.9576343109999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260709 13:20:03.015692 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:03.041024 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:03.041198 19146 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:03.041594 19072 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:03.015456 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:03.042054 19110 connection.cc:256] RPC call timeout handler was delayed by -1.9225384070000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 13:20:02.988014 23102 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:03.049877 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2264) took 1178 ms. Trace:
I20260709 13:20:03.050424 19070 rpcz_store.cc:276] 0709 13:20:01.871638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.894963 (+ 23325us) service_pool.cc:224] Handling call
0709 13:20:03.049067 (+1154104us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540025dd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:03.049798 (+   731us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477899648}
I20260709 13:20:03.032917 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:02.996212 19744 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.039505 19214 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:03.017185 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:03.042398 19110 connection.cc:256] RPC call timeout handler was delayed by -1.8415384070001437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260709 13:20:02.951216 23415 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.050432 19217 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:03.036005 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:02.945214 23146 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.010977 23522 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:03.127338 23522 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.071413 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:03.032208 23500 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.052855 23582 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.032829 23592 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:02.993854 23470 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:03.093997 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 78260.4us
I20260709 13:20:03.049422 23588 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:03.053462 23102 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:03.130951 19065 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
W20260709 13:20:03.153440 23587 log.cc:927] Time spent T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:20:03.154691 19216 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.157840 23500 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.160099 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:03.160923 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:03.177212 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:03.172220 23500 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:03.172255 19069 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:03.178977 23527 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:03.176245 23569 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:20:03.163218 23478 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:03.164490 23599 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:03.178453 23500 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:03.169138 23588 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:03.175101 19066 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:03.202322 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:03.162719 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:03.201683 23513 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:03.179389 23527 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.203856 19035 leader_election.cc:400] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15.
I20260709 13:20:03.165077 23415 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:03.159956 23585 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.219653 19035 leader_election.cc:403] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:20:03.176635 23546 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.175s	user 0.012s	sys 0.009s
I20260709 13:20:03.052631 23583 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:03.169184 23102 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.168151 23271 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:03.237284 19145 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:20:03.227804 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 119293us
W20260709 13:20:03.255394 19110 connection.cc:256] RPC call timeout handler was delayed by -1.7956384070000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:20:03.244994 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:03.221551 23527 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.248272 23607 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:03.256976 19035 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:03.247036 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.215819 23592 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:03.266881 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:03.272794 23591 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 13:20:03.275542 23593 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:20:03.302702 19744 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:20:03.314983 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.317730 23582 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:03.318269 23522 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:03.319096 19215 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:03.320988 23582 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:03.277338 23153 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.256480 23499 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:03.322369 23499 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.323045 23499 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.326107 23588 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:03.254304 23146 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.300810 23271 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:03.344726 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 311891us
I20260709 13:20:03.346879 19717 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:03.350028 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.353135 19220 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:03.276054 23174 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:03.364766 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.303833 23515 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:03.258985 23358 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:20:03.322427 23583 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:03.359010 23612 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.364157 23000 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:03.301884 23607 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:03.398953 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 388330us
I20260709 13:20:03.399813 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.395164 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:03.403494 19217 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:03.335266 23271 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:03.405350 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.407219 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.422048 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:03.408488 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.423326 19221 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:03.424499 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.409986 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:03.408217 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.425876 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:03.411679 19220 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:03.427150 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:03.412941 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.431015 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.432868 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:03.384706 23268 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:20:03.394065 23000 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.441355 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.451212 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:03.452234 19216 raft_consensus.cc:2368] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16.
I20260709 13:20:03.425580 23585 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:03.418859 23580 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:03.466208 23153 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:03.467796 19140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7347527d150466586ce647078eff8bb"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:03.470206 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:03.534207 19140 raft_consensus.cc:606] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:03.534425 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 64313.8us
W20260709 13:20:03.530494 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 135395us
W20260709 13:20:03.531051 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 67472.7us
W20260709 13:20:03.532796 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 91528.7us
I20260709 13:20:03.560153 19184 leader_election.cc:400] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:03.560810 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:03.451159 23000 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:03.571719 23601 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 13:20:03.572570 23602 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:20:03.573033 23174 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.457720 23604 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.398738 23612 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.669204 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.543177 23153 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:03.560444 23315 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.725457 19184 leader_election.cc:400] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:20:03.725805 19184 leader_election.cc:403] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.578452 23470 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:03.729521 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 199338us
I20260709 13:20:03.730847 19184 leader_election.cc:400] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:03.721271 23174 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.734264 23513 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:20:03.739104 23102 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.742069 23612 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:03.716439 22912 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:03.696293 23585 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:03.724264 23153 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.747336 19184 leader_election.cc:403] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.777696 23174 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:03.779336 23102 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:03.799111 23102 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:03.799584 23102 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:03.800468 23102 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.773074 23616 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.801458 23616 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.803043 23527 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:03.781492 23015 consensus_meta.cc:287] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.000s
I20260709 13:20:03.782377 23637 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.859506 23015 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:03.860199 23637 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:03.861843 23015 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:03.862727 23637 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:03.864070 23637 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:03.789608 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 58890.1us
I20260709 13:20:03.866460 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.751377 23580 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:03.804440 23615 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:20:03.754174 23478 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:03.805177 23611 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:20:03.805998 23516 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.009s
I20260709 13:20:03.807199 23607 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:03.781487 23271 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:03.813107 23627 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:03.796027 23585 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.451615 23592 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:03.720944 23594 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.503s	user 0.004s	sys 0.009s
W20260709 13:20:03.819317 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 61471.3us
I20260709 13:20:03.964639 19219 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:03.885923 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.965056 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.968255 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:03.969172 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:03.802629 23499 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.953049 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.974992 19221 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:03.954226 19220 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:03.955091 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:03.978071 19145 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:03.978605 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 92767.1us
I20260709 13:20:03.982738 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:03.961504 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.986872 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 451337us
I20260709 13:20:03.932296 23603 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.011492 19145 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:03.986649 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.010584 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:04.015295 19143 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:03.940056 23516 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15.
I20260709 13:20:04.016505 19140 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:04.017244 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.018265 19221 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:03.985929 19217 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:03.900272 23315 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
W20260709 13:20:03.986270 23146 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.624s	user 0.003s	sys 0.006s
W20260709 13:20:04.034159 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 491208us
I20260709 13:20:03.986191 23575 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.020574 23604 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.037670 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:03.933385 23580 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:03.961968 23478 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.038100 23603 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:04.039970 23146 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15.
W20260709 13:20:04.092002 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54420.6us
I20260709 13:20:04.093000 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:04.093801 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107987us
W20260709 13:20:04.096587 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 128391us
I20260709 13:20:04.098127 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:04.120090 23610 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 13:20:04.047452 23635 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:04.125066 19140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:04.126602 19140 raft_consensus.cc:606] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.127074 19140 raft_consensus.cc:614] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:04.090930 23568 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 1.483s	user 0.000s	sys 0.013s
I20260709 13:20:04.060144 23603 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.090487 23627 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:04.145788 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 135289us
I20260709 13:20:04.146839 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.148671 19184 leader_election.cc:400] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:04.149135 19184 leader_election.cc:403] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:20:04.152536 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:04.155259 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57225.4us
I20260709 13:20:04.155272 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:20:04.148686 23586 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.230s	user 0.004s	sys 0.000s
I20260709 13:20:04.152994 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:04.144927 23603 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.160197 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.163130 19145 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:04.163431 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:04.161077 19140 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:04.164028 19143 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:04.165130 19143 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:04.167115 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.169230 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.122218 23516 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:20:04.172690 19069 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:20:04.169872 19068 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:20:04.173906 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:04.174454 19070 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.175606 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:04.177222 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:04.177747 19184 connection.cc:256] RPC call timeout handler was delayed by -1.3392052799999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:20:04.178203 19745 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:20:04.178174 19184 connection.cc:256] RPC call timeout handler was delayed by -1.3338052799999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:20:04.160287 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:04.181093 19069 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:04.182087 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.182668 19069 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:04.182649 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.184046 19140 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:20:04.151839 23575 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.185142 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.185846 19067 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:04.186813 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.185192 23575 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:04.188284 23575 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:04.189145 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:04.190387 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 76926.1us
I20260709 13:20:04.192107 19113 leader_election.cc:400] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16.
I20260709 13:20:04.192373 19113 leader_election.cc:403] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:04.194253 23581 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.189193 23575 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.196504 23619 raft_consensus.cc:993] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:04.197049 23515 raft_consensus.cc:1081] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:04.197507 23470 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.198042 23470 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.198210 23000 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.194798 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.199949 19070 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:04.166117 19143 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:04.200603 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107737us
I20260709 13:20:04.201021 19143 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.201350 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.149631 23634 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:04.154698 23604 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:04.158247 23582 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:04.210700 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:04.211676 19065 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.212533 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:04.214335 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.216109 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.217324 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.133396 23635 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.219719 19140 raft_consensus.cc:2368] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:04.223986 19110 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.226126 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.227946 23646 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.229296 23470 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.224606 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:04.236145 19143 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:04.255481 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:04.262831 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.210206 23527 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:04.262205 19714 leader_election.cc:336] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.623s (SENT)
I20260709 13:20:04.210515 23625 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.210327 23641 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:04.214226 23582 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.268399 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.267761 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:04.265863 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 62793.7us
I20260709 13:20:04.274366 19065 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:04.280453 19142 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:20:04.275094 23641 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.254390 23626 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.254201 23619 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:04.283622 23636 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:20:04.284202 23367 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:04.288928 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.323911 19142 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:04.324946 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:04.203943 23015 consensus_queue.cc:1175] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:20:04.290989 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.254238 23004 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.284600 23648 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.260362 23484 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.295111 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.298067 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.267458 23470 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:20:04.313689 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0258311380000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:20:04.314378 19035 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:04.276827 23271 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.213753 23634 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.271579 23583 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.289759 23582 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:04.320868 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 119586us
I20260709 13:20:04.285753 23515 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.286123 23585 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:04.326164 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:04.290185 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:04.285306 23649 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.361045 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.294785 23641 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.379283 23000 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.379938 23000 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.350301 23583 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.381050 23617 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.343295 23271 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:04.350015 23645 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.327069 23527 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.285526 23624 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:20:04.337445 23004 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:04.364195 23655 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:04.367022 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.369012 23649 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.373126 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:04.373695 19139 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:04.374408 23635 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.381127 23583 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:04.342237 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0079362799999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:20:04.427577 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.428090 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 624) took 1518 ms. Trace:
I20260709 13:20:04.383296 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.395959 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.428440 19215 rpcz_store.cc:276] 0709 13:20:02.909948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.929054 (+ 19106us) service_pool.cc:224] Handling call
0709 13:20:04.427917 (+1498863us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54002da5d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:04.428038 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813119744}
W20260709 13:20:04.349278 23621 log.cc:927] Time spent T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
I20260709 13:20:04.348117 23580 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:04.397948 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:04.351223 23478 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.397670 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.405331 23655 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:04.407723 23650 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:20:04.409296 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:04.399448 23628 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:20:04.349647 23561 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:20:04.489585 23655 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.490053 19139 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:04.397058 23271 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.433758 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 1999) took 1437 ms. Trace:
I20260709 13:20:04.493064 19144 rpcz_store.cc:276] 0709 13:20:02.996788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.003925 (+  7137us) service_pool.cc:224] Handling call
0709 13:20:03.004258 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.004478 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:03.093118 (+ 88640us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.433191 (+1340073us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b1800480640. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287
0709 13:20:04.433304 (+   113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.433364 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:04.433433 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.433517 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.433694 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120655,"prepare.queue_time_us":158496,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":173320,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":120236,"spinlock_wait_cycles":11602304,"thread_start_us":529085,"threads_started":3,"wal-append.queue_time_us":928760}
I20260709 13:20:04.359462 23367 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:20:04.487111 23656 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:04.496227 23367 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:04.496757 23367 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:04.496506 23642 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:20:04.497903 23642 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:04.497773 23367 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.487780 23635 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.396747 23617 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.488116 23649 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:04.498924 23635 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:04.499415 23635 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:04.499691 23647 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:20:04.500864 23618 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
W20260709 13:20:04.509366 23629 consensus_queue.cc:1175] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "55991c1f7f474a9888725d00438d8a83" responder_term: 14 status { last_received { term: 14 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 14 index: 7 } }
I20260709 13:20:04.511597 23578 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.518795 23499 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.521854 23271 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:04.526746 23609 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.323s	user 0.001s	sys 0.011s
I20260709 13:20:04.532021 23522 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:04.449214 23585 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.538821 23205 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:04.539338 23205 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:04.404573 23645 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.542292 23645 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:04.546859 19143 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:04.498361 23642 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:04.406075 23004 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.540364 23205 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.408538 23484 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:04.609324 23484 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.612202 23484 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.605028 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 590) took 1279 ms. Trace:
I20260709 13:20:04.612911 19744 rpcz_store.cc:276] 0709 13:20:03.325769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.326024 (+   255us) service_pool.cc:224] Handling call
0709 13:20:03.326369 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.327051 (+   682us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:03.365541 (+ 38490us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.702447 (+336906us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.703077 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.703249 (+   172us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:03.703293 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.703377 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.604793 (+901416us) raft_consensus.cc:1685] finished
0709 13:20:04.604815 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.604966 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35859,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":32,"raft.queue_time_us":778,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5894,"thread_start_us":295470,"threads_started":1,"wal-append.queue_time_us":651655}
I20260709 13:20:04.405916 23527 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.617911 23527 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.426756 23632 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.272s
I20260709 13:20:04.631649 23527 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:04.643986 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 381801us
W20260709 13:20:04.656941 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 259322us
I20260709 13:20:04.656955 23205 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.658957 23527 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.661579 23527 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.662220 23527 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:04.662608 23527 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:04.662840 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.663126 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:04.664090 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:04.666222 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:04.667142 19744 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:04.669180 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.671904 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:04.672082 19215 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:20:04.673714 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 277828us
I20260709 13:20:04.676241 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:04.677090 23522 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:04.678013 19071 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:04.678920 23522 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:04.679682 23522 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.680262 23522 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:04.681200 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.684850 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.685995 19071 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 8.
I20260709 13:20:04.685324 23616 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:04.686436 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 342032us
I20260709 13:20:04.687536 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:04.688592 19065 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:04.699168 19184 leader_election.cc:400] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:04.689016 19072 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:04.690363 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:04.690491 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.703953 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.739655 19070 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:04.744191 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:04.744824 23580 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:04.745337 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:04.746042 23645 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:04.746547 23645 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.747524 23580 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:04.748179 23580 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.750726 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:04.693540 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.752018 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:04.752275 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 54434.7us
W20260709 13:20:04.754786 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 61317.7us
I20260709 13:20:04.755846 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.757635 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:20:04.655812 23627 consensus_meta.cc:287] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.004s
I20260709 13:20:04.766569 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:04.769167 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.771355 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:04.772780 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.778362 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.778913 19215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c875508da24d49ae8496600c3e674b63"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:04.779043 19213 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:04.779458 19215 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:04.779834 19215 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.780027 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.780563 19213 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:04.687036 23367 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.794795 19064 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:04.785271 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:04.654132 23634 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.806448 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:04.809458 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:04.809522 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.749752 23585 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:04.823771 19714 leader_election.cc:336] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.656s (SENT)
I20260709 13:20:04.824393 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.838898 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.774379 23268 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.768532 23614 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:04.785077 23624 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.787061 23627 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.796027 23499 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.914230 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:04.920720 19215 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.793536 23649 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:04.663501 23527 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.846175 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:04.928457 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 82362.3us
I20260709 13:20:04.929212 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.846909 23484 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:04.848300 23619 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.848963 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.936524 19064 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:04.850165 23639 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:04.782531 23604 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.837101 23617 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:04.839833 23634 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:04.934619 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:04.942085 23639 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:04.947240 23639 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:04.926734 23153 consensus_meta.cc:287] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.121s	user 0.012s	sys 0.000s
I20260709 13:20:04.837369 23626 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.837805 23588 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.852393 23516 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:04.937636 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.836962 23625 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:20:04.768121 23635 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.842279 23645 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:04.753376 23603 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.775134 23642 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.942237 23604 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:04.961316 23515 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.935041 23575 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:04.913645 23271 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:04.900462 22878 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:04.962787 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:04.967177 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:04.837881 23612 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:20:04.939311 23607 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.937542 23592 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:04.913551 23513 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:20:04.927433 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:04.940553 23174 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:04.925011 23581 consensus_meta.cc:287] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
I20260709 13:20:04.975101 23657 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.221s
I20260709 13:20:04.975821 23653 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:04.976306 23584 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:04.976688 23640 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.985553 23515 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:04.970777 23470 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:05.001590 23661 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:20:04.845521 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:05.033510 23484 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:05.017905 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 168591us
W20260709 13:20:05.006150 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 199773us
I20260709 13:20:04.940764 23649 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:05.027791 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 60725.7us
W20260709 13:20:05.061482 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.028465 19217 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:04.970816 23606 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.036072 23174 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.116549 23606 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.118085 23174 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:04.936293 23499 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:05.004760 23582 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.644s	user 0.002s	sys 0.005s
I20260709 13:20:05.035524 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:04.960165 23634 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:04.965113 23153 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:04.988096 23575 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:05.130375 23575 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.130419 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:05.042652 19215 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:05.132453 19215 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:05.133631 19215 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:04.981985 23604 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.136265 19219 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.948374 23619 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:05.139405 23004 consensus_meta.cc:287] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.001s
I20260709 13:20:05.139832 23004 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.044809 23515 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:05.037325 23583 consensus_meta.cc:287] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.000s
I20260709 13:20:05.054688 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:05.037034 23581 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16.
I20260709 13:20:05.035156 23669 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:05.057674 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:05.215304 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 157701us
I20260709 13:20:05.216226 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:05.217429 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:05.117098 23663 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:05.037719 23653 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:04.927729 23624 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.118117 19213 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:05.005172 22878 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.224337 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:05.127074 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.127287 23606 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.129141 23634 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.129488 23582 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.140319 23619 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.221931 23205 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.238119 23205 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.238598 23205 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.042433 23584 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:05.237272 23624 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.242420 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:05.134436 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:05.243376 19215 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:05.243717 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.032733 23592 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.142840 23639 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.144410 23603 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.148057 23522 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.150031 23649 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.158346 23635 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.177634 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.263038 19139 raft_consensus.cc:2376] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15. Re-sending same reply.
I20260709 13:20:05.183816 23153 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:05.126667 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 72452.3us
I20260709 13:20:05.225435 23653 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.208849 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:05.152829 23641 consensus_meta.cc:287] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
I20260709 13:20:05.124796 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.226037 19070 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.221797 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:05.227916 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.194000 23580 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.122071 23513 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 13:20:05.212785 23657 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.232758 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:05.234755 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 179551us
I20260709 13:20:05.222512 23669 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.236403 23359 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.237056 19144 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:05.226651 23645 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:05.237268 23582 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.254182 19219 raft_consensus.cc:2410] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:05.256618 19142 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:05.222330 23174 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:05.259305 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.260121 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.260983 19748 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:20:05.263451 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:05.264084 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:05.206141 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 151524us
I20260709 13:20:05.231850 23637 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.212432 23583 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.213109 23604 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:05.366322 23631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.183s	user 0.026s	sys 0.076s
I20260709 13:20:05.266124 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:05.597641 23631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.076s	sys 0.182s
I20260709 13:20:05.597453 23680 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:05.598421 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 376665us
I20260709 13:20:05.599174 19745 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.601507 19213 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:05.604339 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.447228 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 636) took 1706 ms. Trace:
I20260709 13:20:05.609270 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:05.335391 19064 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:05.611088 19065 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:05.366417 19147 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:05.612769 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 497) took 1247 ms. Trace:
I20260709 13:20:05.298606 19751 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:05.614886 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.274163 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:05.603006 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:05.615967 19139 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:05.604142 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:05.615087 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.617514 19141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 496) took 1252 ms (client timeout 1656 ms). Trace:
W20260709 13:20:05.617666 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 343534us
I20260709 13:20:05.610375 19748 pending_rounds.cc:85] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Aborting all ops after (but not including) 9
W20260709 13:20:05.618052 19141 rpcz_store.cc:269] 0709 13:20:04.365432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.054114 (+688682us) service_pool.cc:224] Handling call
0709 13:20:05.617460 (+563346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.618659 19748 pending_rounds.cc:107] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:20:05.619021 19748 raft_consensus.cc:2889] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:05.617533 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.619819 19139 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.605790 19212 rpcz_store.cc:276] 0709 13:20:03.740952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.741176 (+   224us) service_pool.cc:224] Handling call
0709 13:20:03.741500 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.745690 (+  4190us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:03.745716 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.373678 (+627962us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b2c0003e7c8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:20:04.374048 (+   370us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.445982 (+ 71934us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:04.446021 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.446313 (+   292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.386442 (+940129us) raft_consensus.cc:1685] finished
0709 13:20:05.386459 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.447151 (+ 60692us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3811,"raft.queue_time_us":4121,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":22337,"spinlock_wait_cycles":3604352,"thread_start_us":71594,"threads_started":1,"wal-append.queue_time_us":599937}
I20260709 13:20:05.616955 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:05.613184 19147 rpcz_store.cc:276] 0709 13:20:04.365706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.334326 (+968620us) service_pool.cc:224] Handling call
0709 13:20:05.334670 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.612499 (+277829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.612703 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.604970 19743 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:05.629417 19070 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:05.636829 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.598194 23680 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:05.654516 19070 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:05.545457 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:05.669395 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.669492 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.671885 19747 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:05.671904 19141 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:05.672544 19139 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:05.367439 23516 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.664990 19745 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
W20260709 13:20:05.656352 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 52306.5us
I20260709 13:20:05.678027 19746 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:05.674829 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 161225us
I20260709 13:20:05.652956 23470 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:05.654707 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 391298us
I20260709 13:20:05.680477 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
W20260709 13:20:05.557765 23678 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:20:05.703011 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.616055 23499 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.692474 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.615964 23592 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.711903 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.697124 19747 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:05.693269 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.610190 23645 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.682137 23580 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:05.695348 23470 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.678382 23153 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:05.673452 23676 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:05.718120 19141 raft_consensus.cc:2393] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:05.681923 23649 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.669967 23603 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:05.739885 23603 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:05.739984 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.740566 19141 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.740782 23603 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.743762 23649 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.744230 23649 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.717036 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.748128 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.682144 23174 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:05.749123 23639 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.749543 23174 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.751418 23583 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.724255 23499 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:20:05.752190 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.752293 23174 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.623479 23637 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.755055 23637 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.755697 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2208) took 1052 ms. Trace:
I20260709 13:20:05.756047 19218 rpcz_store.cc:276] 0709 13:20:04.703314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.703432 (+   118us) service_pool.cc:224] Handling call
0709 13:20:04.770009 (+ 66577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.220528 (+450519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.220557 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.228405 (+  7848us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.677234 (+448829us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:05.677271 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.677335 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.755495 (+ 78160us) raft_consensus.cc:1685] finished
0709 13:20:05.755513 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.755642 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34273,"raft.queue_time_us":156710,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6480,"thread_start_us":694640,"threads_started":2,"wal-append.queue_time_us":485922}
I20260709 13:20:05.704361 23522 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.727020 23680 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:05.758873 23205 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
I20260709 13:20:05.737277 23470 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.719053 23359 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:20:05.728068 23575 consensus_meta.cc:287] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.001s
I20260709 13:20:05.760599 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.749158 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.684656 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:05.762038 19745 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:05.732741 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:05.733013 23580 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.695421 23516 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.624518 23641 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.707100 23624 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:05.722924 23645 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.715891 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:05.731226 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.762688 19749 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:05.764448 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.765350 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:05.772820 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 57003.5us
I20260709 13:20:05.773663 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 500) took 1407 ms. Trace:
I20260709 13:20:05.774075 19140 rpcz_store.cc:276] 0709 13:20:04.366575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.765123 (+1398548us) service_pool.cc:224] Handling call
0709 13:20:05.773574 (+  8451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.775167 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:05.767484 23655 consensus_meta.cc:287] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.277s	user 0.005s	sys 0.006s
I20260709 13:20:05.719928 22878 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.770391 23580 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:05.770439 23516 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:05.771849 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 154984us
I20260709 13:20:05.779299 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:05.791865 19745 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:05.786821 19744 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:05.787799 19140 raft_consensus.cc:2410] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:05.789474 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.792212 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:05.780400 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:05.759303 23205 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.760764 23575 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.794441 19066 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:05.793565 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.826714 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:05.827888 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:05.793560 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.829548 19147 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:05.797093 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.833643 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.832046 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:05.832523 19140 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 7.
I20260709 13:20:05.826570 23516 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:05.839860 23516 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.824594 23583 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:05.841202 23583 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.842079 23516 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.842816 23657 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:05.842864 23604 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.843101 23583 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.843420 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 642) took 1446 ms. Trace:
I20260709 13:20:05.843871 19217 rpcz_store.cc:276] 0709 13:20:04.397470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.397640 (+   170us) service_pool.cc:224] Handling call
0709 13:20:05.843230 (+1445590us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540032dcd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:05.843367 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312257280}
I20260709 13:20:05.844321 23669 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.831604 23522 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:05.789083 23655 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.849931 19067 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:05.832120 23688 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:05.851328 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.852067 19147 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:05.852110 19141 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:05.772303 23570 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:05.790573 23358 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.839483 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.858518 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:05.859596 19147 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:05.861213 19147 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:05.843708 23657 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:05.789831 23624 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:05.863411 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:05.867976 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.859230 23358 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.869270 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:05.869899 23358 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.868106 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.857539 23499 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.850675 23655 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.762272 23676 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.855643 23013 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.869282 19147 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.872709 23657 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:05.857470 23670 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:05.861688 23604 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.921429 23680 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:05.925062 23592 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:05.958376 19147 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.977409 23653 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.979672 23653 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.979802 23645 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.963297 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:05.980655 23657 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.981453 19141 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:05.982690 19141 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:05.983220 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 501) took 1616 ms. Trace:
I20260709 13:20:05.983690 19141 rpcz_store.cc:276] 0709 13:20:04.366833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.982210 (+1615377us) service_pool.cc:224] Handling call
0709 13:20:05.982528 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.983016 (+   488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.983173 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:05.967468 19146 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.963587 23670 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.986865 23670 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.959959 23499 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.935355 23632 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.987660 23632 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.984107 23680 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.862507 23570 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.990051 23499 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:05.971283 23685 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:05.991514 23680 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:05.991994 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2028) took 1245 ms. Trace:
I20260709 13:20:05.993109 23575 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.992359 19215 rpcz_store.cc:276] 0709 13:20:04.746798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.243987 (+497189us) service_pool.cc:224] Handling call
0709 13:20:05.244374 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.258474 (+ 14100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.258505 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.258970 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.569238 (+310268us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:05.569296 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.569391 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.991797 (+422406us) raft_consensus.cc:1685] finished
0709 13:20:05.991818 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.991941 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19265,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2909,"thread_start_us":131614,"threads_started":1,"wal-append.queue_time_us":472204}
I20260709 13:20:05.994575 23583 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.995121 19146 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:20:05.995023 23583 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.997455 23632 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:05.998332 23641 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:05.964860 23604 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:05.971662 23470 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.000356 19139 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:05.974023 23205 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:05.981341 23624 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:05.975605 23522 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:05.976485 23515 consensus_meta.cc:287] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.000s
I20260709 13:20:05.931910 23690 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:06.017721 23690 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.018210 23690 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.008939 23575 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:20:05.969306 23683 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:20:06.022112 23645 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:05.966995 23676 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:06.023309 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2302) took 1806 ms. Trace:
I20260709 13:20:06.023447 19140 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:06.023702 19138 rpcz_store.cc:276] 0709 13:20:04.216820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.217004 (+   184us) service_pool.cc:224] Handling call
0709 13:20:04.227410 (+ 10406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.255129 (+ 27719us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:04.282576 (+ 27447us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.167785 (+885209us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b1800378be0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:20:05.233878 (+ 66093us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.235864 (+  1986us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.236544 (+   680us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.236881 (+   337us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.237337 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.237462 (+   125us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:05.237567 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.237637 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.023104 (+785467us) raft_consensus.cc:1685] finished
0709 13:20:06.023125 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.023254 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28754,"prepare.queue_time_us":27262,"raft.queue_time_us":38172,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":9115,"spinlock_wait_cycles":41665536,"thread_start_us":65636,"threads_started":1,"wal-append.queue_time_us":1416655}
I20260709 13:20:06.026381 19138 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:06.027611 19138 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:06.028117 23515 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.024258 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2308) took 1615 ms. Trace:
I20260709 13:20:06.029755 19140 rpcz_store.cc:276] 0709 13:20:04.409019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.023007 (+1613988us) service_pool.cc:224] Handling call
0709 13:20:06.023278 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.024035 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.024210 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:05.934726 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 199378us
I20260709 13:20:06.030982 19742 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:06.010427 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 527) took 1161 ms. Trace:
I20260709 13:20:06.008827 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:06.008255 23205 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:06.008639 23680 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:06.000802 23604 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:06.014312 23470 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.015468 23359 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:06.003780 23570 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.016847 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2307) took 1644 ms. Trace:
I20260709 13:20:06.009867 19147 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:06.046952 19141 rpcz_store.cc:276] 0709 13:20:04.382990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.989178 (+1606188us) service_pool.cc:224] Handling call
0709 13:20:06.016360 (+ 27182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:06.016534 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.016570 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:06.016607 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:06.016636 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.016693 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.016797 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:06.032302 19140 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:05.976336 23649 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.032150 19065 rpcz_store.cc:276] 0709 13:20:04.849501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.612624 (+763123us) service_pool.cc:224] Handling call
0709 13:20:05.613049 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:05.654244 (+ 41195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.654270 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.682844 (+ 28574us) log.cc:844] Serialized 26 byte log entry
0709 13:20:06.010013 (+327169us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:06.010073 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.010183 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.010224 (+    41us) raft_consensus.cc:1685] finished
0709 13:20:06.010234 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.010362 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40697,"raft.queue_time_us":60514,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":26607,"thread_start_us":285301,"threads_started":1,"wal-append.queue_time_us":281010}
W20260709 13:20:06.035059 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 242933us
I20260709 13:20:06.036319 23676 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:06.037375 23633 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:06.038605 23522 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.041160 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:06.042711 19184 leader_election.cc:400] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:06.042446 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:06.045068 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 181758us
I20260709 13:20:06.045033 23516 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:20:06.059798 23500 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:06.063246 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:06.044945 23645 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:06.063731 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:06.065742 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:06.068914 19070 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:06.069255 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:06.083133 19141 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:20:06.087747 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.052558 23690 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.050915 23680 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.066287 23500 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:06.068360 23645 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:06.068500 23669 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:06.046811 23205 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:06.066599 23624 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:20:06.065044 23470 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:06.256153 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.313850 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:06.262534 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.098493 23705 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:20:06.288324 19110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.623s (SENT) [suppressed 21 similar messages]
I20260709 13:20:06.284232 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2020) took 1539 ms. Trace:
W20260709 13:20:06.286908 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 162470us
W20260709 13:20:06.245642 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 204522us
I20260709 13:20:06.326193 23657 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:06.327694 19219 rpcz_store.cc:276] 0709 13:20:04.744900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.745130 (+   230us) service_pool.cc:224] Handling call
0709 13:20:06.283989 (+1538859us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400390dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:06.284164 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897671552}
I20260709 13:20:06.326272 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:06.329533 19714 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:06.330389 23710 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:06.331295 23710 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:06.079355 23153 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:06.100430 23676 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.082314 23653 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:06.077790 23691 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.329658 23657 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:06.287359 23677 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.127s	user 0.001s	sys 0.010s
I20260709 13:20:06.097110 23174 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.243s
I20260709 13:20:06.335358 23629 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:06.364248 23629 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.338337 23653 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:06.343602 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:06.344110 23205 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:06.242640 23358 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.153784 23670 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.195s
I20260709 13:20:06.158346 23499 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.081679 23580 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:06.349260 23515 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:06.099391 23689 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:06.351455 23153 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:06.369273 23580 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.370046 23153 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.371495 23653 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.153148 23703 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.216s
I20260709 13:20:06.189146 23698 consensus_queue.cc:1059] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.169s
I20260709 13:20:06.143479 23641 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:06.318149 23527 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.318819 23645 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.067683 23522 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.352851 23649 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.353546 23690 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.318542 23669 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:06.097873 22912 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.370992 23689 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.388563 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:06.372152 23670 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:06.360018 23657 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:06.394253 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:06.396452 19138 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:06.400724 19142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2305) took 2080 ms (client timeout 2193 ms). Trace:
W20260709 13:20:06.401144 19142 rpcz_store.cc:269] 0709 13:20:04.319930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.325926 (+  5996us) service_pool.cc:224] Handling call
0709 13:20:06.400571 (+2074645us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54002d7654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:06.400671 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978478976}
I20260709 13:20:06.401981 23580 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:06.402132 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:06.403234 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:06.403694 23358 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:06.404160 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:06.381079 23500 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.405038 23500 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:06.405459 19067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2155) took 1715 ms (client timeout 2190 ms). Trace:
W20260709 13:20:06.405843 19067 rpcz_store.cc:269] 0709 13:20:04.690169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.690456 (+   287us) service_pool.cc:224] Handling call
0709 13:20:06.405294 (+1714838us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002170d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:06.405406 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465655680}
I20260709 13:20:06.407008 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.396023 23670 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:06.409400 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:06.410126 19141 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:06.409693 23670 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.410928 23670 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.350734 23676 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.376382 23499 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.411105 19141 raft_consensus.cc:1240] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:06.506853 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 526) took 1658 ms. Trace:
W20260709 13:20:06.449051 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 160757us
I20260709 13:20:06.535498 19063 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:06.547575 19064 rpcz_store.cc:276] 0709 13:20:04.848988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.992398 (+143410us) service_pool.cc:224] Handling call
0709 13:20:04.992717 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.611800 (+619083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.506569 (+894769us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400056c54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:06.506784 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705933184}
I20260709 13:20:06.459563 19142 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:06.382871 23632 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.551039 23632 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.502708 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2280) took 2322 ms. Trace:
I20260709 13:20:06.396169 23689 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:06.552286 19068 rpcz_store.cc:276] 0709 13:20:04.180001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.180170 (+   169us) service_pool.cc:224] Handling call
0709 13:20:04.180469 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.360753 (+180284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.360797 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.364255 (+  3458us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.408732 (+ 44477us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:05.043234 (+634502us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.043436 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.502301 (+1458865us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:06.502352 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.502402 (+    50us) raft_consensus.cc:1685] finished
0709 13:20:06.502483 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.502623 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64338,"prepare.queue_time_us":726104,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":609,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3309,"spinlock_wait_cycles":413973248,"thread_start_us":316474,"threads_started":2,"wal-append.queue_time_us":443586,"wal-append.run_cpu_time_us":3816,"wal-append.run_wall_time_us":1671048}
I20260709 13:20:06.465525 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:06.555433 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.557027 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:06.555795 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 90355.2us
I20260709 13:20:06.495553 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2018) took 1751 ms. Trace:
W20260709 13:20:06.558964 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.561653 19138 raft_consensus.cc:2468] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:06.570117 19748 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:06.570308 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2206) took 1867 ms. Trace:
I20260709 13:20:06.572429 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.399242 22912 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.570724 19221 rpcz_store.cc:276] 0709 13:20:04.702725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.702866 (+   141us) service_pool.cc:224] Handling call
0709 13:20:04.768814 (+ 65948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.795109 (+ 26295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.795139 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.829151 (+ 34012us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.054920 (+225769us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:05.054959 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.055022 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.286665 (+1231643us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:06.555237 (+268572us) raft_consensus.cc:1685] finished
0709 13:20:06.555255 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.570244 (+ 14989us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16818,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":38509,"spinlock_wait_cycles":54871296,"thread_start_us":132705,"threads_started":1,"wal-append.queue_time_us":237053}
I20260709 13:20:06.561964 19214 rpcz_store.cc:276] 0709 13:20:04.744433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.963384 (+218951us) service_pool.cc:224] Handling call
0709 13:20:04.972618 (+  9234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.758625 (+786007us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:05.858641 (+100016us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.038505 (+179864us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.038675 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:06.038715 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:06.038750 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.495273 (+456523us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400269dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:06.495328 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.495483 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215260,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":159,"raft.queue_time_us":474,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"spinlock_wait_cycles":1807020416,"thread_start_us":277832,"threads_started":2,"wal-append.queue_time_us":178742}
I20260709 13:20:06.394840 23669 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:06.575359 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:06.576231 19068 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:06.486275 23701 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:06.545830 23680 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:06.571005 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.715011 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.448850 23580 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.737365 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.489560 23673 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:06.546559 23629 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.563800 23102 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.743510 19067 raft_consensus.cc:2393] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:06.744158 19138 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:06.754755 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.382992 23641 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.548923 23681 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.758172 19141 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:20:06.751157 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 177544us
I20260709 13:20:06.742283 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:06.752808 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.753301 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.753683 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:06.570986 23656 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:06.762827 19751 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:06.763123 19068 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:06.765470 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.755916 23580 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.738945 23618 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:06.738250 23701 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:06.741700 23575 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.747314 23603 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:06.741185 23583 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.768222 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:06.741549 23513 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.769022 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.772496 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.789281 19064 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
W20260709 13:20:06.774777 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.777769 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58957.7us
I20260709 13:20:06.571123 23622 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.189s
I20260709 13:20:06.741235 23174 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:06.780966 19072 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.751725 23673 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:06.783775 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:06.762460 23516 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.781970 23680 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:06.773305 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:06.804775 19141 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:06.776525 23470 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.790463 19714 leader_election.cc:336] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 2.051s (SENT)
I20260709 13:20:06.792224 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.794793 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.807230 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:06.807631 19068 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:06.762912 23681 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.788430 19138 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:20:06.787158 23604 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:06.814270 23604 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.800467 23500 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:06.816843 23701 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.817281 23604 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:06.818166 23701 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.504520 23657 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.822108 22912 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:06.823770 23499 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.824431 23470 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.825194 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.825770 19070 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:06.822221 19068 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:06.826576 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.764809 23102 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.827257 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.827571 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.827493 23645 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.828437 23102 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.792250 23513 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.829654 23570 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:06.830014 23570 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:06.830760 23570 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.831632 23522 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.831837 23570 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:06.801486 23174 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.832278 23673 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:06.833654 19144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 503) took 2083 ms (client timeout 1785 ms). Trace:
I20260709 13:20:06.833813 23673 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:06.834024 19144 rpcz_store.cc:269] 0709 13:20:04.750530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.032403 (+281873us) service_pool.cc:224] Handling call
0709 13:20:06.833459 (+1801056us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540017a7d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:06.833564 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255974784}
I20260709 13:20:06.828691 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:06.836589 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.806322 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:06.838972 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 48564.7us
I20260709 13:20:06.840493 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.843220 19070 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:20:06.844092 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.847229 19068 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:06.807535 23516 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.851940 23516 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.840840 23604 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.784843 23575 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.841246 23599 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:06.856845 23708 consensus_queue.cc:1059] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:06.857759 23205 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:06.858376 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:06.861653 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50195.2us
I20260709 13:20:06.839752 23641 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:06.864267 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.870823 19070 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:06.786634 23603 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.871688 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.872220 19070 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:06.784271 23618 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.867777 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.867414 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:06.826454 23470 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:06.875268 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.877439 19068 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:06.877777 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:06.878309 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.878857 19068 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.870285 23712 consensus_queue.cc:1059] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:20:06.853173 23604 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:06.877754 23645 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:06.893038 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.836330 23680 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.899369 19068 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:06.884804 23174 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:06.905910 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.884650 22912 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:06.913539 22912 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:06.913993 22912 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.901932 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.918623 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:06.919888 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:06.942046 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:06.901932 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.951623 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:06.960793 19070 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:06.917129 23645 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:06.972846 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.941552 23470 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.983402 23470 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:06.989485 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:06.990492 19070 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:06.942157 23174 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:06.941756 23632 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:07.003403 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.002564 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:07.004694 19070 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.004696 19072 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:06.973996 23146 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:07.011746 19070 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:07.012620 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:07.013298 19070 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:07.013536 19146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 502) took 2646 ms (client timeout 2051 ms). Trace:
I20260709 13:20:06.975139 23645 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:07.013903 19146 rpcz_store.cc:269] 0709 13:20:04.367094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.760322 (+1393228us) service_pool.cc:224] Handling call
0709 13:20:07.013371 (+1253049us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400220e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.013445 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474272640}
I20260709 13:20:06.988106 23513 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:07.029883 23513 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:07.030354 23513 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:07.030803 23513 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.001981 23676 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:07.037452 23470 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:07.038070 23604 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:07.040155 23680 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:07.025723 23575 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:07.015498 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:07.042814 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:07.043336 19070 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:07.043651 23603 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:07.044071 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:07.008976 23146 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:07.029058 23580 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:07.046171 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:07.117100 19063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2145) took 2454 ms (client timeout 1801 ms). Trace:
W20260709 13:20:07.147508 19066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2275) took 2980 ms (client timeout 2478 ms). Trace:
I20260709 13:20:07.165796 23730 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:07.192056 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2297) took 3023 ms. Trace:
W20260709 13:20:07.198263 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.199414 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.436858 19070 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:07.442355 19141 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:07.443415 19070 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: [14.7-16.8]
I20260709 13:20:07.443575 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:07.443994 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2161) took 1567 ms. Trace:
I20260709 13:20:07.444346 19070 rpcz_store.cc:276] 0709 13:20:05.876244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.442906 (+1566662us) service_pool.cc:224] Handling call
0709 13:20:07.443200 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:07.443771 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.443945 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.445154 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:07.446082 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2162) took 1501 ms. Trace:
I20260709 13:20:07.446422 19070 rpcz_store.cc:276] 0709 13:20:05.944684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.445403 (+1500719us) service_pool.cc:224] Handling call
0709 13:20:07.445660 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.445814 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.445839 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:07.445879 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:07.445907 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.445954 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.446038 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.448541 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:07.450155 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2163) took 1491 ms. Trace:
I20260709 13:20:07.450501 19070 rpcz_store.cc:276] 0709 13:20:05.960185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.449520 (+1489335us) service_pool.cc:224] Handling call
0709 13:20:07.449758 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.449888 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.449912 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:07.449950 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:07.449978 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.450026 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.450109 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.451529 19147 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:07.452003 19070 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:07.452572 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2165) took 1463 ms. Trace:
I20260709 13:20:07.452667 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:07.452911 19070 rpcz_store.cc:276] 0709 13:20:05.989138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.451635 (+1462497us) service_pool.cc:224] Handling call
0709 13:20:07.451867 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.452355 (+   488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.452528 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.453480 19138 raft_consensus.cc:2393] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:07.235203 19069 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:07.248713 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:07.265257 19071 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:20:07.454634 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2159) took 1582 ms. Trace:
W20260709 13:20:07.454697 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 206056us
I20260709 13:20:07.454979 19071 rpcz_store.cc:276] 0709 13:20:05.872026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.264693 (+1392667us) service_pool.cc:224] Handling call
0709 13:20:07.265039 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:07.454400 (+189361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.454585 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.455302 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2156) took 2764 ms. Trace:
I20260709 13:20:07.455746 19069 rpcz_store.cc:276] 0709 13:20:04.691397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.691633 (+   236us) service_pool.cc:224] Handling call
0709 13:20:07.235001 (+2543368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.454237 (+219236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.455137 (+   900us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54001b9750. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.455253 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5848327040}
W20260709 13:20:07.282231 19067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2160) took 1409 ms (client timeout 1623 ms). Trace:
W20260709 13:20:07.457031 19067 rpcz_store.cc:269] 0709 13:20:05.873112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.406773 (+533661us) service_pool.cc:224] Handling call
0709 13:20:07.281995 (+875222us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b540036d3d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.282161 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771972352}
W20260709 13:20:07.457772 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.165086 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:07.169708 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:07.170483 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:07.584283 19218 raft_consensus.cc:2410] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:07.584231 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:07.165778 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:07.098212 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 146681us
W20260709 13:20:08.741488 17969 debug-util.cc:398] Leaking SignalData structure 0x7b080000fea0 after lost signal to thread 19110
W20260709 13:20:09.334960 17969 kernel_stack_watchdog.cc:198] Thread 19110 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 293ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:20:07.344950 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:07.385067 18958 maintenance_manager.cc:643] P 1b2c4f6d390c49c387cc446ceb8d00e4: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.113s	user 0.180s	sys 0.060s Metrics: {"bytes_written":30129,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":217415,"dirs.run_cpu_time_us":532,"dirs.run_wall_time_us":25331,"drs_written":1,"lbm_read_time_us":371,"lbm_reads_lt_1ms":4,"lbm_write_time_us":279323,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":9,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":115910,"threads_started":2,"update_count":20,"wal-append.queue_time_us":195329}
W20260709 13:20:07.427372 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.343006 18959 maintenance_manager.cc:419] P 1b2c4f6d390c49c387cc446ceb8d00e4: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8230 bytes on disk
W20260709 13:20:09.344014 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.407089 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.692097 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:07.436787 19063 rpcz_store.cc:269] 0709 13:20:04.662444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.663836 (+  1392us) service_pool.cc:224] Handling call
0709 13:20:07.116853 (+2453017us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54003a0cd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.117010 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4236965760}
I20260709 13:20:07.682070 19065 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:09.370631 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2294) took 3271 ms. Trace:
W20260709 13:20:09.370962 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 1.67864e+06us
I20260709 13:20:09.371129 19065 rpcz_store.cc:276] 0709 13:20:06.099442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.681561 (+1582119us) service_pool.cc:224] Handling call
0709 13:20:07.681880 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.369916 (+1688036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.370373 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:07.436933 19066 rpcz_store.cc:269] 0709 13:20:04.166643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.166778 (+   135us) service_pool.cc:224] Handling call
0709 13:20:07.147282 (+2980504us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54001b9754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.147430 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3695420288}
W20260709 13:20:09.373798 19038 connection.cc:256] RPC call timeout handler was delayed by -1.6774003539999285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260709 13:20:09.375020 19066 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.375675 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2182) took 2571 ms. Trace:
I20260709 13:20:09.375983 19066 rpcz_store.cc:276] 0709 13:20:06.804196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.374051 (+2569855us) service_pool.cc:224] Handling call
0709 13:20:09.374639 (+   588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.375429 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.375609 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.463610 19069 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:20:09.379827 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2285) took 3339 ms. Trace:
I20260709 13:20:09.380169 19069 rpcz_store.cc:276] 0709 13:20:06.040560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.456497 (+1415937us) service_pool.cc:224] Handling call
0709 13:20:07.456771 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.379274 (+1922503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.379658 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.460342 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2167) took 1458 ms. Trace:
I20260709 13:20:09.382105 19070 rpcz_store.cc:276] 0709 13:20:06.001572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.459348 (+1457776us) service_pool.cc:224] Handling call
0709 13:20:07.459763 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.459989 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.460020 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:07.460078 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:07.460119 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.460192 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.460297 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.337790 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2171) took 1335 ms. Trace:
W20260709 13:20:08.755663 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08002a52a0 after lost signal to thread 17967
W20260709 13:20:09.386366 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08002223e0 after lost signal to thread 19004
W20260709 13:20:09.388008 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800237bc0 after lost signal to thread 19071
W20260709 13:20:09.388818 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed6e0 after lost signal to thread 19096
W20260709 13:20:09.389128 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed780 after lost signal to thread 19097
W20260709 13:20:09.389390 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed620 after lost signal to thread 19110
W20260709 13:20:08.414141 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.389853 23635 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.469229 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:07.528442 19139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2024) took 2021 ms (client timeout 1768 ms). Trace:
W20260709 13:20:09.397398 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed240 after lost signal to thread 19140
W20260709 13:20:09.397744 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed220 after lost signal to thread 19141
W20260709 13:20:09.398034 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed1e0 after lost signal to thread 19142
W20260709 13:20:09.397620 19139 rpcz_store.cc:269] 0709 13:20:05.507490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.702687 (+195197us) service_pool.cc:224] Handling call
0709 13:20:07.528223 (+1825536us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54002b93d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.528368 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681793920}
W20260709 13:20:09.398322 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed1c0 after lost signal to thread 19143
W20260709 13:20:09.398607 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed180 after lost signal to thread 19144
W20260709 13:20:09.398859 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed120 after lost signal to thread 19145
W20260709 13:20:09.399117 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ecf60 after lost signal to thread 19146
W20260709 13:20:09.399484 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ecf40 after lost signal to thread 19147
I20260709 13:20:09.399626 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:09.400302 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080022fa40 after lost signal to thread 19171
W20260709 13:20:09.400624 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce920 after lost signal to thread 19172
I20260709 13:20:07.477056 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:07.464004 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:07.396656 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 493) took 3032 ms. Trace:
I20260709 13:20:07.472373 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:07.437362 19145 rpcz_store.cc:276] 0709 13:20:04.168591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.199988 (+ 31397us) service_pool.cc:224] Handling call
0709 13:20:04.200265 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.271353 (+ 71088us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:04.636899 (+365546us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.749507 (+112608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.749553 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:04.749590 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.191769 (+2442179us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b540018a954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:07.191822 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.191972 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89349,"prepare.queue_time_us":387007,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":40,"raft.queue_time_us":82891,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":16026,"spinlock_wait_cycles":163001088,"thread_start_us":381751,"threads_started":2,"wal-append.queue_time_us":29176,"wal-append.run_cpu_time_us":1050,"wal-append.run_wall_time_us":1003460}
I20260709 13:20:07.468441 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:07.487547 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:08.332942 19168 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6820 after lost signal to thread 17967
I20260709 13:20:07.491775 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2168) took 1489 ms. Trace:
W20260709 13:20:08.368431 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.686964 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2325) took 1592 ms. Trace:
I20260709 13:20:07.171200 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:07.168697 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:07.238394 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:07.611009 19217 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:07.585738 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:07.166662 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:07.167675 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:09.410120 19212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2038) took 2239 ms (client timeout 2481 ms). Trace:
W20260709 13:20:07.310274 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.430456 23753 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.408862 19142 rpcz_store.cc:276] 0709 13:20:06.094426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.551098 (+456672us) service_pool.cc:224] Handling call
0709 13:20:06.833807 (+282709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:06.834154 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.834181 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.834627 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:20:06.904182 (+ 69555us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:06.904254 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.904352 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.909492 (+  5140us) raft_consensus.cc:1685] finished
0709 13:20:06.909512 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.686691 (+777179us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b540017a7d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.686898 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1018,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":649401088,"thread_start_us":69056,"threads_started":1,"wal-append.queue_time_us":73249,"wal-append.run_cpu_time_us":26096,"wal-append.run_wall_time_us":2361029}
W20260709 13:20:07.295315 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 967642us
I20260709 13:20:07.125098 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 594) took 1882 ms. Trace:
I20260709 13:20:09.431324 23753 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.449924 19742 rpcz_store.cc:276] 0709 13:20:05.242610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.245537 (+  2927us) service_pool.cc:224] Handling call
0709 13:20:07.124925 (+1879388us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54006801d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.125038 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583287040}
I20260709 13:20:07.235998 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 598) took 1970 ms. Trace:
I20260709 13:20:07.070474 22912 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:07.164374 23004 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:07.240526 23013 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:09.461227 23013 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:07.486294 23015 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.464993 23015 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.466161 23751 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.467355 23015 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:07.069437 23146 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.452538 19746 rpcz_store.cc:276] 0709 13:20:05.265632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.265780 (+   148us) service_pool.cc:224] Handling call
0709 13:20:05.677877 (+412097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.682579 (+  4702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.235803 (+1553224us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b540039b2d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.235941 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169389696}
I20260709 13:20:07.102977 23174 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:20:09.483192 19186 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42382 dropped due to backpressure: service queue is full with 50 items
I20260709 13:20:09.483492 23174 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:07.080207 23205 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:07.092202 23359 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:09.489800 23359 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.485157 23491 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:09.494315 23491 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:07.081480 23513 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.499603 23513 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:07.458582 23522 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:07.458496 23572 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:07.718447 23582 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:09.509223 23582 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:07.530611 23583 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.102991 23584 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.513046 23583 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.514153 23584 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.515686 23583 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:07.199538 23588 raft_consensus.cc:3055] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:09.518162 23588 raft_consensus.cc:740] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:09.519418 23588 consensus_queue.cc:260] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.483579 19186 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42382 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2054)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2051)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2042)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2056)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2048)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2052)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2050)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2046)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2039)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2049)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2059)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2043)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2044)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2213)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2215)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2216)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2217)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2221)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2053)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2057)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 647)
I20260709 13:20:07.388722 23599 raft_consensus.cc:3055] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:09.521900 23599 raft_consensus.cc:740] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:20:09.522769 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.045075 23618 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:07.606127 23619 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:07.566123 23624 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:09.527418 23619 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:07.385921 23641 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:09.530162 23641 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.532483 23641 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:07.566187 23642 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.019032 23645 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:07.094084 23653 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.001s
I20260709 13:20:09.543105 23653 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.540248 19186 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42382 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2054)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2051)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2042)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2056)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2048)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2052)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2050)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2046)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2039)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2049)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2059)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2043)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2044)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2213)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2215)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2216)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2217)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2221)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2053)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2057)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 647)
I20260709 13:20:07.077467 23669 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:07.063990 23670 consensus_meta.cc:287] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.000s
I20260709 13:20:09.550287 19064 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:09.552083 19064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2164) took 3589 ms (client timeout 2076 ms). Trace:
I20260709 13:20:07.259986 23673 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:07.699952 23681 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.572336 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 538) took 2567 ms. Trace:
I20260709 13:20:07.234512 23688 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:09.573474 23669 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:07.059504 23689 consensus_meta.cc:287] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.004s
I20260709 13:20:09.576790 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:09.577034 23689 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.577574 19746 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:20:09.579095 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:07.309347 23700 raft_consensus.cc:3055] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:09.580338 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:09.580459 23700 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:09.581382 19744 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:09.582043 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:09.581818 23700 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:09.582435 19744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 609) took 3007 ms (client timeout 3233 ms). Trace:
I20260709 13:20:09.583021 23700 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:09.582883 19744 rpcz_store.cc:269] 0709 13:20:06.574692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.575096 (+   404us) service_pool.cc:224] Handling call
0709 13:20:09.582214 (+3007118us) spinlock_profiling.cc:243] Waited 2.87 s on lock 0x7b5400572454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.582373 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6593222912}
I20260709 13:20:09.583552 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:07.233927 23701 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:09.585258 23653 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:07.437224 23730 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.510785 23582 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:08.962989 23744 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.587296 23582 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.587539 23744 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.211355 23592 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:09.090296 23745 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.589293 19214 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:09.589573 23745 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:09.590543 19214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2029) took 2426 ms (client timeout 2240 ms). Trace:
I20260709 13:20:09.590720 23619 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:09.590943 19214 rpcz_store.cc:269] 0709 13:20:07.164559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.164781 (+   222us) service_pool.cc:224] Handling call
0709 13:20:09.590320 (+2425539us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b540035c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.590477 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4620521216}
I20260709 13:20:09.591893 23745 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:09.592361 19214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2054) took 2353 ms (client timeout 1660 ms). Trace:
I20260709 13:20:07.601876 23731 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:09.594301 23731 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.596509 23731 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.235888 23746 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:09.286438 23747 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.597295 23746 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.597716 23747 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.327636 23748 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.351830 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:09.599858 23748 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:09.600342 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 2.24825e+06us
I20260709 13:20:09.603799 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:09.604646 19749 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:09.604969 23744 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.605602 23744 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:09.606140 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:09.606336 23744 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.606949 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:09.607803 23583 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.360299 23644 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.609004 23747 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.609287 23644 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.611450 23644 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.351887 18958 maintenance_manager.cc:643] P 1b2c4f6d390c49c387cc446ceb8d00e4: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":645,"lbm_reads_lt_1ms":4}
I20260709 13:20:09.390661 23635 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.613474 23635 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.364946 23637 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:09.392901 19138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2044) took 1951 ms (client timeout 2194 ms). Trace:
W20260709 13:20:09.401479 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800149aa0 after lost signal to thread 19212
W20260709 13:20:09.615877 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2940 after lost signal to thread 19215
W20260709 13:20:09.615747 19138 rpcz_store.cc:269] 0709 13:20:07.465589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.468973 (+  3384us) service_pool.cc:224] Handling call
0709 13:20:09.392626 (+1923653us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:09.616293 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080018bb60 after lost signal to thread 19216
W20260709 13:20:09.616590 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb1a0 after lost signal to thread 19219
W20260709 13:20:09.616828 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800234280 after lost signal to thread 19221
I20260709 13:20:09.617331 19138 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:09.400839 19139 raft_consensus.cc:2410] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:09.617951 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2046) took 2151 ms. Trace:
I20260709 13:20:09.618398 19139 rpcz_store.cc:276] 0709 13:20:07.466309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.399158 (+1932849us) service_pool.cc:224] Handling call
0709 13:20:09.617873 (+218715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.405616 19145 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:09.619400 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2050) took 2152 ms. Trace:
I20260709 13:20:09.619709 19145 rpcz_store.cc:276] 0709 13:20:07.467444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.404273 (+1936829us) service_pool.cc:224] Handling call
0709 13:20:09.404900 (+   627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.619125 (+214225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.619335 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.410432 19063 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:20:09.407474 19168 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6420 after lost signal to thread 19004
I20260709 13:20:09.620854 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2303) took 3237 ms. Trace:
I20260709 13:20:09.579355 23689 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.621323 19063 rpcz_store.cc:276] 0709 13:20:06.383095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.409376 (+3026281us) service_pool.cc:224] Handling call
0709 13:20:09.409820 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.620610 (+210790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.620795 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:09.621995 19168 debug-util.cc:398] Leaking SignalData structure 0x7b08000e57c0 after lost signal to thread 19096
W20260709 13:20:09.622299 19168 debug-util.cc:398] Leaking SignalData structure 0x7b080013f480 after lost signal to thread 19097
I20260709 13:20:09.623206 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 539) took 2618 ms. Trace:
I20260709 13:20:09.416610 19219 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:20:09.623736 19168 debug-util.cc:398] Leaking SignalData structure 0x7b0800320a20 after lost signal to thread 19171
W20260709 13:20:09.623771 18968 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 235) took 34567 ms (client timeout 15000 ms). Trace:
I20260709 13:20:09.624150 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2032) took 2458 ms. Trace:
I20260709 13:20:09.411443 19065 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:20:09.411398 19215 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:09.401782 19140 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:20:09.405236 19147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2045) took 1939 ms (client timeout 1729 ms). Trace:
W20260709 13:20:09.403867 19144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2049) took 1936 ms (client timeout 1660 ms). Trace:
I20260709 13:20:07.239804 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:09.402740 19141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2040) took 1962 ms (client timeout 1754 ms). Trace:
I20260709 13:20:09.415031 19218 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:09.414222 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2227) took 2236 ms (client timeout 1687 ms). Trace:
W20260709 13:20:09.421675 19212 rpcz_store.cc:269] 0709 13:20:07.170860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.170971 (+   111us) service_pool.cc:224] Handling call
0709 13:20:09.409872 (+2238901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.384595 19072 rpcz_store.cc:276] 0709 13:20:06.002724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.765256 (+762532us) service_pool.cc:224] Handling call
0709 13:20:07.337605 (+572349us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54002175d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:07.337722 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34198784}
W20260709 13:20:09.428011 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53658.6us
I20260709 13:20:09.403129 19143 rpcz_store.cc:276] 0709 13:20:04.364449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.381755 (+ 17306us) service_pool.cc:224] Handling call
0709 13:20:04.382055 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.547333 (+165278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.396385 (+2849052us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54002b8ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:07.396593 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378474752}
I20260709 13:20:09.406457 19071 rpcz_store.cc:276] 0709 13:20:06.001876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.455880 (+1454004us) service_pool.cc:224] Handling call
0709 13:20:07.456171 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:07.456439 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.456466 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:07.460575 (+  4109us) log.cc:844] Serialized 26 byte log entry
0709 13:20:07.488924 (+ 28349us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:07.488962 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.489026 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.491572 (+  2546us) raft_consensus.cc:1685] finished
0709 13:20:07.491591 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.491715 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50814,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":27953,"threads_started":1,"wal-append.queue_time_us":28291,"wal-append.run_cpu_time_us":1526,"wal-append.run_wall_time_us":1001709}
I20260709 13:20:09.437256 23749 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.415474 18965 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 10, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 10 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.440656 19221 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.452445 23753 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.466955 23751 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:07.480844 23102 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:09.468055 19146 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:09.469722 23755 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.471871 23013 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:09.473555 23146 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.477953 23153 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:09.631049 23755 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.623610 19063 rpcz_store.cc:276] 0709 13:20:07.004913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.622295 (+2617382us) service_pool.cc:224] Handling call
0709 13:20:09.622632 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.622853 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.622883 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.622940 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:09.622995 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.623045 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.623140 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.474805 23015 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:09.633294 23015 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.633744 23755 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.633824 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 541) took 2628 ms. Trace:
W20260709 13:20:09.624142 19168 debug-util.cc:398] Leaking SignalData structure 0x7b08001737c0 after lost signal to thread 19172
I20260709 13:20:09.634470 19063 rpcz_store.cc:276] 0709 13:20:07.005386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.632423 (+2627037us) service_pool.cc:224] Handling call
0709 13:20:09.632990 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.633410 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.633446 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.633496 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:09.633536 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.633604 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.633760 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.635763 23015 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:09.476171 22912 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.474985 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2184) took 2670 ms. Trace:
I20260709 13:20:09.636629 19069 rpcz_store.cc:276] 0709 13:20:06.804617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.414751 (+2610134us) service_pool.cc:224] Handling call
0709 13:20:09.415359 (+   608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.416045 (+   686us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:09.416075 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.416796 (+   721us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.434998 (+ 18202us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:09.435033 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.435089 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.474752 (+ 39663us) raft_consensus.cc:1685] finished
0709 13:20:09.474781 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.474904 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17986,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":19638,"thread_start_us":17659,"threads_started":1,"wal-append.queue_time_us":54836}
I20260709 13:20:09.488372 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2183) took 2683 ms. Trace:
I20260709 13:20:09.638852 19066 rpcz_store.cc:276] 0709 13:20:06.804392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.376710 (+2572318us) service_pool.cc:224] Handling call
0709 13:20:09.426350 (+ 49640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.436660 (+ 10310us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:09.436702 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.437419 (+   717us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.470682 (+ 33263us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:09.470734 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.470823 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.488078 (+ 17255us) raft_consensus.cc:1685] finished
0709 13:20:09.488103 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.488278 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194,"raft.queue_time_us":19435,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":319,"thread_start_us":32613,"threads_started":1,"wal-append.queue_time_us":33057}
I20260709 13:20:09.496771 23491 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.528316 23624 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.520629 23588 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:09.641043 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2034) took 2472 ms (client timeout 2129 ms). Trace:
W20260709 13:20:09.641397 19215 rpcz_store.cc:269] 0709 13:20:07.168318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.168444 (+   126us) service_pool.cc:224] Handling call
0709 13:20:09.640937 (+2472493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.642186 23624 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:09.642302 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2232) took 2463 ms (client timeout 1733 ms). Trace:
W20260709 13:20:09.642649 19215 rpcz_store.cc:269] 0709 13:20:07.179352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.642115 (+2462763us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.642249 (+   134us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.643389 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2040) took 2471 ms (client timeout 1754 ms). Trace:
W20260709 13:20:09.643684 19215 rpcz_store.cc:269] 0709 13:20:07.172075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.643239 (+2471164us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.643344 (+   105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:20:09.644327 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2053) took 2174 ms. Trace:
I20260709 13:20:09.644760 19139 rpcz_store.cc:276] 0709 13:20:07.470159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.619141 (+2148982us) service_pool.cc:224] Handling call
0709 13:20:09.619466 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.642936 (+ 23470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.642965 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.643021 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:09.643056 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.644113 (+  1057us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b540017b1d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:09.644149 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.644264 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53473024}
I20260709 13:20:09.649545 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2181) took 2845 ms. Trace:
I20260709 13:20:09.649582 22878 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.650010 19065 rpcz_store.cc:276] 0709 13:20:06.803990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.372712 (+2568722us) service_pool.cc:224] Handling call
0709 13:20:09.411001 (+ 38289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:09.649246 (+238245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.649464 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.650171 22878 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:09.650882 19144 rpcz_store.cc:269] 0709 13:20:07.467133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.472143 (+  5010us) service_pool.cc:224] Handling call
0709 13:20:09.403652 (+1931509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.652544 18965 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:09.653270 22878 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.608520 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:09.654847 23624 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.654680 18965 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 13, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:09.655931 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47582.6us
I20260709 13:20:09.656985 23691 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.657888 23691 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.523464 23599 consensus_queue.cc:260] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:09.552485 19064 rpcz_store.cc:269] 0709 13:20:05.962565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.789863 (+827298us) service_pool.cc:224] Handling call
0709 13:20:09.551756 (+2761893us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b5400056254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.551975 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6306524416}
I20260709 13:20:09.565953 19067 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:20:09.657682 19141 rpcz_store.cc:269] 0709 13:20:07.439995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.444658 (+  4663us) service_pool.cc:224] Handling call
0709 13:20:09.402544 (+1957886us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:09.661660 19147 rpcz_store.cc:269] 0709 13:20:07.465977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.468133 (+  2156us) service_pool.cc:224] Handling call
0709 13:20:09.405005 (+1936872us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.563138 23673 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.572620 19070 rpcz_store.cc:276] 0709 13:20:07.004645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.383143 (+2378498us) service_pool.cc:224] Handling call
0709 13:20:09.383553 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.570421 (+186868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.570464 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.570529 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:09.570559 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.572152 (+  1593us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400216bd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:09.572181 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.572273 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393238400}
I20260709 13:20:09.585294 19744 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:09.586000 23701 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.664233 23673 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.664577 23691 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:09.664796 23599 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:09.665292 23701 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.665874 19749 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.666074 23749 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:09.664798 19217 rpcz_store.cc:269] 0709 13:20:07.178015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.583959 (+405944us) service_pool.cc:224] Handling call
0709 13:20:09.414014 (+1830055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.668306 23749 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:07.048779 23728 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.672338 19216 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:09.544744 19186 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42382 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2054)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2051)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2042)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2056)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2048)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2052)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2050)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2046)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2039)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2049)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2059)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2058)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2043)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2044)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2213)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2215)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2216)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2217)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2221)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2053)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2057)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 647)
W20260709 13:20:09.266985 19113 connection.cc:256] RPC call timeout handler was delayed by -1.2885667499999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2618s for a response
W20260709 13:20:09.673311 19113 connection.cc:256] RPC call timeout handler was delayed by -1.0372072049999588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 13:20:09.675051 23751 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:09.675926 19212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2051) took 2437 ms (client timeout 1729 ms). Trace:
W20260709 13:20:09.676074 19146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2047) took 2209 ms (client timeout 2617 ms). Trace:
W20260709 13:20:09.593050 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.601140 19220 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.677031 23624 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:09.677637 23624 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.679713 23624 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:09.676517 19113 leader_election.cc:336] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Timed out: RequestConsensusVote RPC to 127.17.139.3:39345 timed out after 1.508s (SENT)
I20260709 13:20:09.680297 19185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2044) took 2507 ms. Trace:
I20260709 13:20:09.680446 19113 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:09.588819 23730 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:09.601514 23619 raft_consensus.cc:2764] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:09.600395 23746 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.603394 23748 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.603466 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:09.617444 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080003a1c0 after lost signal to thread 19245
W20260709 13:20:09.418367 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 73476.7us
I20260709 13:20:09.617982 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2052) took 2148 ms. Trace:
I20260709 13:20:09.445003 19142 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:20:09.635962 19168 debug-util.cc:398] Leaking SignalData structure 0x7b0800344220 after lost signal to thread 19245
I20260709 13:20:09.525301 23359 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:09.657212 19140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2048) took 2190 ms (client timeout 2327 ms). Trace:
I20260709 13:20:09.569473 19068 raft_consensus.cc:2410] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:09.669448 23744 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:09.669674 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2234) took 2489 ms (client timeout 1766 ms). Trace:
I20260709 13:20:09.671594 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2288) took 3623 ms. Trace:
I20260709 13:20:09.589344 23592 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.335574 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:09.738765 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 403615us
W20260709 13:20:09.739593 19168 debug-util.cc:398] Leaking SignalData structure 0x7b080034f8a0 after lost signal to thread 19246
I20260709 13:20:09.739236 23681 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:09.740280 23749 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:09.738514 19140 rpcz_store.cc:269] 0709 13:20:07.466877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.476827 (+  9950us) service_pool.cc:224] Handling call
0709 13:20:09.657111 (+2180284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.740886 23749 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:20:09.741173 19168 debug-util.cc:398] Leaking SignalData structure 0x7b0800349a40 after lost signal to thread 19775
W20260709 13:20:09.741544 19168 debug-util.cc:398] Leaking SignalData structure 0x7b0800096420 after lost signal to thread 19776
I20260709 13:20:09.741695 23681 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:09.741891 19067 rpcz_store.cc:276] 0709 13:20:06.048260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.458160 (+1409900us) service_pool.cc:224] Handling call
0709 13:20:09.563182 (+2105022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.661622 (+ 98440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.671395 (+  9773us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b5400056250. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.671528 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4819159296}
I20260709 13:20:09.742588 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2051) took 2274 ms. Trace:
I20260709 13:20:09.742650 19069 raft_consensus.cc:1240] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:09.743125 19142 rpcz_store.cc:276] 0709 13:20:07.467776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.433114 (+1965338us) service_pool.cc:224] Handling call
0709 13:20:09.433593 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.742314 (+308721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.742517 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.744089 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 543) took 2287 ms. Trace:
W20260709 13:20:09.676537 19146 rpcz_store.cc:269] 0709 13:20:07.466588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.487217 (+ 20629us) service_pool.cc:224] Handling call
0709 13:20:09.675882 (+2188665us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b540017c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.676022 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142054784}
I20260709 13:20:09.745132 23153 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.745358 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 2.50528e+06us
I20260709 13:20:09.745604 23153 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.746042 19138 rpcz_store.cc:276] 0709 13:20:07.469801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.616625 (+2146824us) service_pool.cc:224] Handling call
0709 13:20:09.617052 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.617746 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.617905 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.747092 23359 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:09.744589 19069 rpcz_store.cc:276] 0709 13:20:07.457105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.638257 (+2181152us) service_pool.cc:224] Handling call
0709 13:20:09.638598 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.743245 (+104647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.743843 (+   598us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001a9854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:09.744025 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238866688}
I20260709 13:20:09.747836 19745 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:09.724248 23669 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.712594 23751 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.748862 23669 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.749303 23751 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.750321 23153 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.750851 23588 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.751088 23669 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.751212 23751 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:09.720073 19038 leader_election.cc:336] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Timed out: RequestConsensusVote RPC to 127.17.139.3:39345 timed out after 1.665s (SENT)
I20260709 13:20:09.680784 19185 rpcz_store.cc:276] 0709 13:20:07.173259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.680140 (+2506881us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.752977 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 76526.7us
I20260709 13:20:09.712371 23013 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:09.753839 19113 leader_election.cc:336] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Timed out: RequestConsensusVote RPC to 127.17.139.3:39345 timed out after 1.687s (SENT)
I20260709 13:20:09.754283 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:09.739396 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080037c700 after lost signal to thread 19246
W20260709 13:20:09.592804 19214 rpcz_store.cc:269] 0709 13:20:07.239072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.592141 (+2353069us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.592269 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.755151 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800363860 after lost signal to thread 19714
W20260709 13:20:09.687094 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2224) took 2509 ms (client timeout 1508 ms). Trace:
W20260709 13:20:09.755620 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800387c60 after lost signal to thread 19715
W20260709 13:20:09.752148 19217 rpcz_store.cc:269] 0709 13:20:07.179897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.669488 (+2489591us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.669615 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.755972 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080031cba0 after lost signal to thread 19717
W20260709 13:20:09.644371 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2228) took 2466 ms (client timeout 1763 ms). Trace:
W20260709 13:20:09.756660 19215 rpcz_store.cc:269] 0709 13:20:07.178259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.644231 (+2465972us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.644332 (+   101us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:20:09.657086 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:09.755823 19220 raft_consensus.cc:2410] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:09.680687 19749 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
W20260709 13:20:09.756688 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080035cdc0 after lost signal to thread 19742
I20260709 13:20:09.712800 23644 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:09.758229 23619 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:09.759754 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2031) took 2594 ms (client timeout 2069 ms). Trace:
I20260709 13:20:09.754041 23013 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:09.769888 19220 rpcz_store.cc:269] 0709 13:20:07.165164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.165568 (+   404us) service_pool.cc:224] Handling call
0709 13:20:09.759448 (+2593880us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540024c554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.759660 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4419231104}
I20260709 13:20:09.773095 19218 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
W20260709 13:20:09.749629 19068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2173) took 3739 ms (client timeout 2880 ms). Trace:
W20260709 13:20:09.742082 19168 debug-util.cc:398] Leaking SignalData structure 0x7b0800352d40 after lost signal to thread 23499
I20260709 13:20:09.763374 19746 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
W20260709 13:20:09.624480 18968 rpcz_store.cc:269] 0709 13:19:35.060489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.093124 (+ 32635us) service_pool.cc:224] Handling call
0709 13:20:09.623445 (+34530321us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:00.996184 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:01.164361 (+168177us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:01.164417 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:20:01.164453 (+    36us) tablet.cc:662] Decoding operations
0709 13:20:01.452639 (+288186us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:01.452737 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:01.452773 (+    36us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:20:01.469663 (+ 16890us) tablet.cc:701] Row locks acquired
0709 13:20:01.469716 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:20:01.469886 (+   170us) write_op.cc:270] Start()
0709 13:20:01.470022 (+   136us) write_op.cc:276] Timestamp: P: 1783603201469817 usec, L: 0
0709 13:20:01.470046 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:01.569302 (+ 99256us) log.cc:844] Serialized 7830 byte log entry
0709 13:20:02.167595 (+598293us) op_driver.cc:464] REPLICATION: finished
0709 13:20:02.198994 (+ 31399us) write_op.cc:301] APPLY: starting
0709 13:20:02.199123 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:02.281437 (+ 82314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:02.281575 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:02.469815 (+188240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:02.530078 (+ 60263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=40
0709 13:20:02.530137 (+    59us) write_op.cc:312] APPLY: finished
0709 13:20:02.530634 (+   497us) log.cc:844] Serialized 139 byte log entry
0709 13:20:02.530818 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.531018 (+   200us) write_op.cc:454] Released schema lock
0709 13:20:02.531094 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:02.641652 (+110558us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b540014ee54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103585e28 00007f6106fc0581 00007f6106fbfd58 00007f6106fc49f1 00007f6106fc49a9 00007f6106fc4939 00007f6106fc4901 00007f6106fc3b2d 000000000038f354 000000000038f199
0709 13:20:02.641946 (+   294us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.641987 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":415862,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":29159,"apply.run_cpu_time_us":16491,"apply.run_wall_time_us":332554,"num_ops":20,"prepare.queue_time_us":1085082,"prepare.run_cpu_time_us":34502,"prepare.run_wall_time_us":1654422,"raft.queue_time_us":224311,"raft.run_cpu_time_us":9338,"raft.run_wall_time_us":94689,"replication_time_us":668200,"spinlock_wait_cycles":40920448,"thread_start_us":1170079,"threads_started":4,"wal-append.queue_time_us":279753,"wal-append.run_cpu_time_us":22268,"wal-append.run_wall_time_us":1700423}]]}
I20260709 13:20:09.636699 19063 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 8. Current term is 9. Ops: []
W20260709 13:20:09.676326 19212 rpcz_store.cc:269] 0709 13:20:07.238273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.675731 (+2437458us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.675858 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.774260 19068 rpcz_store.cc:269] 0709 13:20:06.009867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.972526 (+962659us) service_pool.cc:224] Handling call
0709 13:20:09.749424 (+2776898us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b540025c954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.749570 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5930753792}
W20260709 13:20:09.768714 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec1c0 after lost signal to thread 19746
I20260709 13:20:09.740525 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:09.755883 19216 rpcz_store.cc:269] 0709 13:20:07.177270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.238124 (+ 60854us) service_pool.cc:224] Handling call
0709 13:20:09.686866 (+2448742us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400269dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:09.687013 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580727040}
I20260709 13:20:09.624526 19219 rpcz_store.cc:276] 0709 13:20:07.165421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.166415 (+   994us) service_pool.cc:224] Handling call
0709 13:20:09.624080 (+2457665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.771503 19221 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:20:09.777827 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.779048 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2045) took 2546 ms (client timeout 1639 ms). Trace:
W20260709 13:20:09.783432 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080021f8c0 after lost signal to thread 19775
W20260709 13:20:09.783795 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0b00 after lost signal to thread 19776
W20260709 13:20:09.784029 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003a21c0 after lost signal to thread 22912
W20260709 13:20:09.779592 19218 rpcz_store.cc:269] 0709 13:20:07.232278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.585483 (+353205us) service_pool.cc:224] Handling call
0709 13:20:09.773742 (+2188259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.785243 23728 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:09.789444 19714 connection.cc:256] RPC call timeout handler was delayed by -1.2391667379999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:20:09.789865 19714 connection.cc:256] RPC call timeout handler was delayed by -1.1021887460001381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33740000000000003s for a response
I20260709 13:20:09.791767 23669 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:09.789430 23688 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.794725 22878 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.795046 23688 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.795198 22878 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.797152 23592 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:09.797708 19221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2033) took 2630 ms (client timeout 1845 ms). Trace:
I20260709 13:20:09.798285 23688 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.786293 23584 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:09.786727 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.799584 23584 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:09.800117 23584 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.742108 23749 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.788527 23624 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:09.798094 19221 rpcz_store.cc:269] 0709 13:20:07.167320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.167435 (+   115us) service_pool.cc:224] Handling call
0709 13:20:09.787113 (+2619678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.804637 19742 raft_consensus.cc:2468] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:20:09.784583 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 542) took 2779 ms. Trace:
I20260709 13:20:09.842434 23688 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:09.844014 19063 rpcz_store.cc:276] 0709 13:20:07.005682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.635863 (+2630181us) service_pool.cc:224] Handling call
0709 13:20:09.636379 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.778735 (+142356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.784533 (+  5798us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:09.785771 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 45415.2us
I20260709 13:20:09.708565 23637 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.782791 23015 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:09.805414 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003c68a0 after lost signal to thread 23004
W20260709 13:20:09.807812 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.844448 23688 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.808061 19213 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:09.846325 23637 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.847535 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2037) took 2677 ms. Trace:
I20260709 13:20:09.808485 23644 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.847996 23688 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.848485 23637 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:09.849819 23644 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:09.809587 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 152593us
W20260709 13:20:09.845820 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800318d60 after lost signal to thread 23013
W20260709 13:20:09.850612 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee560 after lost signal to thread 23146
W20260709 13:20:09.850881 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080021c860 after lost signal to thread 23174
W20260709 13:20:09.851109 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800273fa0 after lost signal to thread 23205
I20260709 13:20:09.851389 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:09.732625 23645 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.853786 23645 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.813316 22878 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:09.656428 18965 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 11, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 11 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.855535 18965 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.859203 18965 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index -1 to 6, term changed from 5 to 11, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1), NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:09.871409 18965 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:09.825192 23146 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:09.825237 23744 consensus_queue.cc:1059] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:09.826340 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2235) took 2601 ms (client timeout 1879 ms). Trace:
I20260709 13:20:09.884755 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:09.884902 23761 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:20:09.884843 19216 rpcz_store.cc:269] 0709 13:20:07.225331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.826138 (+2600807us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.826280 (+   142us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:20:09.885550 23761 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:20:09.828763 19212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2238) took 2139 ms (client timeout 1508 ms). Trace:
I20260709 13:20:09.830119 23584 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.888432 23584 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.834841 23689 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:09.835116 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2223) took 2658 ms (client timeout 2115 ms). Trace:
W20260709 13:20:09.890980 19220 rpcz_store.cc:269] 0709 13:20:07.176998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.834918 (+2657920us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.835057 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.891855 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2052) took 2653 ms (client timeout 2327 ms). Trace:
W20260709 13:20:09.892213 19220 rpcz_store.cc:269] 0709 13:20:07.238544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.891656 (+2653112us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.891790 (+   134us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.893108 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2233) took 2713 ms (client timeout 2556 ms). Trace:
W20260709 13:20:09.893499 19220 rpcz_store.cc:269] 0709 13:20:07.179621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.892859 (+2713238us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.893049 (+   190us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.894464 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2220) took 2718 ms (client timeout 2618 ms). Trace:
W20260709 13:20:09.894847 19220 rpcz_store.cc:269] 0709 13:20:07.175947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.894270 (+2718323us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.894410 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.895680 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2050) took 2657 ms (client timeout 2617 ms). Trace:
I20260709 13:20:09.895809 23146 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.896014 19220 rpcz_store.cc:269] 0709 13:20:07.237998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.895525 (+2657527us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.895637 (+   112us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.836364 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2210) took 2662 ms (client timeout 2190 ms). Trace:
I20260709 13:20:09.896430 23146 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:09.897119 19215 rpcz_store.cc:269] 0709 13:20:07.173506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.836175 (+2662669us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.836301 (+   126us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.837121 19214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2229) took 2658 ms (client timeout 2120 ms). Trace:
W20260709 13:20:09.898140 19214 rpcz_store.cc:269] 0709 13:20:07.178520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.836945 (+2658425us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.837067 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:20:09.898540 23146 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:09.837818 19221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2056) took 2148 ms (client timeout 1665 ms). Trace:
W20260709 13:20:09.899216 19221 rpcz_store.cc:269] 0709 13:20:07.689366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.837631 (+2148265us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.837763 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.841693 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2239) took 2147 ms (client timeout 1687 ms). Trace:
W20260709 13:20:09.851389 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800238240 after lost signal to thread 23359
I20260709 13:20:09.857165 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:09.847863 19213 rpcz_store.cc:276] 0709 13:20:07.170026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.170143 (+   117us) service_pool.cc:224] Handling call
0709 13:20:07.170464 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.846777 (+2676313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.847280 (+   503us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b540014b4d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:09.847467 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6054223872}
I20260709 13:20:09.857614 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:09.753602 19185 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40750 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2042)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2056)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2048)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2052)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2050)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2046)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2039)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2049)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2059)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2058)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2242)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2241)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2043)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2213)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2215)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2216)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2217)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2221)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2053)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2057)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 647)
I20260709 13:20:09.860916 23624 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:09.817715 23013 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:09.861070 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:09.862481 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:09.862866 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:09.863070 23619 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:09.863833 23688 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.864459 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.865559 19070 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:09.866658 23015 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:09.867754 23753 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:09.824561 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:09.845773 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2048) took 2610 ms (client timeout 2194 ms). Trace:
I20260709 13:20:09.872633 23635 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:09.875625 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.900622 19217 rpcz_store.cc:269] 0709 13:20:07.694080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.841491 (+2147411us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.841625 (+   134us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.905776 19218 rpcz_store.cc:269] 0709 13:20:07.233174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.842965 (+2609791us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.843706 (+   741us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:20:09.751752 19186 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:40764 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2056)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2048)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2052)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2050)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2046)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2039)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2049)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2059)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2058)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2242)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2241)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2043)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2213)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2215)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2216)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2217)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2221)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2226)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2237)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2053)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2057)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 647)
I20260709 13:20:09.881883 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:09.885620 19072 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
W20260709 13:20:09.886142 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2230) took 2707 ms (client timeout 2281 ms). Trace:
W20260709 13:20:09.907238 19216 rpcz_store.cc:269] 0709 13:20:07.178788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.885951 (+2707163us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.886083 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.827050 19219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2042) took 2654 ms (client timeout 1834 ms). Trace:
W20260709 13:20:09.886241 19212 rpcz_store.cc:269] 0709 13:20:07.689044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.828572 (+2139528us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.828703 (+   131us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:20:09.900777 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080023eb40 after lost signal to thread 23513
W20260709 13:20:09.908008 19219 rpcz_store.cc:269] 0709 13:20:07.172534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.826865 (+2654331us) service_pool.cc:211] Skipping call since client already timed out
0709 13:20:09.826990 (+   125us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:20:09.905964 19069 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
W20260709 13:20:09.911373 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbf00 after lost signal to thread 23584
W20260709 13:20:09.911761 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc420 after lost signal to thread 23588
W20260709 13:20:09.912070 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003944e0 after lost signal to thread 23618
I20260709 13:20:09.890900 23689 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:20:09.913365 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080035f100 after lost signal to thread 23645
W20260709 13:20:09.913863 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800377560 after lost signal to thread 23653
I20260709 13:20:09.914448 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:09.916358 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080039c4c0 after lost signal to thread 23669
W20260709 13:20:09.916644 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec6c0 after lost signal to thread 23670
W20260709 13:20:09.916898 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080034f940 after lost signal to thread 23673
I20260709 13:20:09.916729 19068 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.918481 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:09.917322 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080037d580 after lost signal to thread 23688
W20260709 13:20:09.919476 19093 debug-util.cc:398] Leaking SignalData structure 0x7b08003fe160 after lost signal to thread 23689
W20260709 13:20:09.919719 19093 debug-util.cc:398] Leaking SignalData structure 0x7b080034b9a0 after lost signal to thread 23700
W20260709 13:20:09.919924 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800323700 after lost signal to thread 23701
I20260709 13:20:09.913290 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.910032 23624 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:09.924480 19093 debug-util.cc:398] Leaking SignalData structure 0x7b0800367a40 after lost signal to thread 23728
W20260709 13:20:09.918591 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 94170.1us
I20260709 13:20:09.921192 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:09.926689 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 69661.5us
I20260709 13:20:09.921871 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.924095 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:09.928665 19217 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:09.930819 23619 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:09.931566 23619 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:09.932843 23619 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.934636 23619 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:09.937108 23584 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:09.937799 23584 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.937502 23689 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.938326 23584 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.938906 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:09.940394 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:09.939756 18965 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 9 to 11, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 11 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.941576 23749 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:09.941196 23761 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.941740 18965 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 10 to 11, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 11 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.943008 23761 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.944525 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:09.915733 23688 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:09.945461 23728 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:09.945564 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:09.946116 23728 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:09.946242 23645 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.939095 23689 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:09.931648 19714 leader_election.cc:336] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.785s (SENT)
I20260709 13:20:09.923491 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:09.947382 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.942003 23749 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:09.923820 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.948376 19218 raft_consensus.cc:2410] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:09.953593 19212 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:09.929071 19220 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:09.955042 19213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2041) took 2757 ms (client timeout 3233 ms). Trace:
W20260709 13:20:09.955791 19213 rpcz_store.cc:269] 0709 13:20:07.172310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.906607 (+2734297us) service_pool.cc:224] Handling call
0709 13:20:09.929975 (+ 23368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.923198 23013 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:09.927620 23624 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:09.968389 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.961558 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.962448 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2231) took 2778 ms (client timeout 3687 ms). Trace:
W20260709 13:20:09.969538 19218 rpcz_store.cc:269] 0709 13:20:07.179108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.906748 (+2727640us) service_pool.cc:224] Handling call
0709 13:20:09.957924 (+ 51176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:09.970481 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:09.971153 19218 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:09.971992 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.964138 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.963979 23728 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:09.974867 19218 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:09.965104 19219 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:09.967521 22878 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:09.965811 23146 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:09.982041 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.974404 19221 raft_consensus.cc:2410] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:09.958509 23174 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:09.956825 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:09.974884 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 86300.2us
W20260709 13:20:09.982894 19221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2049) took 2745 ms (client timeout 2939 ms). Trace:
I20260709 13:20:09.965162 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:09.983295 19221 rpcz_store.cc:269] 0709 13:20:07.237628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.900109 (+2662481us) service_pool.cc:224] Handling call
0709 13:20:09.963971 (+ 63862us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:20:09.982834 (+ 18863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11171584}
I20260709 13:20:09.983942 19217 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.973536 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:09.975196 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.981490 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.957377 23749 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.966594 23688 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:09.964550 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:09.983384 19216 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:20:09.986521 19215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2046) took 2753 ms (client timeout 2913 ms). Trace:
W20260709 13:20:09.991187 19215 rpcz_store.cc:269] 0709 13:20:07.232602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.897694 (+2665092us) service_pool.cc:224] Handling call
0709 13:20:09.973400 (+ 75706us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:20:09.986450 (+ 13050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17027840}
I20260709 13:20:09.986423 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:09.987291 19219 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:09.962273 23013 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.997313 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.007702 19068 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:09.988794 23146 consensus_queue.cc:1243] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:10.008585 19221 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:20:10.023372 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.024124 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.024317 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.025508 19215 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:10.029006 19218 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:10.012070 23013 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.033507 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.023231 23644 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:10.037863 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.018824 23174 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:09.944458 18965 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 8, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 8 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.043635 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.043748 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.041210 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.039389 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.042615 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.031025 23688 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.043330 19212 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
W20260709 13:20:10.048593 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 84165us
I20260709 13:20:10.049330 19216 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
W20260709 13:20:10.052814 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 121230us
I20260709 13:20:10.059398 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.061964 19218 raft_consensus.cc:2410] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:10.063208 19221 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:10.063833 23767 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:10.064239 23767 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:10.064268 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.065124 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.065268 23767 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.066197 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.067894 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.068339 19065 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:10.068233 19215 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:10.048749 23644 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:10.085315 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.057708 23637 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:10.042483 23582 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:20:10.106127 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.111824 19220 raft_consensus.cc:2410] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:10.108707 23146 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:20:10.086604 23767 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:10.114487 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2222) took 2935 ms (client timeout 2880 ms). Trace:
W20260709 13:20:10.114868 19220 rpcz_store.cc:269] 0709 13:20:07.176572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.896645 (+2720073us) service_pool.cc:224] Handling call
0709 13:20:10.112243 (+215598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.117264 19216 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.092110 23637 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:10.121261 19215 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:10.117985 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.119189 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.122908 19212 raft_consensus.cc:2410] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:10.123804 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2212) took 2947 ms. Trace:
I20260709 13:20:10.124197 19216 rpcz_store.cc:276] 0709 13:20:07.174005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.107901 (+2933896us) service_pool.cc:224] Handling call
0709 13:20:10.117073 (+  9172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.120830 (+  3757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.121037 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90368}
W20260709 13:20:10.124784 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.125291 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.126704 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2211) took 2949 ms. Trace:
I20260709 13:20:10.064641 18965 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 7 to 12, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 12 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:10.259557 23730 consensus_queue.cc:1059] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:10.262663 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.266726 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:10.266904 23146 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.267262 19145 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.267452 23146 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.269826 23146 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.127086 19215 rpcz_store.cc:276] 0709 13:20:07.173775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.073367 (+2899592us) service_pool.cc:224] Handling call
0709 13:20:10.121080 (+ 47713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.123308 (+  2228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.123474 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.274187 19145 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:10.227182 23004 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:10.283080 23004 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:10.229394 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2043) took 3056 ms. Trace:
I20260709 13:20:10.285866 19221 rpcz_store.cc:276] 0709 13:20:07.173009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.073307 (+2900298us) service_pool.cc:224] Handling call
0709 13:20:10.121307 (+ 48000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.229061 (+107754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.229086 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.229127 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:10.229160 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.229215 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.229315 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33408}
I20260709 13:20:10.229728 19217 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:10.230937 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2215) took 3056 ms. Trace:
I20260709 13:20:10.231276 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:10.166627 23174 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.107277 23753 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:20:10.149194 23772 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:10.165333 23766 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:20:10.306494 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.307225 19742 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.149605 23744 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:20:10.233183 23691 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:10.235101 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:10.166872 23644 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.236161 23768 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:10.224913 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.237774 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.239436 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.316231 19216 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:10.240142 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.242574 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.243315 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.243800 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.244609 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.244971 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.225549 23624 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.245647 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.316463 19063 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:10.246488 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.246729 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:10.247671 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.248018 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.323625 19147 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:10.324548 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.249286 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.250531 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.254803 19212 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:10.257922 19213 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
W20260709 13:20:10.275135 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 136798us
I20260709 13:20:10.119135 23747 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:20:10.306947 23146 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.281319 23760 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.140404 23700 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.300753 23619 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.302717 19220 rpcz_store.cc:276] 0709 13:20:07.174752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.117511 (+2942759us) service_pool.cc:224] Handling call
0709 13:20:10.230410 (+112899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.230602 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.230628 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.230690 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:10.230718 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.230768 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.230866 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.127230 23582 consensus_queue.cc:1243] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:20:10.310940 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.314571 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.321600 19064 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 8: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.317797 19070 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:10.316646 19072 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:10.313470 23751 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.313608 23772 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:10.341851 19140 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:10.225693 23584 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:10.364543 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.364390 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.365255 19072 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:10.365825 23584 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:10.366310 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.366994 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:10.367594 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.368283 19066 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 14. Ops: []
W20260709 13:20:10.368585 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.279894 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.328438 19217 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:10.370165 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2219) took 3194 ms. Trace:
I20260709 13:20:10.370483 19217 rpcz_store.cc:276] 0709 13:20:07.175719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.306433 (+3130714us) service_pool.cc:224] Handling call
0709 13:20:10.328163 (+ 21730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.369929 (+ 41766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.370113 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.329438 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2216) took 3154 ms. Trace:
I20260709 13:20:10.331642 19146 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:10.371728 19212 rpcz_store.cc:276] 0709 13:20:07.174992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.254291 (+3079299us) service_pool.cc:224] Handling call
0709 13:20:10.254593 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.329130 (+ 74537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.329368 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.316035 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:10.335844 17969 debug-util.cc:398] Leaking SignalData structure 0x7b080000ff60 after lost signal to thread 19110
I20260709 13:20:10.335644 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:10.336740 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 105550us
I20260709 13:20:10.341709 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.342562 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.338927 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:10.341079 19141 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:10.315891 23768 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:10.345077 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.345717 19218 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:10.345949 19144 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:10.350106 23772 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.351596 19142 raft_consensus.cc:2393] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 9: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.351913 19138 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.353013 23004 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.356297 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:10.357029 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.359854 23624 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.359231 19743 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:10.344499 23751 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.336359 23760 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.361212 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.362016 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:10.399816 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 119990us
I20260709 13:20:10.362134 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.337525 23637 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.337910 23700 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.363641 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.364041 19213 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:10.404244 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2225) took 3226 ms. Trace:
I20260709 13:20:10.400758 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.404668 19213 rpcz_store.cc:276] 0709 13:20:07.177522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.333347 (+3155825us) service_pool.cc:224] Handling call
0709 13:20:10.363848 (+ 30501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.403932 (+ 40084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.404180 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.399542 19751 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
W20260709 13:20:10.406330 19110 connection.cc:256] RPC call timeout handler was delayed by -2.8880887639998036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:20:10.407464 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 68644.2us
I20260709 13:20:10.362064 19068 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.367213 19072 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.243343 23749 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.397775 19215 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:10.411121 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.408154 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:10.414584 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:10.420094 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.420542 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:10.420739 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.421191 19066 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.413362 19145 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:10.421334 19141 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:10.423542 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:10.406980 23744 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:10.403069 23773 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.426930 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2226) took 3249 ms. Trace:
W20260709 13:20:10.427450 19110 connection.cc:256] RPC call timeout handler was delayed by -2.6919046189998426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 13:20:10.400210 23760 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:10.428328 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 112372us
I20260709 13:20:10.441381 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:10.428829 19212 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:10.407972 23700 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.427039 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.442680 19138 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.431233 19217 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:10.409919 23753 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.436295 19220 rpcz_store.cc:276] 0709 13:20:07.177761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.340328 (+3162567us) service_pool.cc:224] Handling call
0709 13:20:10.408808 (+ 68480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.426606 (+ 17798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.426637 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.426679 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:10.426718 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.426781 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.426882 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.445328 23004 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.416260 23688 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:10.445495 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.421581 23689 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:10.440704 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:10.446372 19110 connection.cc:256] RPC call timeout handler was delayed by -1.9183718340000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2502s for a response
I20260709 13:20:10.429531 19146 raft_consensus.cc:2376] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16. Re-sending same reply.
W20260709 13:20:10.450340 19110 connection.cc:256] RPC call timeout handler was delayed by -1.6592348340000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
I20260709 13:20:10.446615 19145 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.450646 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2237) took 3221 ms. Trace:
I20260709 13:20:10.451023 19212 rpcz_store.cc:276] 0709 13:20:07.229008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.372469 (+3143461us) service_pool.cc:224] Handling call
0709 13:20:10.420074 (+ 47605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.450413 (+ 30339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.450585 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.453866 19749 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:10.426435 23624 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:10.458693 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:10.460004 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.460192 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:10.468080 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 53568.3us
I20260709 13:20:10.468287 19142 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:10.469756 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:10.471380 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.449530 23688 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.421737 23619 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.475435 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.483711 19212 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:10.441314 23767 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.475255 19038 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:10.478178 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.481316 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.455844 23689 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:10.457466 23765 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:10.493257 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.493851 19220 raft_consensus.cc:2376] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14. Re-sending same reply.
W20260709 13:20:10.494346 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.485673 19213 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:10.495236 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2047) took 3262 ms. Trace:
I20260709 13:20:10.495540 19213 rpcz_store.cc:276] 0709 13:20:07.232906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.405636 (+3172730us) service_pool.cc:224] Handling call
0709 13:20:10.444410 (+ 38774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.495012 (+ 50602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.495186 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.458015 23635 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:10.472030 19064 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:10.490518 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:10.482952 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.455155 23784 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:10.450371 23753 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.502076 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.481648 23688 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.505998 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.500793 19035 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.473810 23744 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:10.510541 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.512739 19142 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.513562 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.514384 19213 raft_consensus.cc:2410] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:10.493462 23689 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.474714 23013 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.500905 23624 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.463415 23773 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.500536 23635 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:10.518729 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.519304 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:10.519935 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.502694 23785 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:10.547637 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.522392 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.555102 19213 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:10.559413 19220 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
W20260709 13:20:10.559834 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44559.9us
I20260709 13:20:10.561074 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.493683 23767 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.520967 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.564450 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:10.565402 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.566190 19069 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.512393 22878 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:10.571305 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 113483us
I20260709 13:20:10.474973 23768 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.574735 19068 raft_consensus.cc:2393] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 9: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.519148 23644 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:10.565400 19143 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:20:10.559207 23777 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:20:10.576264 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.572249 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:10.555361 23635 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.595834 23015 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.596344 23015 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:10.596751 23015 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:10.597131 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 112391us
I20260709 13:20:10.510663 23765 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.600255 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.604537 19220 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:10.601683 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.601828 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.606309 19213 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:10.603518 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.557236 19147 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
W20260709 13:20:10.607157 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 106485us
I20260709 13:20:10.558414 23785 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.607160 19141 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:20:10.575275 22878 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.611958 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.612085 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:10.614336 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 154334us
I20260709 13:20:10.594708 23619 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:10.605515 23776 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:20:10.618319 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.620662 19742 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:10.606937 23644 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:10.631063 19064 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.621953 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.626683 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.635221 19213 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
W20260709 13:20:10.635486 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.635866 23791 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:10.636097 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.636329 23791 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.636768 23791 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.637593 19213 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:10.638185 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2055) took 3397 ms. Trace:
W20260709 13:20:10.613396 23778 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:20:10.640064 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2214) took 3465 ms. Trace:
I20260709 13:20:10.640479 19219 rpcz_store.cc:276] 0709 13:20:07.174496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.113952 (+2939456us) service_pool.cc:224] Handling call
0709 13:20:10.243967 (+130015us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:10.244491 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.244524 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:10.245212 (+   688us) log.cc:844] Serialized 52 byte log entry
0709 13:20:10.334929 (+ 89717us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:10.334974 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.335037 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.639810 (+304773us) raft_consensus.cc:1685] finished
0709 13:20:10.639836 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.639985 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":89351,"threads_started":1,"wal-append.queue_time_us":189736}
I20260709 13:20:10.611065 22878 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.638473 19213 rpcz_store.cc:276] 0709 13:20:07.241254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.637151 (+3395897us) service_pool.cc:224] Handling call
0709 13:20:10.637439 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.637962 (+   523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.638112 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.632261 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.643898 19745 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 9.
I20260709 13:20:10.632668 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.633162 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:10.647995 23786 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:20:10.648268 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2057) took 2958 ms. Trace:
I20260709 13:20:10.648655 19219 rpcz_store.cc:276] 0709 13:20:07.689631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.641913 (+2952282us) service_pool.cc:224] Handling call
0709 13:20:10.647712 (+  5799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.647904 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.647931 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.648000 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:10.648031 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.648086 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.648201 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.649379 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2221) took 3473 ms. Trace:
I20260709 13:20:10.649626 19143 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:10.649760 19216 rpcz_store.cc:276] 0709 13:20:07.176323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.316868 (+3140545us) service_pool.cc:224] Handling call
0709 13:20:10.349994 (+ 33126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.350349 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.350376 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.350878 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.409772 (+ 58894us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:10.409809 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.410742 (+   933us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.649179 (+238437us) raft_consensus.cc:1685] finished
0709 13:20:10.649198 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.649307 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13064,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"thread_start_us":58539,"threads_started":1,"wal-append.queue_time_us":156685}
I20260709 13:20:10.651954 19216 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:10.653108 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.653878 19751 raft_consensus.cc:2393] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.622260 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.623440 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.659006 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.659359 19750 raft_consensus.cc:2410] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:10.612920 23751 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:10.661470 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.609109 23785 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:10.662222 19742 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:10.663836 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:10.677543 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65491.2us
I20260709 13:20:10.679082 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:10.617252 23790 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:10.685503 23780 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:20:10.693639 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.694567 19220 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 10: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:10.686667 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:10.697402 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.617059 23761 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 13:20:10.685662 23787 log.cc:927] Time spent T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:20:10.704816 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:10.705581 19745 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:20:10.703598 19212 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:10.707196 19212 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:10.694518 23795 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.710345 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.712791 23767 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:10.719631 19063 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:10.725811 19216 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.705468 23784 raft_consensus.cc:3060] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:10.750388 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.767720 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.768669 23765 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.769058 19035 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:10.769455 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.770192 19220 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:10.629002 23793 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:20:10.778891 19140 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 8.
I20260709 13:20:10.779093 23015 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.757450 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:10.766358 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2060) took 1391 ms. Trace:
I20260709 13:20:10.683493 23744 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:10.780375 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 137770us
I20260709 13:20:10.780117 19213 rpcz_store.cc:276] 0709 13:20:09.375006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.659546 (+1284540us) service_pool.cc:224] Handling call
0709 13:20:10.697948 (+ 38402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.766024 (+ 68076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.766053 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.766096 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:10.766126 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.766183 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.766300 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:10.765519 23773 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.783931 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.711079 23795 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:10.769104 23780 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:10.785825 19212 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.790625 19070 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:10.784827 23797 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:10.794674 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.785188 23751 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:10.787618 23015 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.788273 23795 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.797564 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:10.786963 23789 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.805276 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:10.786666 23013 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.810221 19212 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:10.812103 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.812644 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.823762 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.825970 19213 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:10.795760 23797 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.794653 23753 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.796249 23790 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:10.801558 23751 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.807003 23789 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.815749 23791 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.850159 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:10.850916 23813 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:10.851514 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:10.852383 23813 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.860045 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.831234 23797 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.860858 19213 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
W20260709 13:20:10.864620 23796 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
I20260709 13:20:10.838336 23751 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.788100 23644 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.833930 23013 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:10.838742 23789 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:10.871083 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 236604us
W20260709 13:20:10.872197 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 88539.5us
I20260709 13:20:10.875633 23813 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:10.907245 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:10.874296 23583 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.920182 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:10.921882 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 69970.1us
I20260709 13:20:10.923384 19213 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:10.923159 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:10.921501 23808 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:10.924079 23808 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:10.924559 23771 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:10.925117 23771 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.925243 23790 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.926331 23691 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:10.926736 23691 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:10.928231 23624 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:10.930037 23769 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:10.930423 23769 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:10.931245 23769 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.931690 23795 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.932282 23769 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.932142 23700 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:10.933336 23782 raft_consensus.cc:3055] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:10.933734 23782 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:10.934638 23782 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.935617 23782 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:10.938138 19214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2039) took 3766 ms (client timeout 3000 ms). Trace:
W20260709 13:20:10.938532 19214 rpcz_store.cc:269] 0709 13:20:07.171842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.898747 (+2726905us) service_pool.cc:224] Handling call
0709 13:20:09.975064 (+ 76317us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b5800122d98. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:20:10.937909 (+962845us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54002693d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:10.938054 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961270784}
I20260709 13:20:10.939754 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.939880 22878 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.940586 19221 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.933724 23795 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.943919 19744 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:10.944335 23700 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:10.946624 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:10.948592 22878 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.940331 23635 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.954329 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:10.927610 23691 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:10.955822 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:10.916105 23013 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:10.968869 19072 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:10.917790 23583 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.005726 19213 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:20:11.006173 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 99015.7us
I20260709 13:20:11.006204 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 647) took 1524 ms. Trace:
I20260709 13:20:11.008302 19219 rpcz_store.cc:276] 0709 13:20:09.481476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.649581 (+1168105us) service_pool.cc:224] Handling call
0709 13:20:10.649861 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.650082 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:10.696437 (+ 46355us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.005866 (+309429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.005918 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:11.005966 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.006043 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.006152 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":747,"prepare.queue_time_us":46350,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":3859840,"thread_start_us":318006,"threads_started":2}
I20260709 13:20:11.010373 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2213) took 3836 ms. Trace:
I20260709 13:20:11.012898 19218 rpcz_store.cc:276] 0709 13:20:07.174232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.113758 (+2939526us) service_pool.cc:224] Handling call
0709 13:20:10.126624 (+ 12866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.400288 (+273664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.010107 (+609819us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540036ced4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:11.010316 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503271680}
I20260709 13:20:11.014853 23815 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.014505 23795 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.020439 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:11.021575 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:11.022347 19220 raft_consensus.cc:2410] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:11.010298 23583 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.026036 19110 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:11.027304 19110 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.028745 23773 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:11.029429 23773 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:11.030382 23773 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.033053 23753 raft_consensus.cc:2804] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:11.033210 23624 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:11.033593 23753 raft_consensus.cc:697] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:11.034566 23753 consensus_queue.cc:237] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.045445 23791 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.971163 23772 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:11.046733 23772 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:11.047120 23772 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.050935 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2218) took 3875 ms. Trace:
I20260709 13:20:11.051307 19221 rpcz_store.cc:276] 0709 13:20:07.175467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.286961 (+3111494us) service_pool.cc:224] Handling call
0709 13:20:10.940386 (+653425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.950485 (+ 10099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.050750 (+100265us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54002693d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:11.050880 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469925632}
I20260709 13:20:11.052413 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:11.053948 23749 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:11.058180 23635 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:10.967897 23765 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.058835 23765 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.059180 23765 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.065236 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2236) took 3836 ms. Trace:
I20260709 13:20:11.065634 23691 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.065601 19217 rpcz_store.cc:276] 0709 13:20:07.228701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.371176 (+3142475us) service_pool.cc:224] Handling call
0709 13:20:10.420464 (+ 49288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.444009 (+ 23545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.065036 (+621027us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400161054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:11.065184 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24332544}
I20260709 13:20:11.066871 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:11.068490 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 654) took 1099 ms. Trace:
I20260709 13:20:11.069873 19216 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:11.070422 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 655) took 1100 ms. Trace:
I20260709 13:20:11.070694 19216 rpcz_store.cc:276] 0709 13:20:09.969526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.069300 (+1099774us) service_pool.cc:224] Handling call
0709 13:20:11.069577 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.070214 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.070376 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.071936 19216 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:11.072397 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 662) took 1100 ms. Trace:
I20260709 13:20:11.014483 23808 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.023059 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:11.073287 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2217) took 3898 ms. Trace:
I20260709 13:20:11.091977 19215 rpcz_store.cc:276] 0709 13:20:07.175217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.270743 (+3095526us) service_pool.cc:224] Handling call
0709 13:20:10.271116 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.413001 (+141885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.073086 (+660085us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b5400100254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:11.073236 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226086656}
I20260709 13:20:11.072664 19216 rpcz_store.cc:276] 0709 13:20:09.971496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.071353 (+1099857us) service_pool.cc:224] Handling call
0709 13:20:11.071617 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.072209 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.072355 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:11.096187 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.096724 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.097357 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 328339us
I20260709 13:20:11.068774 19217 rpcz_store.cc:276] 0709 13:20:09.969201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.067705 (+1098504us) service_pool.cc:224] Handling call
0709 13:20:11.067968 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.068198 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.068221 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.068257 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:11.068286 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.068337 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.068442 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:11.085489 19212 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:11.099573 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:11.109754 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:11.117849 19221 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.133317 19219 raft_consensus.cc:2410] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:20:11.040822 23688 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.000s
I20260709 13:20:11.133702 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:11.019567 23797 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.135182 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:11.117332 19212 pending_rounds.cc:85] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:11.142011 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:11.085697 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 57307.8us
W20260709 13:20:11.143868 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.144958 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.146919 19064 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:11.147593 19110 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:11.152506 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.154196 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.154460 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:11.135001 23760 consensus_meta.cc:287] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.672s	user 0.004s	sys 0.006s
I20260709 13:20:11.155476 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:11.156383 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:11.158411 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.159924 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.160130 19066 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:11.141800 19212 pending_rounds.cc:107] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:11.161731 19212 raft_consensus.cc:2889] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:11.162819 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.163734 19068 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:11.163856 19071 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:11.164973 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:11.165961 19216 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:11.168335 19216 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:11.138420 23771 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.171700 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:11.173934 19072 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:11.157678 23689 consensus_meta.cc:287] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.003s
I20260709 13:20:11.172386 19065 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:11.088560 23791 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
W20260709 13:20:11.190332 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.198674 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:11.186054 19069 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:11.199215 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.206386 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2053) took 3967 ms. Trace:
W20260709 13:20:11.200999 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.207594 19212 rpcz_store.cc:276] 0709 13:20:07.238784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.625237 (+3386453us) service_pool.cc:224] Handling call
0709 13:20:10.683030 (+ 57793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.206100 (+523070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.206320 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:11.202641 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.209384 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.209808 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.203392 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.200673 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 53154.6us
W20260709 13:20:11.213001 19184 connection.cc:256] RPC call timeout handler was delayed by -3.1896260799999254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 13:20:11.144801 23688 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.224922 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:11.225515 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.219439 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:11.227093 19216 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:11.227187 19184 connection.cc:256] RPC call timeout handler was delayed by -2.8116260799999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 13:20:11.228164 19184 connection.cc:256] RPC call timeout handler was delayed by -2.7019283889999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:20:11.228538 19184 connection.cc:256] RPC call timeout handler was delayed by -2.688428389000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:20:11.228890 19184 connection.cc:256] RPC call timeout handler was delayed by -2.515628389000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:20:11.229259 19184 connection.cc:256] RPC call timeout handler was delayed by -2.4976283890000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 13:20:11.230474 19184 connection.cc:256] RPC call timeout handler was delayed by -2.4976283890000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 13:20:11.231122 19184 connection.cc:256] RPC call timeout handler was delayed by -2.424728388999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:20:11.231783 19184 connection.cc:256] RPC call timeout handler was delayed by -2.4166283890001523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:20:11.232869 23814 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:20:11.234458 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.235915 23765 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.237349 19146 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:11.237840 19139 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:11.238569 19145 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:11.239743 19141 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:11.224418 23645 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:20:11.243541 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.244179 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.153345 23789 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.250192 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:11.252619 23812 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:11.288969 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.289927 19144 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:11.199654 23013 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.296344 19069 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:20:11.297566 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.298441 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:11.301165 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 355076us
I20260709 13:20:11.225112 23815 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.198817 23689 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.166332 23760 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.327711 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:11.334643 19072 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
I20260709 13:20:11.333621 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.336233 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:11.327298 19064 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:11.199847 23816 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.221807 22878 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.336457 19144 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:11.338845 19141 raft_consensus.cc:2410] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:11.339768 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:11.342684 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:11.343133 19184 connection.cc:256] RPC call timeout handler was delayed by -2.4166283890001523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:20:11.341220 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:11.343273 19145 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
W20260709 13:20:11.345505 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.345049 19221 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
W20260709 13:20:11.343991 19184 connection.cc:256] RPC call timeout handler was delayed by -2.4103283890001421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:20:11.347290 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 205969us
I20260709 13:20:11.348126 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:11.349027 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.349406 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:11.346625 19184 connection.cc:256] RPC call timeout handler was delayed by -2.3056947649999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:20:11.338143 23785 consensus_meta.cc:287] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.638s	user 0.014s	sys 0.000s
I20260709 13:20:11.352331 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.352936 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.354182 19749 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:11.354357 19746 raft_consensus.cc:2393] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:11.334483 23815 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.360134 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.360958 19145 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
W20260709 13:20:11.362443 19184 connection.cc:256] RPC call timeout handler was delayed by -2.2744283890001498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 13:20:11.362864 19184 connection.cc:256] RPC call timeout handler was delayed by -2.1709283889999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 13:20:11.363207 19184 connection.cc:256] RPC call timeout handler was delayed by -2.06732607999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28490000000000004s for a response
W20260709 13:20:11.363607 19184 connection.cc:256] RPC call timeout handler was delayed by -2.0493241980000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 13:20:11.363934 19184 connection.cc:256] RPC call timeout handler was delayed by -1.9413260799999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2989s for a response
I20260709 13:20:11.364776 19143 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 10.
W20260709 13:20:11.353634 23821 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.124s	user 0.003s	sys 0.000s
I20260709 13:20:11.366789 19141 raft_consensus.cc:1240] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:20:11.364228 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0936312260000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31370000000000003s for a response
W20260709 13:20:11.372130 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.352252 23789 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.380295 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.363469 23815 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.363123 23644 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.384770 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.387141 19145 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
W20260709 13:20:11.387832 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.388722 19776 heartbeater.cc:646] Failed to heartbeat to 127.17.139.62:35345 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.139.62:35345 timed out after 15.000s (SENT)
I20260709 13:20:11.351397 23751 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.389855 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:11.376420 23784 consensus_meta.cc:287] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.000s
I20260709 13:20:11.397194 23829 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:11.397746 23829 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:11.398214 23829 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.399201 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.400187 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:11.401467 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 60358.3us
I20260709 13:20:11.402338 19141 raft_consensus.cc:2368] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:11.357045 23785 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:11.285697 23619 consensus_queue.cc:1175] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "508ee2e0531b43d7a1c05f950644ae66" responder_term: 16 status { last_received { term: 15 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:11.409299 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.409758 23765 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:11.410642 19146 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:20:11.411540 23751 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.411731 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.412211 23785 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:11.412935 19139 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:11.413079 23824 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.413453 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.414144 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.414727 19147 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.403702 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.409291 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.417071 19140 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.418893 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.413537 22878 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.402441 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:11.419479 19070 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:11.439416 23689 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.440639 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.436789 23765 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.441401 23765 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.442306 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.443315 23765 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.443873 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:11.444407 23765 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.446040 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:11.383374 23825 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.447182 23825 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.447820 23583 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.402099 23784 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:11.436429 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:11.404249 23789 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:20:11.456820 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54426.9us
I20260709 13:20:11.454257 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:11.459086 19113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.006s	sys 0.010s
W20260709 13:20:11.459508 19113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.010s
I20260709 13:20:11.409284 23688 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:11.463243 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:11.485666 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 137646us
I20260709 13:20:11.450924 23749 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.491959 19140 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:11.449128 23797 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.455358 23624 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.454367 23816 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.508934 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:11.503614 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.447794 23825 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.505645 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:11.506016 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.506794 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.507269 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.514242 19140 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.457832 23795 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:11.454638 23644 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.527863 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:11.528278 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.522874 19144 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:11.529093 19142 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:11.529052 19141 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.524107 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.524915 19110 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:11.534818 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.494728 23791 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:11.513075 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 833986us
I20260709 13:20:11.546260 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:11.488442 23789 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:11.542181 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:11.542214 19751 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:11.530732 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.551081 19139 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.485632 23700 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:20:11.545503 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 99582.6us
I20260709 13:20:11.546600 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:11.507591 23624 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.527264 19742 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 17: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:11.559549 19214 raft_consensus.cc:2410] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:11.561898 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.558248 19066 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:11.562996 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:11.563203 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.563963 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:11.564373 19066 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:11.566352 23004 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:11.566871 19140 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:11.567075 19745 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:11.547890 23769 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.004s
I20260709 13:20:11.569150 19064 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:20:11.565835 19714 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:11.572719 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.577571 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.592398 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.600208 19063 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:20:11.613459 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.553841 23760 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.568074 23624 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.621547 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:11.623050 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 76862.7us
I20260709 13:20:11.621929 19064 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 17. Ops: []
W20260709 13:20:11.636472 23822 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:20:11.555339 23772 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.639638 23772 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:11.641158 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 153092us
I20260709 13:20:11.641906 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:11.642791 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.643926 19110 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:11.646111 23817 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:20:11.649549 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:11.653023 23830 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 13:20:11.655251 23833 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:20:11.657711 23583 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.659200 23744 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.659689 23744 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:11.663715 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 63168.8us
I20260709 13:20:11.664235 19147 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
W20260709 13:20:11.667619 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 144539us
I20260709 13:20:11.566488 23644 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:20:11.665853 19139 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:11.597141 23827 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.622228 23700 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.683156 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.699311 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:11.701432 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:11.668466 23753 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:11.669850 23583 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.668651 23769 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:11.721907 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.737800 23834 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:20:11.739050 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2062) took 1300 ms. Trace:
I20260709 13:20:11.739413 19218 rpcz_store.cc:276] 0709 13:20:10.438654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.080066 (+641412us) service_pool.cc:224] Handling call
0709 13:20:11.080456 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.081046 (+   590us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:11.081096 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.081649 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.383971 (+302322us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:11.384018 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.384099 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.738844 (+354745us) raft_consensus.cc:1685] finished
0709 13:20:11.738865 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.738992 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1267,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6854,"thread_start_us":301907,"threads_started":1,"wal-append.queue_time_us":413249}
W20260709 13:20:11.741233 23832 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:20:11.671093 23785 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:11.731056 19139 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:11.733202 19745 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:11.721239 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:11.735196 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 69276.1us
W20260709 13:20:11.748888 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65812.2us
W20260709 13:20:11.749073 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 183313us
I20260709 13:20:11.749320 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.753402 19141 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
W20260709 13:20:11.754086 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.696s (SENT) [suppressed 45 similar messages]
W20260709 13:20:11.770057 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.782214 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 80829.9us
I20260709 13:20:11.836920 19035 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:11.787302 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.839855 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.791955 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.730568 23753 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.746407 23771 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.747646 23785 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.801870 23744 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:11.807310 23838 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:11.808521 23836 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:20:11.809466 23840 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:20:11.810002 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 113929us
W20260709 13:20:11.811103 23839 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:11.818581 23815 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:11.835843 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.706995 23805 raft_consensus.cc:3055] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:11.841761 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.795428 23691 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:11.845439 23004 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:20:11.800858 23833 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:20:11.849241 23837 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:11.845407 23765 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:20:11.796645 23619 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:11.851006 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 59168.3us
I20260709 13:20:11.798444 23768 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:11.851460 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.898952 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.899292 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:11.900198 23844 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:11.902315 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:11.902724 23808 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.848762 23753 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.848518 23013 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:11.735383 23789 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.852805 23785 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:11.907191 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.846302 23700 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:11.833637 23773 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:20:11.908707 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:11.883098 23637 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.909389 19214 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.855831 23583 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:11.900259 23814 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:11.902382 23844 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:11.903055 19219 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:11.886338 23791 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:11.885581 22878 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.890811 19066 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:11.917641 22878 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:11.914832 19217 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:11.915349 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:11.873450 23749 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:11.925938 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:11.853250 23795 consensus_queue.cc:1059] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:20:11.879137 23805 raft_consensus.cc:740] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:11.930842 19221 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:11.957716 22878 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.942348 23815 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:11.943671 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:11.945070 23842 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:20:11.916970 23837 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:11.917107 23013 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:11.954387 23782 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:11.917273 23791 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:11.955161 23790 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.974449 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:11.925063 23700 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:11.973330 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:11.880048 23691 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:11.959249 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:11.983527 19141 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:11.961859 19146 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:20:11.942410 23831 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.536s	user 0.003s	sys 0.000s
I20260709 13:20:11.955189 19139 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:11.975423 19746 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:11.974030 23760 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:20:11.977777 23837 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.974267 23645 raft_consensus.cc:2764] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:20:11.978470 23784 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:11.978739 23013 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.933468 23844 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:11.962402 23744 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.973197 23767 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:11.998852 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:11.980453 23790 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:11.970477 23624 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:11.986830 23691 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.010030 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:11.996907 23843 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:11.972913 23689 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:20:12.011842 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 306218us
W20260709 13:20:12.023969 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.007455 23795 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:20:12.017506 23824 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:20:12.033497 23645 raft_consensus.cc:2764] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:12.030320 23624 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.044734 23824 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:12.045234 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:12.045500 23824 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:12.034883 19143 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:12.046308 23753 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.037931 23841 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:12.047338 23841 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:12.048601 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.052114 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.048139 23841 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.053138 23645 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.053439 23841 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.046487 23824 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.041646 23773 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:12.054663 23773 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:12.055094 23824 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.055506 23773 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.056470 23773 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.046427 23815 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.057722 19067 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:12.058581 23813 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.059032 23813 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.059707 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2194) took 1820 ms. Trace:
I20260709 13:20:12.060075 19067 rpcz_store.cc:276] 0709 13:20:10.239059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.242101 (+  3042us) service_pool.cc:224] Handling call
0709 13:20:10.242389 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.058113 (+1815724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.059478 (+  1365us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400036e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:12.059652 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4173963520}
I20260709 13:20:12.007514 23767 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:12.061376 23791 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.061506 23767 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.063427 23767 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.063328 19184 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:12.064303 23645 raft_consensus.cc:2804] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:12.064924 23645 raft_consensus.cc:697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:12.065800 23645 consensus_queue.cc:237] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.042528 23700 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:12.067436 23825 consensus_meta.cc:287] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.000s
I20260709 13:20:12.067827 23825 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.068938 19070 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:12.062438 23791 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.070255 23749 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:12.071427 23747 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:12.071781 23747 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:12.072587 23747 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.073957 23747 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.074150 23818 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.074815 23818 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.075963 19214 raft_consensus.cc:2410] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:12.036545 23797 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:12.077422 23797 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:12.078269 23797 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.079291 23797 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:12.080446 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.019541 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 185889us
I20260709 13:20:12.038048 19216 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:12.081898 19216 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:12.083382 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:12.029295 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2066) took 1587 ms. Trace:
I20260709 13:20:12.084340 19746 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:12.034649 22878 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.029873 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2072) took 1540 ms. Trace:
I20260709 13:20:12.089186 19213 rpcz_store.cc:276] 0709 13:20:10.489285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.100547 (+611262us) service_pool.cc:224] Handling call
0709 13:20:11.147423 (+ 46876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.157938 (+ 10515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.157964 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.163647 (+  5683us) log.cc:844] Serialized 556 byte log entry
0709 13:20:11.229407 (+ 65760us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:11.229459 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.229527 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.941698 (+712171us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:12.029614 (+ 87916us) raft_consensus.cc:1685] finished
0709 13:20:12.029633 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.029818 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62593920,"thread_start_us":65393,"threads_started":1,"wal-append.queue_time_us":238486}
W20260709 13:20:12.048079 23829 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
W20260709 13:20:12.091956 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.093302 19038 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.094784 19219 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:12.104127 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:12.106029 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:11.998440 23785 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.114523 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.110284 19216 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:12.090402 23842 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:20:12.119560 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.148598 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.149874 19214 raft_consensus.cc:1240] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:12.150234 23645 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.009383 23744 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.041148 23843 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:12.048290 23753 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.017220 23782 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:12.109197 23824 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:12.084556 19215 rpcz_store.cc:276] 0709 13:20:10.441706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.093049 (+651343us) service_pool.cc:224] Handling call
0709 13:20:11.139867 (+ 46818us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:11.159166 (+ 19299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.159209 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:11.213855 (+ 54646us) log.cc:844] Serialized 52 byte log entry
0709 13:20:11.418520 (+204665us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:11.451970 (+ 33450us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.452235 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.452332 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.646003 (+193671us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18002a9f40. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:20:12.020589 (+374586us) raft_consensus.cc:1685] finished
0709 13:20:12.029066 (+  8477us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.029235 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33812,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":240,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":22275,"spinlock_wait_cycles":3171200,"thread_start_us":83371,"threads_started":1,"wal-append.queue_time_us":280365}
W20260709 13:20:12.152670 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46737.6us
I20260709 13:20:12.090196 23818 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:12.112957 23700 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:12.164101 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.174736 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.115139 23769 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.152635 19216 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:12.163323 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 255140us
I20260709 13:20:12.144809 23624 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.169718 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.045411 23790 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.164139 23771 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.180203 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 81989.9us
W20260709 13:20:12.181375 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.181180 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:12.115682 23829 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.166178 23782 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:12.169498 23855 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:12.199141 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.199110 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.181972 23700 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:12.201923 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:12.204434 19138 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
W20260709 13:20:12.203327 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.057806 23844 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.178450 23689 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:20:12.192929 23789 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.202193 23769 consensus_queue.cc:1059] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:20:12.244249 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:12.200949 23816 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 13:20:12.202299 23747 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.199136 23765 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:12.226599 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.232100 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2077) took 1615 ms. Trace:
I20260709 13:20:12.173007 23645 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.200302 23807 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.218837 23864 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.212s	user 0.000s	sys 0.003s
I20260709 13:20:12.240841 23818 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:12.213881 23784 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.193832 23771 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.222234 23861 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:20:12.198136 23782 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:12.246349 19138 rpcz_store.cc:276] 0709 13:20:10.616861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.630313 (+ 13452us) service_pool.cc:224] Handling call
0709 13:20:12.231936 (+1601623us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400221d54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:12.232033 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3552323840}
I20260709 13:20:12.247912 23765 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.259716 23765 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.249929 23772 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.243904 23843 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.262594 23645 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:12.263151 23691 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.263891 23583 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:12.264263 23583 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:12.265173 23862 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:12.265136 23583 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.266420 23862 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:12.266697 23583 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.267197 23862 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:12.267547 23862 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:12.247968 23816 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.246135 23767 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:20:12.253434 23807 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.270337 23785 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:12.271873 23807 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:12.252197 23808 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:20:12.254967 23818 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:12.275118 23818 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.275658 23790 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.240298 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.278275 19746 raft_consensus.cc:2410] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:12.279042 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:12.203404 23744 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:12.283489 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.285661 23860 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:12.252300 23689 consensus_queue.cc:1243] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:12.286818 19147 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:12.287730 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:12.287952 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:12.288507 23814 consensus_queue.cc:1059] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:12.289161 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:12.289685 19140 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.289999 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.292620 23784 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.293309 23784 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.296427 23805 consensus_queue.cc:260] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.297750 23805 raft_consensus.cc:3060] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.289709 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:12.298914 19146 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:12.299290 23825 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.301859 23813 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:12.284610 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.304134 23855 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.304324 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.288527 19744 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.306731 23785 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:12.306414 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.309332 23862 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.310235 19140 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:12.310806 23862 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.311337 23818 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.311771 23789 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.313401 23855 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:12.314476 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.311789 23829 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:12.317111 23855 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:12.322104 23814 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.322608 23814 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.324465 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:12.325738 23814 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:12.326103 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:12.327054 23870 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.328085 23813 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:12.327932 23765 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.329838 23785 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:12.330260 23785 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:12.331120 23785 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.332353 23785 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:12.327086 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 48100.7us
I20260709 13:20:12.333761 23691 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:12.241773 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.252297 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:12.195715 23624 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.334833 19070 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:12.254617 23700 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.258759 19143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:12.338734 19143 raft_consensus.cc:606] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.339046 19143 raft_consensus.cc:614] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:12.259327 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.339469 19744 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:12.282693 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:12.283010 23771 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.286065 23860 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:20:12.345130 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.347141 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:12.367470 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:12.371340 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.347378 19216 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:20:12.347522 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:12.372664 19035 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:12.373220 19216 pending_rounds.cc:85] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 11
I20260709 13:20:12.373543 19216 pending_rounds.cc:107] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:20:12.373839 19216 raft_consensus.cc:2889] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:12.378896 19070 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:12.371217 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.381970 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:12.382308 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:12.393057 19140 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.385779 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:12.386099 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:12.393838 19066 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:12.394112 19071 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.395282 19214 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:12.395653 19146 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:12.385407 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.397017 19212 raft_consensus.cc:2410] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:20:12.396978 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 62184.4us
I20260709 13:20:12.400311 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.401515 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.405143 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.386418 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.407981 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.409078 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.409658 19217 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:12.408490 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.410560 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.411039 19215 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.411736 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.411839 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.412645 19216 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.404762 23843 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.413610 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.368112 23691 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.415285 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.417011 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.375876 23765 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.421540 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.428349 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.429844 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.424192 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.424351 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.384262 23814 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:12.420581 19145 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:12.425894 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.426417 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.431243 19138 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:12.431255 19219 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.432817 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.433336 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.439778 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:12.433005 23860 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.433478 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.476666 19141 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:20:12.433902 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.477321 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.477854 19218 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.478127 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.478649 19214 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.384020 23689 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:12.481273 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.434425 23861 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.482403 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.434562 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.483789 19220 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:12.439016 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.485241 19214 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:12.440081 19212 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:12.486342 19214 raft_consensus.cc:1240] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:12.443344 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:12.448760 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.488114 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:12.488449 18965 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 116) took 16280 ms (client timeout 15000 ms). Trace:
I20260709 13:20:12.488826 19214 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.412533 23789 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.492184 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:12.492501 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
W20260709 13:20:12.461630 23863 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:12.462158 23818 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:12.463272 19140 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:12.413872 23825 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:12.384197 23772 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:20:12.467410 19216 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:12.468629 23624 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.472999 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:12.513211 19067 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:12.473754 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:12.514125 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 84368.5us
I20260709 13:20:12.514317 19068 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.474392 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:12.475906 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 50384.1us
I20260709 13:20:12.440220 19714 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.493036 19141 raft_consensus.cc:606] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.517094 19141 raft_consensus.cc:614] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:12.494331 19215 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:12.495645 19214 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:12.499696 19142 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:12.500416 19218 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:12.501329 19065 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:12.428723 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:12.501986 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.502532 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.510226 19069 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:12.522079 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 81904.6us
I20260709 13:20:12.523064 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.511088 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:12.524552 19064 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:12.515015 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.437088 23768 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.526552 19213 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:12.526597 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:12.528231 19064 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:12.529943 23825 raft_consensus.cc:697] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:12.534197 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.537370 23772 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.537818 23862 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:12.551031 23862 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:12.476816 23860 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:12.538985 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 110359us
I20260709 13:20:12.553146 19142 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:12.555011 19067 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:12.543399 19063 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:12.545285 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:12.517547 23864 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:20:12.549856 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:12.507637 23814 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:12.549707 23782 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.548642 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:12.438294 23691 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.525660 23844 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.584206 19071 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:12.582979 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.585258 19069 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 17: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:12.586637 19220 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:12.558424 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.581197 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.587571 19068 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:12.587783 19063 raft_consensus.cc:1240] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:12.588119 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.586136 19064 raft_consensus.cc:2410] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:12.558423 23797 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.542985 23689 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.546620 23624 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.557821 23765 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.591172 19714 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.560195 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.605355 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:12.569293 23583 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.569115 23769 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.488858 18965 rpcz_store.cc:269] 0709 13:19:56.155849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.156062 (+   213us) service_pool.cc:224] Handling call
0709 13:20:12.436289 (+16280227us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:10.859180 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:10.863893 (+  4713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:10.863942 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:20:10.863960 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:10.865080 (+  1120us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:10.865189 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:10.865217 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:20:10.866286 (+  1069us) tablet.cc:701] Row locks acquired
0709 13:20:10.866337 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:20:10.866495 (+   158us) write_op.cc:270] Start()
0709 13:20:10.866652 (+   157us) write_op.cc:276] Timestamp: P: 1783603210866434 usec, L: 0
0709 13:20:10.866689 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:20:10.867471 (+   782us) log.cc:844] Serialized 4392 byte log entry
0709 13:20:11.733906 (+866435us) op_driver.cc:464] REPLICATION: finished
0709 13:20:11.979183 (+245277us) write_op.cc:301] APPLY: starting
0709 13:20:11.979295 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:12.275355 (+296060us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:12.275491 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:12.323965 (+ 48474us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:12.324264 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:20:12.324320 (+    56us) write_op.cc:312] APPLY: finished
0709 13:20:12.324761 (+   441us) log.cc:844] Serialized 105 byte log entry
0709 13:20:12.327418 (+  2657us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:12.327569 (+   151us) write_op.cc:454] Released schema lock
0709 13:20:12.327641 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:12.332279 (+  4638us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:12.333502 (+  1223us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":107711,"reported_tablets":25,"spinlock_wait_cycles":519552,"child_traces":[["op",{"apply.queue_time_us":245000,"apply.run_cpu_time_us":20533,"apply.run_wall_time_us":352606,"cfile_cache_hit":42,"cfile_cache_hit_bytes":43848,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":2,"lbm_read_time_us":73882,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":11,"prepare.queue_time_us":323226,"prepare.run_cpu_time_us":214933,"prepare.run_wall_time_us":401431,"raft.queue_time_us":95754,"raft.run_cpu_time_us":32527,"raft.run_wall_time_us":123602,"replication_time_us":867060,"spinlock_wait_cycles":14080,"thread_start_us":733644,"threads_started":4,"wal-append.queue_time_us":594930}]]}
I20260709 13:20:12.591809 23790 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.596149 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:12.612234 19220 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.612344 19746 raft_consensus.cc:1275] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:12.604332 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:12.594579 23808 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:12.606308 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46203.2us
I20260709 13:20:12.607041 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.623603 19113 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.603931 23700 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:12.609370 23772 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:12.614822 19215 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:12.573597 19219 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:12.614740 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:12.595484 23624 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.626214 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:12.627617 19213 raft_consensus.cc:2410] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:12.631914 19113 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.603363 23765 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:12.557881 23825 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.640237 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:12.628727 23700 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.655543 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:12.635196 23624 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.601861 23797 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.626919 23808 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:12.634893 23790 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:12.630373 23583 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:12.630200 23747 raft_consensus.cc:2764] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:12.626694 23844 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:12.604832 23870 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:12.653268 23700 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.642406 23765 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.668005 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:12.611930 23769 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.669000 19220 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
W20260709 13:20:12.672535 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.640235 23768 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.645921 23749 raft_consensus.cc:2764] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:20:12.717473 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.668705 23808 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.721760 19064 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:12.675006 23645 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:12.635726 23871 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:20:12.645577 23689 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:20:12.742995 19743 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:12.682314 23844 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.732986 19069 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:20:12.639814 23861 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:20:12.743680 23847 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:12.681420 23790 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:20:12.751760 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 111584us
I20260709 13:20:12.755694 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:12.656896 23814 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.762966 19113 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:12.764467 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.765551 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:12.766331 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.748344 23844 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.768080 19113 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.778563 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.782338 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:12.785270 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.786352 23805 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:20:12.786715 23858 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:12.787222 23858 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:12.787706 23760 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:12.788045 23858 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.789043 23843 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.789763 23749 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:12.790174 23749 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.790519 23749 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.790639 23689 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.790696 23843 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.791342 23689 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.791581 23843 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.794433 19213 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:12.795778 23805 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:12.796161 23805 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:12.797019 23805 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.798283 23805 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.797314 23843 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.801793 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.802814 23870 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.803311 23870 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:12.804293 19215 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:12.805399 23870 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:12.806773 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:12.807387 19219 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:12.810542 19218 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:20:12.813377 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.813611 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:12.813907 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.817696 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.818446 19141 raft_consensus.cc:2410] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:12.820425 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.821908 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.824038 19184 leader_election.cc:400] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:12.862367 19184 leader_election.cc:403] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:12.778651 23583 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:12.866004 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 79677.5us
I20260709 13:20:12.780743 23772 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:12.872679 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:12.774857 23768 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:20:12.895720 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.808568 23771 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:12.896158 19217 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 6 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:12.812584 23691 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:12.838492 23816 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:12.866853 23644 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:12.907382 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 87054.6us
I20260709 13:20:12.863595 23782 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:12.910290 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:12.906839 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 105122us
I20260709 13:20:12.895165 23871 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:12.861318 23843 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:20:12.913939 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.904436 23768 consensus_queue.cc:1243] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:12.915278 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:12.924598 19147 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.924993 19147 raft_consensus.cc:614] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:12.915655 23773 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:12.902120 23771 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.824368 23861 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:20:12.900790 23813 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:12.906100 23829 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:20:12.930260 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 145100us
I20260709 13:20:12.933657 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:12.934732 19141 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:20:12.935070 19141 pending_rounds.cc:85] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 7
I20260709 13:20:12.935278 19141 pending_rounds.cc:107] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:20:12.935500 19141 raft_consensus.cc:2889] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:12.939226 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:12.940563 19143 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:12.944147 19138 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:12.945003 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.945807 19143 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:12.947038 19140 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:12.950814 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.950938 19143 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:12.951172 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:12.951468 19138 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 8.
W20260709 13:20:12.954710 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 141164us
W20260709 13:20:12.956693 19184 connection.cc:256] RPC call timeout handler was delayed by -1.3042443260001164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:20:12.957367 19184 connection.cc:256] RPC call timeout handler was delayed by -1.2637443260000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:20:12.957728 19184 connection.cc:256] RPC call timeout handler was delayed by -1.2241443259999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:20:12.958194 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1944443259999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:20:12.958523 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1548443260001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:20:12.958868 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1260443260000557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:20:12.959203 19184 connection.cc:256] RPC call timeout handler was delayed by -1.0729443259999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 13:20:12.959854 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:12.963143 23813 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:12.898280 23760 consensus_queue.cc:1059] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:20:12.967329 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.876101 23790 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:12.930169 23771 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.954051 23768 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:12.970216 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.953616 23689 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.953755 23797 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:12.961814 23773 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:12.928193 23767 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:12.970549 23769 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:12.969882 23893 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.976604 23768 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.980783 23760 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:12.989009 23879 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:20:12.983750 23782 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:12.998299 23877 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:20:13.016752 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 106538us
I20260709 13:20:13.016662 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:13.013120 23880 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:20:13.002681 23768 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:13.023636 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 136297us
I20260709 13:20:13.029481 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:13.010504 23895 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.027606 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.018077 23861 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:13.017190 23772 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:13.036924 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:13.040460 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.023193 23816 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:13.036330 23843 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.044215 23782 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.049794 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:12.997691 23813 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.055430 23871 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.060722 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:13.046487 23884 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:20:13.063109 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.067734 19213 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:13.068107 19213 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:13.068817 19213 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.069903 19213 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.071530 23749 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.064132 23782 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.073498 23841 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:20:13.075350 23886 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.291s	user 0.007s	sys 0.002s
I20260709 13:20:13.064956 23898 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:13.077085 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.077841 19214 raft_consensus.cc:2410] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:20:13.065287 23797 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:13.078756 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.078856 23861 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:13.077742 19142 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:13.080327 19215 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:13.077419 23898 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.082402 23898 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:13.080143 19214 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:20:13.066648 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 98359.6us
I20260709 13:20:13.047061 23825 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:13.093060 23883 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:20:13.039745 23895 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.079862 23861 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.080121 23645 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:13.098937 19067 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:13.098011 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:13.095765 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.104131 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:13.131377 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.131374 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.120504 19213 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
W20260709 13:20:13.126451 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.059590 23843 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:20:13.139674 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:13.129194 19068 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:13.129302 19072 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:20:13.130424 19065 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:13.141788 19142 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:13.142145 23906 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:13.143481 19142 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:13.143550 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.144892 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.145392 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.145972 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.146104 19066 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.147483 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.058746 23583 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:13.134383 19213 pending_rounds.cc:85] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:13.156431 19213 pending_rounds.cc:107] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:13.156770 19213 raft_consensus.cc:2889] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:13.159487 23835 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:13.138079 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.138279 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.161264 19063 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:13.160815 23835 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:13.162674 19063 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 7. Current term is 8. Ops: []
W20260709 13:20:13.093604 23882 log.cc:927] Time spent T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:20:13.161192 23785 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:13.163791 23785 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:13.139515 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 76475.2us
I20260709 13:20:13.100373 23808 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.164794 23785 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.165987 23808 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.166141 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:13.166337 23785 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.166606 23808 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:13.167234 23898 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.167629 23898 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.167956 23898 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.149595 23772 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.107677 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.058108 23773 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.092679 23700 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.153380 19142 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:13.192608 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.133669 23645 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.194824 19070 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:13.195520 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:13.130110 23749 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:13.137898 23897 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.182560 23895 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.201902 23771 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.202086 23765 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:13.181761 23860 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.001s
W20260709 13:20:13.208102 23909 log.cc:927] Time spent T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:13.208995 23816 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.151451 23841 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.212214 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.213418 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:13.215204 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:13.215926 19147 raft_consensus.cc:2410] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:13.216112 19141 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:13.221903 19138 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:13.223791 19068 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:13.227535 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.235592 19068 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:13.180799 23768 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.250861 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.251976 23749 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.254611 23771 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.255064 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.255918 23691 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.257377 23691 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:13.258553 23583 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.259614 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.260110 23891 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.260731 19140 raft_consensus.cc:2393] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:13.260815 23891 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:13.261376 23891 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.261915 23765 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.262639 23691 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.264019 23768 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.264048 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.268054 23691 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.269250 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.270089 23691 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:13.270311 23903 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:13.272063 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.272817 23691 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.274199 23700 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.274471 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.277004 23691 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.278313 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:20:13.279664 23624 consensus_meta.cc:287] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.002s
I20260709 13:20:13.286896 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:13.287644 19066 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
W20260709 13:20:13.292392 23844 consensus_meta.cc:287] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.005s
I20260709 13:20:13.292894 23844 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.294945 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:13.295708 19143 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:13.297042 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.297492 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:13.298022 19066 raft_consensus.cc:606] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Received request to transfer leadership
I20260709 13:20:13.236974 23790 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.302562 23747 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:13.303694 23889 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:13.294163 23691 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:13.304044 23744 raft_consensus.cc:3055] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:13.305094 23744 raft_consensus.cc:740] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:13.305974 23744 consensus_queue.cc:260] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.307072 23895 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:13.307606 23895 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.309625 23895 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.315135 22878 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:13.315631 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:13.319285 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.322249 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:13.322942 19216 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.342126 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:13.343420 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.391095 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.390482 19218 raft_consensus.cc:2368] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:20:13.391872 19219 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:13.392433 19216 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:13.395768 19143 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:13.396719 19145 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:13.398875 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:13.297238 23624 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.397708 19714 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:13.401758 19143 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.390923 23785 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.399194 23807 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.327065 23889 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:20:13.409773 19219 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:20:13.417155 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.422533 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:13.423251 19066 raft_consensus.cc:606] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Received request to transfer leadership
W20260709 13:20:13.422184 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.424214 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.393149 23768 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.405664 23700 raft_consensus.cc:2804] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:13.377236 23891 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.427479 23891 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:13.428457 23773 consensus_queue.cc:1048] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:13.429395 23645 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.429864 23768 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.431819 23768 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.432256 23829 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:13.433346 23645 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:13.434028 23624 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.434095 23645 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:13.433367 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.435717 19212 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:13.437559 23744 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.462824 19744 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:13.462894 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.463518 19063 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.440004 19212 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15. Ops: [10.6-14.8]
I20260709 13:20:13.440267 19143 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:13.442533 23887 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:13.446580 23844 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:13.451287 19070 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:20:13.405174 19113 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.411098 23807 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.454774 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.470172 19066 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.468797 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.470898 19070 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.458333 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:13.409409 23785 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.479414 23901 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:13.479846 23813 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:13.480165 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:13.465969 23700 raft_consensus.cc:697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:13.467023 23891 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:20:13.480677 19143 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.550442 19744 raft_consensus.cc:1275] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:13.460340 23855 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.482790 23785 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:13.479874 23901 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.472947 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:13.583382 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.584134 19213 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:13.585616 19213 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:13.485399 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:13.588371 19212 raft_consensus.cc:3060] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.487183 19066 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:13.590698 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:13.591094 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:13.591478 19717 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:13.468923 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 64196.9us
I20260709 13:20:13.472460 23624 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:13.504143 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.592666 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.593003 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:13.480697 23813 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:13.595142 18954 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 134010us
I20260709 13:20:13.552057 19070 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:13.592636 19113 leader_election.cc:400] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:20:13.465859 23887 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:13.598882 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:13.599162 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 207661us
I20260709 13:20:13.467875 23747 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:13.570878 19744 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:13.577219 23872 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.144s	user 0.006s	sys 0.000s
I20260709 13:20:13.597467 19113 leader_election.cc:403] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:13.598661 19747 raft_consensus.cc:2368] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:20:13.570001 23749 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.600230 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.494323 23805 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:20:13.618265 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.600315 19213 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:13.595777 23624 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.613667 19113 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.595579 23870 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.627591 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.600800 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.628868 19066 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.598863 23768 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:13.582475 23855 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.618343 23785 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.618110 23772 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:20:13.642699 19212 raft_consensus.cc:2468] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:13.588382 23901 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.595626 23813 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:13.642130 19143 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:13.629896 23923 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:13.634727 23900 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:13.641652 23785 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.611601 23773 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:13.660892 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2102) took 1542 ms. Trace:
I20260709 13:20:13.644029 23768 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:13.612670 23753 consensus_queue.cc:1048] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:20:13.647127 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.684521 19143 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:13.703100 19066 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:13.627661 23624 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.646615 19063 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:13.627485 23749 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.661187 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:13.706962 19212 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.708093 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.693548 23785 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.690754 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.659852 23747 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.715266 19212 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:13.693434 23900 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:13.699527 19139 rpcz_store.cc:276] 0709 13:20:12.118538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.118676 (+   138us) service_pool.cc:224] Handling call
0709 13:20:12.119036 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.147173 (+ 28137us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:12.147207 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.154348 (+  7141us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.355215 (+200867us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:12.355270 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.355356 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.473148 (+1117792us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:13.660468 (+187320us) raft_consensus.cc:1685] finished
0709 13:20:13.660499 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.660781 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25342,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":16901,"spinlock_wait_cycles":6859648,"thread_start_us":181072,"threads_started":1,"wal-append.queue_time_us":268521}
I20260709 13:20:13.642409 23744 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.666019 23906 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.684440 23898 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.516s	user 0.014s	sys 0.005s
W20260709 13:20:13.702227 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 74702.3us
I20260709 13:20:13.659250 23790 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.669831 23926 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:20:13.639060 23870 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.704083 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.704753 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:13.725126 19066 raft_consensus.cc:2368] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:20:13.725558 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:13.725850 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.666347 23887 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.727667 23887 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.730479 23870 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:13.731410 23870 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:13.663290 23807 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.692087 23923 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:13.711275 23813 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.732903 23923 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.714075 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.734100 19216 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:13.723695 23906 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:13.697191 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 105810us
I20260709 13:20:13.722870 23898 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.738587 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 565) took 1146 ms. Trace:
I20260709 13:20:13.714888 19068 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:13.739288 23898 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.738963 19064 rpcz_store.cc:276] 0709 13:20:12.591936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.592506 (+   570us) service_pool.cc:224] Handling call
0709 13:20:12.593829 (+  1323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.740021 (+146192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.738339 (+998318us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b540024b654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:13.738516 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199590656}
I20260709 13:20:13.740042 19068 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: [11.7-14.8]
I20260709 13:20:13.741153 19071 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:13.734027 23813 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.725880 23768 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.736613 23906 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.745560 23855 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.748569 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.695279 23925 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:13.750716 19110 leader_election.cc:400] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12.
I20260709 13:20:13.716459 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.706804 23749 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.707387 23773 consensus_queue.cc:1243] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:13.718325 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:13.726214 19139 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:13.732021 23870 consensus_queue.cc:1243] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:13.753396 19212 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:13.768321 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:13.769068 19219 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:20:13.769490 19212 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:13.769874 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:13.770067 19717 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.749250 19216 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:13.643035 23700 consensus_queue.cc:237] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.752138 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:13.767927 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:13.774036 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 55828.1us
I20260709 13:20:13.774063 19139 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:13.774614 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.770382 19219 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:13.776940 23920 log.cc:927] Time spent T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.328s	user 0.000s	sys 0.003s
I20260709 13:20:13.779556 23855 raft_consensus.cc:993] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:13.780021 23841 raft_consensus.cc:1081] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:13.771697 19216 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:20:13.782591 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.771901 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 51272us
I20260709 13:20:13.755913 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:13.754082 23925 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:13.770589 19212 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:13.754231 23816 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:13.790366 19066 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:13.788698 22878 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.791501 22878 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.792351 19219 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:13.792682 19750 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:13.784401 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.757567 23749 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.754307 23753 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:13.794500 19717 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:13.758519 23906 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:20:13.799319 22878 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:13.801225 22878 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:13.802807 19066 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:13.804088 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.808669 23923 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:13.810844 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:13.813030 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:13.797922 23790 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.793674 23814 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:13.819823 19139 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:20:13.794123 23768 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.815338 19142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:13.816026 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.786335 23925 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:13.798118 23644 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.802546 23807 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.804222 19138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:20:13.824769 19746 raft_consensus.cc:1275] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:13.826190 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:13.802453 23816 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:13.830197 19138 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.831671 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:13.832257 19064 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:13.832162 19138 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.817085 23934 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:13.817842 23790 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.835040 19184 leader_election.cc:400] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:20:13.820595 23935 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.838122 19184 leader_election.cc:403] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:20:13.821139 23923 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:13.840138 19139 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:13.825412 23768 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.826634 23767 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.798275 23900 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.827859 23814 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:13.829380 23807 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.844798 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:13.852644 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.839911 23790 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.837801 23926 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.882089 23926 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:13.882853 23926 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:13.875705 23829 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:20:13.885244 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.887648 19138 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.842720 23934 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:13.845185 23768 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.831457 23644 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.927171 23644 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.889621 23744 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:20:13.928465 23768 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.929150 23923 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.929955 19064 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:13.842422 23855 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:20:13.843617 23938 consensus_queue.cc:1059] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:20:13.849113 23935 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 9. Current term is 10.
I20260709 13:20:13.903363 19071 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:13.911425 23782 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:13.912850 23922 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.482s	user 0.002s	sys 0.000s
W20260709 13:20:13.913952 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.873879 23767 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.916417 19138 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:13.917608 19066 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:20:13.918612 23939 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:20:13.919283 23936 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:13.922765 23862 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.924207 19063 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:20:13.924456 23942 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:20:13.872957 23772 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.874910 23807 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.874953 23841 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.945214 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 79159.8us
I20260709 13:20:13.971336 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:13.971956 19071 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:13.972295 19071 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:13.958624 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:13.968235 23900 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:13.943328 23644 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.943153 23813 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.941468 23782 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:13.941679 23768 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:13.973834 19750 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.950955 23753 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.971168 23772 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.958173 23773 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:20:14.005551 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2231) took 1235 ms. Trace:
I20260709 13:20:13.983399 19071 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:13.946337 23816 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.010826 19071 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:13.984359 23946 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:20:13.954742 23769 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:20:14.005661 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.016654 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 142173us
I20260709 13:20:13.970846 23925 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.976878 23841 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.979700 23943 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:20:13.980314 23813 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:13.984792 23753 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.023746 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:14.017405 19069 rpcz_store.cc:276] 0709 13:20:12.770577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.770727 (+   150us) service_pool.cc:224] Handling call
0709 13:20:12.783680 (+ 12953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.783887 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.783918 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.183472 (+399554us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b2c00028df8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:20:13.183907 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.393827 (+209920us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:13.396605 (+  2778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.396678 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.912164 (+515486us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:13.991527 (+ 79363us) raft_consensus.cc:1685] finished
0709 13:20:13.991552 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.005452 (+ 13900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64145024,"thread_start_us":209540,"threads_started":1,"wal-append.queue_time_us":246705}
I20260709 13:20:14.010579 23862 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.981899 23644 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.027410 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:13.981906 23814 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.010226 23910 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:14.032815 19071 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:14.034446 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:14.035038 19069 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.010071 23624 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.036672 19212 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:14.037010 19212 pending_rounds.cc:85] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:14.037216 19212 pending_rounds.cc:107] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:14.037443 19212 raft_consensus.cc:2889] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.015643 23583 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:20:14.039295 19219 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:14.040424 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:14.041054 19216 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.042418 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:14.042837 23950 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:14.042989 19218 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.026563 23785 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.029210 23923 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.991534 23934 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.065320 19142 raft_consensus.cc:606] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:14.068320 19218 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:14.071029 19142 raft_consensus.cc:614] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:14.070065 19216 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:14.038656 23938 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.017905 23782 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.078466 23899 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.063927 23771 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:14.079056 23899 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.027289 23887 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:14.079053 23782 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.081847 23813 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.083348 23644 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.088094 23901 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.076257 23841 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:14.077942 23957 log.cc:927] Time spent T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:20:14.078171 23953 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:20:14.089337 23785 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:14.089874 23624 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.090229 23772 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:14.078367 23878 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.327s	user 0.000s	sys 0.005s
I20260709 13:20:14.055840 23749 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.064148 23891 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:14.055984 23768 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:20:14.125447 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 140575us
I20260709 13:20:14.119903 19143 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:20:14.123373 19069 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:14.115557 23887 consensus_queue.cc:1243] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:14.072247 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:14.076809 23860 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:20:14.126624 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:14.129904 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:14.130741 19745 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:14.076252 23958 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:20:14.121340 23767 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:14.137948 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65803.6us
I20260709 13:20:14.140941 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:14.137043 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:14.141696 23771 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:14.126055 23744 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.150841 19146 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:14.152247 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.126055 23898 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:14.160571 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:14.131170 23899 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.161406 19745 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:14.162515 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.163317 19146 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:14.160599 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.165326 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:14.132814 23700 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:14.165436 19139 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:14.143177 23769 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.168431 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:14.168560 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:14.173465 19218 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:14.174605 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:14.175907 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:14.149397 23785 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:14.129415 23891 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.187896 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 677) took 2098 ms. Trace:
I20260709 13:20:14.187963 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:14.188514 19221 rpcz_store.cc:276] 0709 13:20:12.089733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.089839 (+   106us) service_pool.cc:224] Handling call
0709 13:20:12.113350 (+ 23511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.197656 (+ 84306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.197688 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.205407 (+  7719us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.598804 (+393397us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:12.598860 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.598951 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.984430 (+1385479us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:14.171337 (+186907us) raft_consensus.cc:1685] finished
0709 13:20:14.171356 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.187837 (+ 16481us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35906,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":203,"spinlock_wait_cycles":18004736,"thread_start_us":286023,"threads_started":2,"wal-append.queue_time_us":385787}
I20260709 13:20:14.191628 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.219398 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.160341 23805 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:14.220391 19035 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:14.164952 23771 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:14.221407 19139 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:14.220505 19750 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:14.226174 19742 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:14.153419 23949 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:20:14.188241 23785 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.161818 23744 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.166043 23898 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.221046 23943 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:14.179565 23700 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.188531 23769 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.237401 23925 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:14.188798 23790 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.242129 23785 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.240597 23816 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.259927 19147 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
W20260709 13:20:14.255128 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.257054 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:14.245769 23943 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.230052 23805 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:14.306586 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.254928 23644 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.323750 23769 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.328012 19069 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:14.399139 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:14.324268 23744 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.329175 23749 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:14.402181 19144 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:14.261437 23816 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.338160 23790 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.261482 23771 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.321877 23901 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.396802 23644 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.423202 23644 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.363126 19072 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.427659 23700 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:14.429193 23919 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.996s	user 0.003s	sys 0.001s
I20260709 13:20:14.432646 23805 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:14.394222 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.438539 23956 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.439092 23956 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.420760 23749 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:14.440713 23749 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.441263 23624 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:14.441663 23624 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:14.442723 23749 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:14.442396 23624 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.398793 23807 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.443555 23624 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.444922 23807 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.394877 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2365) took 1445 ms. Trace:
I20260709 13:20:14.395195 19145 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:14.354473 23966 log.cc:927] Time spent T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:20:14.395742 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:14.396046 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:14.329358 23964 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:14.450738 19217 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:14.402036 23970 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.394304 23943 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.451459 19140 rpcz_store.cc:276] 0709 13:20:12.949768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.950950 (+  1182us) service_pool.cc:224] Handling call
0709 13:20:14.394625 (+1443675us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54002b93d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:14.394814 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710092032}
W20260709 13:20:14.414599 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.455304 19072 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:14.268455 19749 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:14.422431 23816 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.404081 23895 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.451509 23970 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.406836 23870 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:20:14.446274 19743 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:14.409650 23968 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:14.459946 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:14.461683 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:14.464406 19221 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:14.473399 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.475589 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:14.482795 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:14.483546 19213 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.485723 23970 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:14.487011 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 296552us
I20260709 13:20:14.487082 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:14.489708 19216 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:14.494336 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:14.495175 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:14.498167 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:14.481046 23807 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.463822 23901 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:14.510650 19145 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:14.508054 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:14.525189 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:14.525970 19216 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.493405 23891 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:14.531800 19213 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:20:14.502591 23870 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.500463 23949 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:14.561918 19717 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:14.563784 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:14.480909 23895 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.565384 19213 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:14.560153 19035 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:14.510279 23956 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:14.562747 23978 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:14.499929 23825 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:20:14.535761 23767 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.568552 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:14.559069 23946 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:14.577665 19216 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:14.612672 19216 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:14.562002 23829 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.614912 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:14.614130 19216 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:14.506431 23970 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:20:14.566805 23744 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:14.524534 23889 consensus_queue.cc:1048] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:20:14.561859 23972 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.567168 23923 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.566452 23891 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:20:14.530963 23807 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.561143 23901 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.610426 23767 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.609814 23814 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.617188 23843 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:14.673990 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2358) took 1736 ms. Trace:
I20260709 13:20:14.674438 19141 rpcz_store.cc:276] 0709 13:20:12.937443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.937576 (+   133us) service_pool.cc:224] Handling call
0709 13:20:12.937835 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.225265 (+287430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.673760 (+1448495us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54000ff5d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:14.673936 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639646592}
I20260709 13:20:14.624020 23829 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.645068 23955 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.625049 23906 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:14.652132 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:14.653232 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:14.650519 23645 raft_consensus.cc:3055] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:14.611440 23978 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.628702 23972 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.630249 23744 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:14.631578 23871 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:14.678709 23843 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.626430 23700 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:20:14.626724 23862 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:20:14.700588 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:14.700994 19743 raft_consensus.cc:1275] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:14.676043 23767 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.699373 19070 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:14.707265 19751 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:14.708384 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:14.678476 23955 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:14.717116 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.735266 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:14.688580 23971 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:14.736603 19067 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:14.632838 23923 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:14.741741 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 118425us
I20260709 13:20:14.745884 19221 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:14.684770 23979 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.685204 23645 raft_consensus.cc:740] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:14.699080 23972 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.753522 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:14.681484 23814 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.750612 23829 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.757030 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:14.771773 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2284) took 1660 ms. Trace:
I20260709 13:20:14.718631 23843 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.764528 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:14.777509 19069 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.741878 23955 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.767189 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:14.772127 19215 rpcz_store.cc:276] 0709 13:20:13.104005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.104265 (+   260us) service_pool.cc:224] Handling call
0709 13:20:13.104642 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.132509 (+ 27867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.132549 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.136639 (+  4090us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.436486 (+1299847us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b18004378c0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:20:14.631424 (+194938us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:14.631459 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.631534 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.754338 (+122804us) raft_consensus.cc:1685] finished
0709 13:20:14.754363 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.764203 (+  9840us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28813,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":13956,"spinlock_wait_cycles":8565504,"thread_start_us":194770,"threads_started":1,"wal-append.queue_time_us":1602972}
I20260709 13:20:14.782562 19067 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:14.713357 23871 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.803700 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:14.798060 23691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.493s	user 0.005s	sys 0.005s
I20260709 13:20:14.781538 23855 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.776732 23970 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:14.833200 23970 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.834558 23978 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.762234 23979 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.835641 23970 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.836721 23979 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:14.823426 19069 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
W20260709 13:20:14.824331 23691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.006s	sys 0.005s
I20260709 13:20:14.848846 19069 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:14.852097 19069 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:14.852108 19141 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:14.868995 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.853801 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.860939 19139 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:14.827540 23855 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.874840 19141 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:14.875327 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:14.877298 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:14.878011 19143 raft_consensus.cc:2393] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:14.878644 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.799746 23744 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.847246 23691 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:14.877117 23906 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:20:14.888449 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 200530us
I20260709 13:20:14.877148 23855 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:14.889756 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 208047us
I20260709 13:20:14.893124 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:14.879853 23807 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:14.893157 23901 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:14.913343 23989 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:14.931434 19215 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:20:14.933357 19143 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:20:14.934127 19747 raft_consensus.cc:1240] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:14.934530 19110 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:14.936810 19717 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:14.892735 23921 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.327s	user 0.000s	sys 0.004s
I20260709 13:20:14.943579 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:14.944785 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.845468 23645 consensus_queue.cc:260] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.950114 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:14.931972 23829 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.941120 23813 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:14.942539 23862 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:15.014554 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.985620 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2118) took 1849 ms. Trace:
I20260709 13:20:14.977444 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:14.973632 19147 raft_consensus.cc:1275] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:14.943197 23949 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.971530 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.941520 23992 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.979663 23980 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:20:15.024106 19140 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.942659 23925 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:14.889252 23943 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.029758 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.023777 19214 rpcz_store.cc:276] 0709 13:20:13.136591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.137445 (+   854us) service_pool.cc:224] Handling call
0709 13:20:13.137752 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.151786 (+ 14034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.151817 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.186183 (+ 34366us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.393514 (+207331us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:13.393554 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.393628 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.663245 (+1269617us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:14.985310 (+322065us) raft_consensus.cc:1685] finished
0709 13:20:14.985337 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.985560 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13677,"raft.queue_time_us":14188,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":48757,"spinlock_wait_cycles":75872000,"thread_start_us":170193,"threads_started":1,"wal-append.queue_time_us":220484}
W20260709 13:20:14.946166 23785 consensus_meta.cc:287] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
I20260709 13:20:14.976073 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 540) took 1931 ms. Trace:
I20260709 13:20:14.941380 23978 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.973558 23987 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:20:14.981658 23981 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:20:15.043999 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.946400 23935 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:15.024559 23825 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.070581 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.070915 19072 raft_consensus.cc:2393] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:15.048163 23887 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.058719 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:14.985756 23923 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.059291 19144 rpcz_store.cc:276] 0709 13:20:13.044925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.045272 (+   347us) service_pool.cc:224] Handling call
0709 13:20:13.045684 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.403872 (+1358188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.975857 (+571985us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400220454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:14.976012 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3118816512}
I20260709 13:20:15.025537 23813 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:15.082544 23813 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.084041 23813 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.983165 23871 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:14.981091 23979 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:20:14.980965 23906 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:14.954885 23891 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:20:14.952342 23976 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.257s
I20260709 13:20:14.975026 23899 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:20:15.065483 23978 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.042914 23870 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:15.043179 23862 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:14.986598 23897 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:15.025292 23747 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:20:15.029241 23829 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.047995 23949 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.080909 23825 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.066501 24000 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.975451 23767 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:14.953549 23996 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:15.080413 19140 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:15.110101 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.115386 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.117977 19143 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:15.119755 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.142082 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.142701 19144 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:14.989207 23691 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.059286 23925 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:15.102991 23644 consensus_meta.cc:287] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
W20260709 13:20:15.134442 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 464605us
I20260709 13:20:15.063328 23785 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:15.154500 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.109627 23998 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:15.116562 23897 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:15.160528 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.166311 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.048316 23992 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.105795 23887 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.078926 23935 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.157416 23998 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.117415 23870 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.185642 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.187703 23829 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.187668 23975 consensus_queue.cc:1059] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:15.206023 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 80836.1us
I20260709 13:20:15.189064 23767 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.190145 23949 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.155476 23996 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.191192 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:15.191823 24020 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:15.187525 23891 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.155140 24000 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.194020 23978 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.194113 23925 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.194811 23808 consensus_queue.cc:1048] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:15.195891 23785 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.196815 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:15.197214 23972 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.199224 23992 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.200519 23943 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:15.200980 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.161085 23747 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.156785 23644 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.212234 19065 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18. Ops: [14.7-17.8]
W20260709 13:20:15.205103 23624 consensus_meta.cc:287] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.761s	user 0.015s	sys 0.001s
I20260709 13:20:15.226823 19068 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.187851 23825 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.206686 23998 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.225185 23978 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.256362 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51744 (request call id 43) took 1419 ms. Trace:
I20260709 13:20:15.258229 19140 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:15.258406 19142 rpcz_store.cc:276] 0709 13:20:13.814956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.815227 (+   271us) service_pool.cc:224] Handling call
0709 13:20:15.234515 (+1419288us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400327b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103584853 00007f610855260a 00007f6101ad87d4 00007f6101ad8762 00007f6101ad8691 00007f6101ad860c 00007f6101ad78c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:15.234655 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551074688}
I20260709 13:20:15.235703 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.221450 23891 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.262699 23785 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:15.264361 23891 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.255573 23906 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:15.222370 24012 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:15.271323 19065 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:15.281004 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.281721 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:15.282713 19065 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:15.284505 19035 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:15.269832 23825 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.280354 23961 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:20:15.287955 23992 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:15.308431 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:15.313174 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.289265 23898 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.295264 23925 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.295701 23979 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:15.297596 23923 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:15.298031 23871 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:15.297636 23935 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.311096 23753 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.300151 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:15.305936 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.306463 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.285717 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.351869 19065 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
W20260709 13:20:15.288772 24015 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:20:15.308946 23992 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.317968 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:15.318810 19751 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:15.255364 23747 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.280910 23944 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.330984 19214 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:15.331991 19141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c875508da24d49ae8496600c3e674b63"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:15.361209 19141 raft_consensus.cc:606] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:15.334373 19143 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:20:15.232770 23862 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.280526 23906 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:15.223067 23897 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.298542 23996 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.346865 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:15.375667 19213 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 10.
I20260709 13:20:15.270920 23978 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.330701 23972 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.353123 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.384518 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.385869 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.386413 19065 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
W20260709 13:20:15.354597 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 54539.9us
I20260709 13:20:15.335311 24021 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:20:15.357790 23644 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.365492 23992 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.358531 23935 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.400038 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2302) took 1259 ms. Trace:
I20260709 13:20:15.359383 19747 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:15.370680 19068 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
W20260709 13:20:15.375110 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.378898 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:15.404227 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.380010 19221 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:15.380187 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:15.405375 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:15.319247 23825 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:15.394068 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 75026us
I20260709 13:20:15.335381 23925 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.347276 23979 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.369138 23944 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.415498 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:15.416313 19213 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:15.403152 19212 rpcz_store.cc:276] 0709 13:20:14.140572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.140697 (+   125us) service_pool.cc:224] Handling call
0709 13:20:15.399807 (+1259110us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540034c954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:15.399970 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542880000}
I20260709 13:20:15.404397 19064 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:15.419765 23935 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:15.380617 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:15.422972 19220 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:15.405375 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.425534 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.426230 19068 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:15.426878 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.354573 23923 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:15.427872 23843 consensus_meta.cc:287] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.002s
I20260709 13:20:15.428344 19072 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:20:15.410926 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:15.429803 19072 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:15.429767 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:15.430981 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:15.433154 19069 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:15.433703 23910 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.433892 23899 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.434566 23910 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:15.407298 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:15.426625 23855 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.468055 23870 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.468626 23949 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:15.469182 23949 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.469841 23855 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.428308 23843 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.471278 23949 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.355921 23871 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.472605 23843 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.473976 23871 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.475601 19067 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:15.466725 19064 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:15.432510 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:15.375417 23906 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.476228 19221 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
W20260709 13:20:15.463333 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 52883.1us
I20260709 13:20:15.463276 19068 raft_consensus.cc:2368] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:15.474067 19065 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:15.485818 19216 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:15.476394 19063 raft_consensus.cc:2393] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:15.487373 19065 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:15.490206 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:15.490837 19747 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:15.496968 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:15.497550 19068 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:15.495831 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 193671us
I20260709 13:20:15.498067 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:15.500023 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 67577.6us
I20260709 13:20:15.494727 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.501689 19143 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:15.506690 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:15.507272 19747 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:15.511516 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:15.512300 19143 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.507237 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:15.514287 19064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:15.515271 19064 raft_consensus.cc:606] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Received request to transfer leadership
I20260709 13:20:15.514643 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:15.516400 19064 raft_consensus.cc:614] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:15.517737 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:15.521522 19714 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:15.518827 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.519716 19065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:15.522578 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.522696 19065 raft_consensus.cc:606] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:15.524356 19065 raft_consensus.cc:614] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:15.525843 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:15.527614 19213 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:15.528007 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:15.477108 23753 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:15.529376 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:15.529398 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:15.526873 23807 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:15.531972 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:15.538599 19141 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.489622 23870 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.537065 19747 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.541592 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:15.542295 23898 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.542464 23976 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:15.542750 23898 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:15.543146 23898 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.397205 24027 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.133s
I20260709 13:20:15.510782 23910 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:15.548610 19143 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:15.517477 23855 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:15.562280 23749 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:15.545436 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:15.557001 23887 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.565210 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:15.537956 23700 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:15.538116 23791 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:15.572315 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2143) took 1063 ms. Trace:
I20260709 13:20:15.586932 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:15.574409 19110 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:15.537467 24000 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.573661 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:15.568643 23855 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.594610 23976 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:15.588619 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:15.591614 19141 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:15.575484 23749 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:15.565323 23808 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:20:15.585026 23943 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:15.545852 23870 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.616078 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:15.610335 19145 rpcz_store.cc:276] 0709 13:20:14.509056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.533798 (+ 24742us) service_pool.cc:224] Handling call
0709 13:20:14.534028 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.534280 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:14.570189 (+ 35909us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.562085 (+991896us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b180049f660. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287
0709 13:20:15.562436 (+   351us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.571923 (+  9487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.571973 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:15.572015 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.572141 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.572260 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5774,"prepare.queue_time_us":74695,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2717,"raft.queue_time_us":128559,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":15515,"spinlock_wait_cycles":54934400,"thread_start_us":373774,"threads_started":2,"wal-append.queue_time_us":277254}
I20260709 13:20:15.541216 23753 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.607743 23805 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.617395 23899 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:15.588405 23910 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:15.541031 23894 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:20:15.544970 23807 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.623215 19213 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.628007 19143 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:15.628969 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44709.1us
I20260709 13:20:15.613585 23791 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:15.624395 23747 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.626924 23855 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.642815 19035 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:15.633246 23949 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:15.721859 19138 raft_consensus.cc:2410] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:20:15.723628 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 107675us
W20260709 13:20:15.727711 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 84953.2us
I20260709 13:20:15.729861 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:15.710796 23791 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.722167 23624 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:15.755035 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.721697 23899 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:15.748023 19747 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:15.748159 23749 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.640472 23805 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.724639 23887 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.816862 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 297118us
I20260709 13:20:15.731985 24018 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:15.766306 24038 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:20:15.772267 23855 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.630501 23976 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:15.724596 23949 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.636453 23943 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:15.746637 23813 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.001s
I20260709 13:20:15.799919 19143 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
W20260709 13:20:15.765558 24043 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:20:15.735368 23925 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.733011 23944 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.843323 23749 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:15.862772 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 127468us
W20260709 13:20:15.852020 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 122212us
I20260709 13:20:16.015269 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 646) took 1501 ms. Trace:
I20260709 13:20:15.967321 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:15.904646 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.968500 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:15.965134 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2263) took 1219 ms. Trace:
I20260709 13:20:15.805444 19213 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:16.171367 19071 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:16.173213 24018 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:15.955013 24039 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.220s	user 0.002s	sys 0.002s
I20260709 13:20:16.176097 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:15.875018 24041 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:20:15.952376 19018 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:16.179955 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:16.077932 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:16.049492 24050 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:16.047559 23862 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:15.859345 23955 consensus_meta.cc:287] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.052s	user 0.001s	sys 0.012s
I20260709 13:20:15.792691 23979 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:16.181741 19067 rpcz_store.cc:276] 0709 13:20:14.745894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.783372 (+ 37478us) service_pool.cc:224] Handling call
0709 13:20:15.964844 (+1181472us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540025e254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:15.965031 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543233280}
W20260709 13:20:15.918058 24047 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:20:15.966605 24032 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.481s	user 0.001s	sys 0.000s
W20260709 13:20:15.941561 24051 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:20:16.185225 19212 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:20:16.185662 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 217245us
I20260709 13:20:16.261487 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:16.184645 19038 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:15.895881 23998 consensus_meta.cc:287] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.000s
W20260709 13:20:15.869299 24044 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:20:16.265179 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.177402 19743 rpcz_store.cc:276] 0709 13:20:14.507184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.507311 (+   127us) service_pool.cc:224] Handling call
0709 13:20:14.534850 (+ 27539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.739542 (+204692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.008405 (+1268863us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54005b5754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:16.008659 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347091200}
I20260709 13:20:16.187597 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:15.871315 23805 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.956372 23829 raft_consensus.cc:3055] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:16.266206 23829 raft_consensus.cc:740] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:16.283860 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 99296.2us
I20260709 13:20:15.955583 23772 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:16.284930 19038 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:16.285236 23772 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:15.844223 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:16.007252 23645 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:16.191998 19018 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:20:16.085807 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:16.292486 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 206739us
I20260709 13:20:15.879560 23807 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.953724 23895 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:15.844224 23870 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.961881 24055 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:16.295387 23870 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:16.295974 23870 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.295534 24055 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.079831 23938 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:16.031875 23767 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:15.901233 23747 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:15.787741 24035 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:16.194587 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:15.817298 23906 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:15.868673 24049 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:16.260426 23979 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:16.197077 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:16.197962 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.981036 23926 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:15.827327 23910 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.328102 19212 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:16.173203 23949 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.184828 24018 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.209939 19751 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:16.015101 23958 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.192618 23925 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:16.192740 23816 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:15.864248 23898 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.266791 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:16.186936 23813 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:16.287874 23772 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:15.827526 23887 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.304150 19219 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:16.363797 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:16.304791 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:16.291638 19018 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:20:16.196797 19065 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:20:16.365226 19065 pending_rounds.cc:85] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 7
I20260709 13:20:16.365473 19065 pending_rounds.cc:107] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:16.365710 19065 raft_consensus.cc:2889] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.843603 23899 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.341944 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:16.207273 23862 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.208312 24050 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.296413 23870 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.205958 23955 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.349818 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2393) took 1255 ms. Trace:
I20260709 13:20:16.355995 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.359073 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 701) took 1468 ms. Trace:
I20260709 13:20:16.278594 23998 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.340847 23944 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:16.310242 24056 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:16.357268 23816 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.364713 19213 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.345906 24035 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:16.368611 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 107225us
I20260709 13:20:16.369946 19744 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.371196 19070 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:20:16.371129 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 86306.1us
I20260709 13:20:16.353681 23925 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:16.372819 19217 rpcz_store.cc:276] 0709 13:20:14.890959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.891214 (+   255us) service_pool.cc:224] Handling call
0709 13:20:14.911808 (+ 20594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.942398 (+ 30590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.942429 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.942867 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.554582 (+611715us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b1800408460. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:20:15.630477 (+ 75895us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:15.630537 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.630635 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.353963 (+723328us) raft_consensus.cc:1685] finished
0709 13:20:16.353985 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.359011 (+  5026us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6861,"raft.queue_time_us":5692,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4423,"spinlock_wait_cycles":11172608,"thread_start_us":75659,"threads_started":1,"wal-append.queue_time_us":788866}
I20260709 13:20:16.306564 23767 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.385176 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:16.385994 23767 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.390424 23870 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.392477 23898 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:16.383333 23816 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.306262 23938 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.356932 24061 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.402130 19142 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:16.380445 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.404186 19212 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:16.343329 23979 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:16.382661 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.367844 24053 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.408914 24053 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.410967 23887 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.411101 24053 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.309908 23747 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.411628 23887 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:16.357271 23958 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.413332 23747 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.413944 23747 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:16.414613 23747 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:16.415138 23958 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:16.415457 23747 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.348495 23926 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.397457 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:16.360816 24064 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:16.372464 19146 rpcz_store.cc:276] 0709 13:20:15.094682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.094821 (+   139us) service_pool.cc:224] Handling call
0709 13:20:15.095143 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.095524 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.095562 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.101679 (+  6117us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.387488 (+285809us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:15.387536 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.387599 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.965804 (+578205us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:16.343632 (+377828us) raft_consensus.cc:1685] finished
0709 13:20:16.343663 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.349736 (+  6073us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5649,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":13167,"spinlock_wait_cycles":11822976,"thread_start_us":243540,"threads_started":1,"wal-append.queue_time_us":319489}
I20260709 13:20:16.406538 19219 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:16.407408 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2141) took 1018 ms. Trace:
I20260709 13:20:16.413969 19070 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:16.340407 24049 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.417752 19212 rpcz_store.cc:276] 0709 13:20:15.388711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.380253 (+991542us) service_pool.cc:224] Handling call
0709 13:20:16.407349 (+ 27096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.420773 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.421427 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.422049 19212 raft_consensus.cc:2376] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15. Re-sending same reply.
I20260709 13:20:16.422536 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2138) took 1034 ms. Trace:
I20260709 13:20:16.422886 19212 rpcz_store.cc:276] 0709 13:20:15.387859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.421195 (+1033336us) service_pool.cc:224] Handling call
0709 13:20:16.422473 (+  1278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.418759 19213 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:16.424005 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2146) took 1033 ms. Trace:
I20260709 13:20:16.393638 23925 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.366768 23813 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.424517 19213 rpcz_store.cc:276] 0709 13:20:15.390276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.304541 (+914265us) service_pool.cc:224] Handling call
0709 13:20:16.423938 (+119397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.394153 23944 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:16.398865 23938 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:16.461452 24064 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.462189 24055 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.461935 24064 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.462015 23944 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.464123 24064 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.465283 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.466627 19212 raft_consensus.cc:2410] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:16.467628 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.468356 19212 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:16.469439 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:16.470204 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 44168.4us
W20260709 13:20:16.453943 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 68836.2us
I20260709 13:20:16.455196 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2137) took 1069 ms. Trace:
I20260709 13:20:16.473135 19217 rpcz_store.cc:276] 0709 13:20:15.387510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.384175 (+996665us) service_pool.cc:224] Handling call
0709 13:20:16.455118 (+ 70943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.458653 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:16.458885 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:16.476248 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.476902 19213 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:16.477828 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:16.468655 23791 consensus_meta.cc:287] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.002s
I20260709 13:20:16.480588 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:16.427815 23943 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.478484 19213 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:16.485841 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2140) took 1097 ms. Trace:
I20260709 13:20:16.486344 19213 rpcz_store.cc:276] 0709 13:20:15.388433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.477613 (+1089180us) service_pool.cc:224] Handling call
0709 13:20:16.485776 (+  8163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.482359 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:16.473433 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:16.460512 23898 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.487761 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.453981 23855 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.453441 23976 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.494088 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2139) took 1106 ms. Trace:
I20260709 13:20:16.379268 23829 consensus_queue.cc:260] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:16.498555 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 196267us
I20260709 13:20:16.464401 23825 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:16.494498 19217 rpcz_store.cc:276] 0709 13:20:15.388154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.473852 (+1085698us) service_pool.cc:224] Handling call
0709 13:20:16.494034 (+ 20182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.518289 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.519363 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.519883 19217 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:16.522360 23978 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:16.491310 23992 consensus_meta.cc:287] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 1.093s	user 0.013s	sys 0.000s
I20260709 13:20:16.495496 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.497058 19113 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:16.487375 23841 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:16.483654 23791 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.499886 23887 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:16.500360 23938 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:16.500447 23855 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.501510 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:16.502439 23862 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:16.503501 23955 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:16.504581 23998 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:16.504967 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.506003 23975 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:16.509467 24022 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 1.179s	user 0.005s	sys 0.007s
I20260709 13:20:16.490463 24035 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.483902 24064 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:16.516374 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2144) took 1126 ms. Trace:
I20260709 13:20:16.517185 23979 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:16.520694 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.543551 19221 rpcz_store.cc:276] 0709 13:20:15.389723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.405175 (+ 15452us) service_pool.cc:224] Handling call
0709 13:20:16.516221 (+1111046us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b540032dcd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:16.516321 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161415936}
I20260709 13:20:16.489120 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:16.527202 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:16.527464 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:16.529150 19213 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:16.560390 19212 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.560416 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:16.536520 23829 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.525132 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:16.493273 23943 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.535293 23841 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:16.491983 23898 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.536531 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:16.579100 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:16.527696 23956 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.539556 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:16.541594 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:16.534184 23960 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:20:16.543957 19217 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:20:16.535409 23958 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:20:16.641258 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.641875 19217 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:16.643595 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:16.529326 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 341765us
I20260709 13:20:16.644847 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:16.562172 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:16.563781 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.648703 19213 raft_consensus.cc:2410] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:20:16.649536 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:16.650182 19213 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:16.650902 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:16.652423 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2134) took 1271 ms. Trace:
I20260709 13:20:16.563103 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:16.535317 23976 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:16.653120 23976 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:16.653215 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 90207.7us
I20260709 13:20:16.653570 23976 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.567651 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:16.532855 23992 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.569171 23943 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.538906 24056 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:16.540357 23749 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:16.544924 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:16.766175 19221 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.590682 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:16.767540 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 176990us
I20260709 13:20:16.768275 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:16.532811 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:16.535391 23767 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:20:16.537557 23887 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.583003 23898 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.540313 23855 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:16.769335 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 236580us
I20260709 13:20:16.775224 23926 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:16.778162 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:16.823465 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 45398.7us
I20260709 13:20:16.825531 19184 leader_election.cc:400] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:16.825889 19184 leader_election.cc:403] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:16.581840 23979 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.582015 23938 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.838711 23926 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
W20260709 13:20:16.841418 24058 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
W20260709 13:20:16.654783 24042 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:16.641165 23897 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.835247 23910 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:16.776078 23943 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.829380 24049 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:16.762733 23747 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.792989 23645 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.836146 24062 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:16.836208 24069 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:16.837719 24077 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:20:16.837374 23870 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:16.652740 19213 rpcz_store.cc:276] 0709 13:20:15.381485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.651710 (+1270225us) service_pool.cc:224] Handling call
0709 13:20:16.651984 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.652147 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.652169 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:16.652211 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:16.652238 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.652291 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.652377 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.765529 23944 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.769798 24059 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.850396 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:16.821235 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:16.851773 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.150249 19143 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:17.150393 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 329243us
W20260709 13:20:16.854003 19113 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.3:39345 timed out after 1.994s (SENT) [suppressed 6 similar messages]
I20260709 13:20:17.148097 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2142) took 1759 ms. Trace:
I20260709 13:20:16.853925 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:16.938287 23855 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.151335 19213 rpcz_store.cc:276] 0709 13:20:15.389145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.147040 (+1757895us) service_pool.cc:224] Handling call
0709 13:20:17.147430 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.147680 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.147720 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.147776 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:17.147819 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.147887 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.148025 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.153009 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:16.970662 19063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2259) took 2262 ms (client timeout 2245 ms). Trace:
I20260709 13:20:17.034296 23791 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:16.939430 23624 consensus_meta.cc:287] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.154s	user 0.011s	sys 0.001s
W20260709 13:20:17.059579 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 399835us
I20260709 13:20:16.937192 23938 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:17.082186 19142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2159) took 1541 ms (client timeout 1565 ms). Trace:
I20260709 13:20:16.555613 23975 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.913420 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:16.851043 24022 log.cc:927] Time spent T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:16.913208 23841 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:16.920969 23813 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.035878 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.123174 23645 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.995937 19212 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:17.167768 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2325) took 1152 ms. Trace:
I20260709 13:20:16.643325 23956 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:16.826730 24055 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:17.044379 24018 consensus_meta.cc:287] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260709 13:20:16.937911 24075 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.849351 23955 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:20:17.042745 23887 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:17.037504 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 576) took 1776 ms. Trace:
W20260709 13:20:17.172997 23829 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 13:20:17.076664 19221 raft_consensus.cc:2468] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
W20260709 13:20:17.175443 23949 consensus_meta.cc:287] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.001s
I20260709 13:20:17.190600 23889 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.191035 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.168727 23960 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:17.089999 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2133) took 1710 ms (client timeout 1601 ms). Trace:
W20260709 13:20:16.921876 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.196103 19216 rpcz_store.cc:269] 0709 13:20:15.379259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.379966 (+   707us) service_pool.cc:224] Handling call
0709 13:20:17.089782 (+1709816us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b5400390dd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:17.089917 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183753088}
I20260709 13:20:16.855299 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.197252 19145 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:16.937740 23749 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:16.855896 23979 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:20:17.034507 23753 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:16.983253 24068 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.341s	user 0.000s	sys 0.000s
I20260709 13:20:17.114182 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:17.113541 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:17.114080 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:17.115272 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:17.116997 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.115231 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:17.092358 23816 consensus_meta.cc:287] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.699s	user 0.007s	sys 0.003s
I20260709 13:20:17.114533 23790 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.849225 23910 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.122601 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.116109 24064 consensus_queue.cc:1048] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:20:17.068943 24056 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.115752 23926 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.149077 24059 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:17.154274 19063 rpcz_store.cc:269] 0709 13:20:14.707859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.708091 (+   232us) service_pool.cc:224] Handling call
0709 13:20:16.970425 (+2262334us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54002cc754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:16.970588 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694639488}
W20260709 13:20:17.158236 19142 rpcz_store.cc:269] 0709 13:20:15.541228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.541355 (+   127us) service_pool.cc:224] Handling call
0709 13:20:17.081972 (+1540617us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540018ae54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:17.082117 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972121344}
I20260709 13:20:17.227535 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:17.134227 24061 consensus_meta.cc:287] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.000s
I20260709 13:20:17.160983 19140 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:20:17.143867 24034 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.620s	user 0.004s	sys 0.012s
I20260709 13:20:17.161688 19146 raft_consensus.cc:2368] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
W20260709 13:20:17.164175 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.164825 23898 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.134838 23992 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:16.984429 23976 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.148394 23944 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:17.159978 24082 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.221s	user 0.001s	sys 0.001s
I20260709 13:20:17.168252 19212 rpcz_store.cc:276] 0709 13:20:16.015415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.470715 (+455300us) service_pool.cc:224] Handling call
0709 13:20:17.167686 (+696971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.154060 23965 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:17.154445 23773 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:17.178570 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 648) took 2427 ms. Trace:
I20260709 13:20:17.161434 23624 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:17.242535 19063 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:17.161715 23862 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.795709 24050 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.182051 19214 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:17.180044 19068 rpcz_store.cc:276] 0709 13:20:15.260829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.486164 (+225335us) service_pool.cc:224] Handling call
0709 13:20:15.486476 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.498196 (+ 11720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.037193 (+1538997us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b540025d854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:17.037428 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23960832}
I20260709 13:20:17.249529 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.223155 23979 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:17.172101 23645 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.188215 23975 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.123054 23747 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.192386 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:17.104548 19071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2361) took 2131 ms (client timeout 1540 ms). Trace:
I20260709 13:20:17.194994 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.197167 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.207559 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:17.159613 23938 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.265463 19221 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:17.239502 23944 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.214807 19141 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:17.269049 19216 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:17.269124 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.269904 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2318) took 1878 ms. Trace:
I20260709 13:20:17.270358 19216 rpcz_store.cc:276] 0709 13:20:15.391707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.268269 (+1876562us) service_pool.cc:224] Handling call
0709 13:20:17.268631 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.269635 (+  1004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.269838 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.214250 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:17.234190 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48573.3us
I20260709 13:20:17.235265 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:17.266438 19071 rpcz_store.cc:269] 0709 13:20:14.973367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.092979 (+119612us) service_pool.cc:224] Handling call
0709 13:20:17.104287 (+2011308us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540025dd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:17.104451 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367825664}
I20260709 13:20:17.272488 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.191116 23949 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.226490 24062 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.218889 23790 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.228935 23926 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:17.238032 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 384020us
I20260709 13:20:17.216125 24072 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:17.238721 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:17.280076 19072 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:20:17.281195 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:17.243523 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:17.281571 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:17.281802 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2143) took 1892 ms. Trace:
I20260709 13:20:17.223399 23870 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.257647 23814 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.241016 19749 rpcz_store.cc:276] 0709 13:20:14.747055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.747217 (+   162us) service_pool.cc:224] Handling call
0709 13:20:14.763762 (+ 16545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.032124 (+268362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.032171 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.038528 (+  6357us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.153979 (+115451us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:15.174245 (+ 20266us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.185501 (+ 11256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.185564 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.508932 (+1323368us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:17.168724 (+659792us) raft_consensus.cc:1685] finished
0709 13:20:17.174090 (+  5366us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.174280 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12482,"prepare.queue_time_us":14014,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":290166,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":17187,"spinlock_wait_cycles":6480000,"thread_start_us":352997,"threads_started":2,"wal-append.queue_time_us":221313}
I20260709 13:20:17.229081 24069 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.210611 23749 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.251751 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:17.253865 19742 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:17.228677 24059 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.234843 24061 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:17.209477 23960 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.242244 24019 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.216410 23816 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.191270 24075 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:17.212658 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 98776.1us
I20260709 13:20:17.283722 23624 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:17.266795 19215 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:17.265952 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.315752 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.191285 23889 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.315598 23970 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.175477 24018 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.273866 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:17.274765 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.275319 19216 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:20:17.241969 23855 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.282480 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:17.327028 19143 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:20:17.264609 23925 consensus_meta.cc:287] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.792s	user 0.006s	sys 0.005s
I20260709 13:20:17.327239 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.235510 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.282191 19213 rpcz_store.cc:276] 0709 13:20:15.389434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.152511 (+1763077us) service_pool.cc:224] Handling call
0709 13:20:17.152829 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.153149 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:17.240698 (+ 87549us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.281494 (+ 40796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.281546 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:17.281586 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.281648 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.281753 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94842,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":118893,"threads_started":2}
I20260709 13:20:17.261057 23955 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.288349 19070 raft_consensus.cc:2368] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:17.293478 19221 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:17.330781 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.331100 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.331707 19221 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:17.331992 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:17.250702 23773 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.256891 23862 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.305781 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:17.257894 23979 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.266184 19139 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.313346 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:17.313747 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:17.290200 23965 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:17.270589 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.346370 19141 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:17.319706 19747 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:20:17.296335 24050 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:17.322199 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.324754 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2150) took 1815 ms. Trace:
I20260709 13:20:17.325006 19749 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:17.328537 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.283371 24062 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.333613 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.334798 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:17.335801 19140 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:17.336025 24094 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.336108 23898 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.287621 23870 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.320593 23899 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:17.295184 24069 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.310782 23791 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:20:17.311015 23814 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:20:17.317071 23583 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:20:17.312168 24019 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.320325 23624 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.528532 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:17.759788 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.706064 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:17.716511 19214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2320) took 2324 ms (client timeout 1994 ms). Trace:
I20260709 13:20:17.761560 19145 raft_consensus.cc:2410] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:20:17.728816 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.604960 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.760962 19144 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:17.573748 22878 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.764338 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:17.604616 19138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2152) took 2110 ms (client timeout 2472 ms). Trace:
I20260709 13:20:17.435865 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:17.765043 19138 rpcz_store.cc:269] 0709 13:20:15.493870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.494019 (+   149us) service_pool.cc:224] Handling call
0709 13:20:17.604317 (+2110298us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400220e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:17.604531 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456143744}
I20260709 13:20:17.765748 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:17.762899 19214 rpcz_store.cc:269] 0709 13:20:15.392253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.355664 (+963411us) service_pool.cc:224] Handling call
0709 13:20:17.716256 (+1360592us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540034b554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:17.716419 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859825408}
I20260709 13:20:17.760018 19216 rpcz_store.cc:276] 0709 13:20:15.509107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.274764 (+1765657us) service_pool.cc:224] Handling call
0709 13:20:17.275046 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.324513 (+ 49467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.324704 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.764647 22878 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:17.353291 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 82515.4us
I20260709 13:20:17.767658 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:17.770090 19214 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.731541 19038 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:17.770762 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:17.765834 19215 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:17.358784 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2317) took 1967 ms. Trace:
I20260709 13:20:17.777805 19212 rpcz_store.cc:276] 0709 13:20:15.391439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.244311 (+1852872us) service_pool.cc:224] Handling call
0709 13:20:17.244542 (+   231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.321210 (+ 76668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.321240 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.321762 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.356508 (+ 34746us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:17.356557 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.356634 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.358486 (+  1852us) raft_consensus.cc:1685] finished
0709 13:20:17.358506 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.358686 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434,"raft.queue_time_us":90855,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":99366,"threads_started":2,"wal-append.queue_time_us":26637}
I20260709 13:20:17.780478 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.768169 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:17.796651 19216 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:17.759235 19213 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:17.789856 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.797959 19141 raft_consensus.cc:2410] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:17.798210 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.799186 19216 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:17.799994 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2322) took 1785 ms. Trace:
I20260709 13:20:17.800522 19213 rpcz_store.cc:276] 0709 13:20:16.014526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.799077 (+1784551us) service_pool.cc:224] Handling call
0709 13:20:17.799412 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.799613 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.799648 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.799703 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:17.799746 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.799811 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.799932 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.776964 19147 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:17.338474 23773 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.794868 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:17.347352 19035 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:17.809952 19216 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:17.810174 23897 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.810608 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2323) took 1795 ms. Trace:
I20260709 13:20:17.811434 19184 leader_election.cc:400] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 13.
I20260709 13:20:17.813993 19216 rpcz_store.cc:276] 0709 13:20:16.014833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.802619 (+1787786us) service_pool.cc:224] Handling call
0709 13:20:17.802882 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.810378 (+  7496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.810556 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.815369 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:17.817204 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2326) took 1801 ms. Trace:
I20260709 13:20:17.822412 19216 rpcz_store.cc:276] 0709 13:20:16.015644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.815786 (+1800142us) service_pool.cc:224] Handling call
0709 13:20:17.816660 (+   874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.816836 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.816869 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.816942 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:17.816980 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.817047 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.817153 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.341988 23905 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:17.835089 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:17.828437 19216 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:17.836966 19221 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.838706 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2156) took 1739 ms. Trace:
W20260709 13:20:17.831350 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 99906.8us
I20260709 13:20:17.816685 23897 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:17.842162 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 494865us
I20260709 13:20:17.843061 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:17.844134 22878 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:17.844282 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:17.833156 19067 raft_consensus.cc:1240] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:20:17.397976 24061 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:17.500730 24088 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:17.560587 24052 raft_consensus.cc:993] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:17.847141 22878 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:17.525527 23910 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:17.488607 23943 consensus_meta.cc:287] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
W20260709 13:20:17.709707 24089 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.414s	user 0.003s	sys 0.000s
I20260709 13:20:17.840298 19212 raft_consensus.cc:2410] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:17.846310 23644 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:17.846243 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:17.557873 23747 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:17.839111 19216 rpcz_store.cc:276] 0709 13:20:16.099258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.827937 (+1728679us) service_pool.cc:224] Handling call
0709 13:20:17.828222 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.836551 (+  8329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.838649 (+  2098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.501729 23816 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.559260 23749 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:17.871887 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2402) took 1023 ms. Trace:
I20260709 13:20:17.791777 23583 consensus_queue.cc:1243] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:20:17.341419 23855 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.502038 23949 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:17.469753 24090 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:20:17.558712 23990 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 2.675s	user 0.009s	sys 0.018s
I20260709 13:20:17.850128 19035 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:17.527638 23645 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:17.527006 23926 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:17.434785 23923 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:17.526461 23790 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.541174 24075 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.566315 23976 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.995219 23841 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:17.865432 23943 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.031605 19071 raft_consensus.cc:2368] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12.
I20260709 13:20:17.854257 19214 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:17.564610 23960 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:17.558534 23938 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:17.572310 23956 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:17.559856 24018 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.503314 23979 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:17.855808 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.787923 23860 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.459524 23862 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:17.521064 24093 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:17.340484 23925 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:17.861168 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.342559 23955 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.332857 23970 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.862573 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:17.871048 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:17.872366 19139 rpcz_store.cc:276] 0709 13:20:16.848223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.848367 (+   144us) service_pool.cc:224] Handling call
0709 13:20:16.848662 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.342591 (+493929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.871563 (+528972us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54002a7954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:17.871813 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942854528}
I20260709 13:20:17.839422 23898 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:17.929077 19064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.011s	sys 0.036s
I20260709 13:20:17.498037 24059 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.847515 23978 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:17.547313 23944 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.451920 24050 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.850260 23897 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:18.115064 19063 raft_consensus.cc:1240] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:18.104202 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:17.988550 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:17.855295 23843 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.438038 23965 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.861644 24052 raft_consensus.cc:1081] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:17.793673 23899 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:17.998008 19219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2136) took 2616 ms (client timeout 2074 ms). Trace:
I20260709 13:20:17.930382 23972 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.121292 23972 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.122326 23970 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.122741 24059 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.122946 23624 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.123579 23972 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.846686 24061 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.125272 23965 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.125859 24061 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.969108 23813 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.794842 24094 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:17.846887 24088 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.014809 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:17.874066 23644 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:18.034560 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2149) took 2643 ms. Trace:
I20260709 13:20:18.109153 23938 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.057142 19072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.009s	sys 0.019s
W20260709 13:20:18.141449 19072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.009s	sys 0.019s
W20260709 13:20:18.057461 19065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.005s	sys 0.012s
W20260709 13:20:18.142644 19065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.006s	sys 0.012s
W20260709 13:20:18.037842 19068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.000s	sys 0.016s
W20260709 13:20:18.143934 19068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.001s	sys 0.016s
I20260709 13:20:18.106535 23944 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.058157 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:18.148259 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 90522us
I20260709 13:20:18.068432 19216 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:18.072180 19215 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:18.149196 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:20:18.078855 19064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.011s	sys 0.037s
I20260709 13:20:18.149732 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:18.037475 24054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.941s	user 0.012s	sys 0.022s
I20260709 13:20:18.081815 19217 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:18.149734 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:17.974838 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 108660us
I20260709 13:20:18.087865 19146 raft_consensus.cc:2376] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13. Re-sending same reply.
I20260709 13:20:18.118935 19138 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:18.152302 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:18.117666 19067 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
W20260709 13:20:18.120456 19219 rpcz_store.cc:269] 0709 13:20:15.382056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.363557 (+981501us) service_pool.cc:224] Handling call
0709 13:20:17.997644 (+1634087us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b540035c5d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:17.997912 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67008768}
I20260709 13:20:18.136729 19218 rpcz_store.cc:276] 0709 13:20:15.391170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.156052 (+1764882us) service_pool.cc:224] Handling call
0709 13:20:17.165121 (+  9069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.165458 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.165487 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.165985 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.213694 (+ 47709us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:17.214309 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.214379 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.709050 (+494671us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:18.029964 (+320914us) raft_consensus.cc:1685] finished
0709 13:20:18.029989 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.034464 (+  4475us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1474,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5726,"spinlock_wait_cycles":13144320,"thread_start_us":24943,"threads_started":1,"wal-append.queue_time_us":81043}
W20260709 13:20:18.037596 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.005s	sys 0.024s
W20260709 13:20:18.155992 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.005s	sys 0.024s
W20260709 13:20:18.156527 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 816900us
I20260709 13:20:18.156927 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:18.117918 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 267906us
I20260709 13:20:18.151506 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:18.158833 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:20:18.139670 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 124977us
I20260709 13:20:18.087471 23978 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.075330 23979 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:18.178288 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.117213 23897 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.161428 24069 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.161711 23965 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.081830 23898 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.088801 23943 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.163100 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.163661 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:18.164260 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.165153 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:18.066953 24093 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.165913 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2321) took 2153 ms. Trace:
I20260709 13:20:18.168076 24088 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.168668 24103 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.193179 19220 rpcz_store.cc:276] 0709 13:20:16.012755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.530327 (+1517572us) service_pool.cc:224] Handling call
0709 13:20:17.530786 (+   459us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:17.667049 (+136263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.667096 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:17.706282 (+ 39186us) log.cc:844] Serialized 78 byte log entry
0709 13:20:18.081065 (+374783us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:18.081183 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.081261 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.165661 (+ 84400us) raft_consensus.cc:1685] finished
0709 13:20:18.165686 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.165849 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135675,"raft.queue_time_us":179114,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":372744,"threads_started":1,"wal-append.queue_time_us":455604}
I20260709 13:20:18.137548 23813 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.169396 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.176527 24018 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.170507 23955 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.171386 23644 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.172362 24019 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.173966 23925 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.159385 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:18.250924 23790 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.067914 23860 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.180586 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:18.154316 24054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.058s	user 0.012s	sys 0.022s
I20260709 13:20:18.188131 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:18.192289 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.193126 19140 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:18.394441 19065 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
W20260709 13:20:18.394584 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 206532us
I20260709 13:20:18.146027 24072 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.147966 24061 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.245929 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:18.248318 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 78994.7us
I20260709 13:20:18.401484 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.058746 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.403496 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.404287 19214 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:18.205765 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:18.251749 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 65576.3us
I20260709 13:20:18.154013 23841 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:18.184535 23978 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.191257 24036 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.388578 24108 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.304129 23855 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.182399 23899 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:17.566995 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:18.305214 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:18.325110 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.249163 23772 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.189052 23965 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:18.251528 24103 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.303310 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.251039 23901 consensus_queue.cc:1059] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:20:18.307432 24094 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:18.301651 24105 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:20:18.361888 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.190204 23944 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:18.182986 23979 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:18.376231 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 216933us
I20260709 13:20:18.484568 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.453332 23790 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.488207 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.451684 23841 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:18.251340 24018 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.182729 24035 consensus_queue.cc:1059] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.180s
I20260709 13:20:18.186779 23843 consensus_queue.cc:1059] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:20:18.155953 23938 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.487756 23790 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.497272 23790 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.497812 23938 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:18.381839 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.498521 19717 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:18.375466 19067 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:18.385118 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.499945 19717 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.500329 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:18.501050 23814 raft_consensus.cc:2804] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:18.501451 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.501616 23814 raft_consensus.cc:697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:18.502091 19070 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:18.502883 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.502542 23814 consensus_queue.cc:237] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.503441 19070 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:18.504262 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.386003 23955 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.500762 23906 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.505074 23955 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:18.505360 23906 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.505627 23955 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:18.389672 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.508298 23790 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.509361 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.510008 19746 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:18.510829 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:18.390148 19147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.039s
I20260709 13:20:18.390447 19184 leader_election.cc:400] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:18.511873 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.396061 19035 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:18.398205 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.512702 23898 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:18.438284 19748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.513441 23901 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:18.438797 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.514847 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:18.514947 23901 raft_consensus.cc:3055] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:18.515383 23901 raft_consensus.cc:740] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:18.515928 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.505812 23906 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:18.441053 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 235390us
I20260709 13:20:18.517462 23813 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.444494 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2333) took 2024 ms. Trace:
I20260709 13:20:18.513463 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.518075 19214 rpcz_store.cc:276] 0709 13:20:16.420221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.443537 (+2023316us) service_pool.cc:224] Handling call
0709 13:20:18.443893 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.444105 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.444141 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.444197 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:18.444236 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.444305 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.444425 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.519001 19069 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:18.519392 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.519832 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.520437 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:18.445504 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44119.7us
I20260709 13:20:18.303452 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2408) took 1151 ms. Trace:
I20260709 13:20:18.448220 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.521278 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:18.521654 24093 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.476851 19212 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 11: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:18.512183 19184 leader_election.cc:403] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:18.522409 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:18.522528 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 132185us
I20260709 13:20:18.522893 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.523233 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.523459 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:18.523896 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:18.446141 23925 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:18.521075 19143 rpcz_store.cc:276] 0709 13:20:17.152253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.152750 (+   497us) service_pool.cc:224] Handling call
0709 13:20:18.303194 (+1150444us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400189a54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:18.303380 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398384384}
I20260709 13:20:18.459471 24108 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.525138 23925 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.524494 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.525707 24093 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:18.526170 19065 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:18.526387 24093 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.524456 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:18.451507 24036 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:18.527220 23925 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:18.482498 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2165) took 1301 ms. Trace:
I20260709 13:20:18.527618 24036 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.181197 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:18.528270 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2167) took 1346 ms. Trace:
I20260709 13:20:18.529299 19138 raft_consensus.cc:1240] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:18.529964 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2168) took 1348 ms. Trace:
I20260709 13:20:18.530058 23979 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.530296 19138 rpcz_store.cc:276] 0709 13:20:17.181759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.528827 (+1347068us) service_pool.cc:224] Handling call
0709 13:20:18.529134 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.529754 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.529915 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.530915 19215 raft_consensus.cc:2410] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:18.531725 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2169) took 1349 ms. Trace:
I20260709 13:20:18.532079 19138 rpcz_store.cc:276] 0709 13:20:17.182204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.531027 (+1348823us) service_pool.cc:224] Handling call
0709 13:20:18.531302 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.531455 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.531479 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.531516 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:18.531546 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.531596 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.531680 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.478860 23965 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.533293 23841 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.442167 19141 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:18.444051 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 559) took 1281 ms. Trace:
I20260709 13:20:18.536396 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.451936 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.521095 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.527118 24108 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:18.540434 19220 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 9: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:18.526999 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.486512 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.533705 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:18.542069 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:18.513906 19748 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:18.517408 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.520869 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.483914 23887 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:18.537808 19750 raft_consensus.cc:2368] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:18.537926 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.527815 19145 rpcz_store.cc:276] 0709 13:20:17.180899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.481663 (+1300764us) service_pool.cc:224] Handling call
0709 13:20:18.481973 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.482140 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.482162 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.482203 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:18.482244 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.482315 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.482436 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.538653 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.554617 19212 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:18.555667 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.528648 19143 rpcz_store.cc:276] 0709 13:20:17.181478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.527537 (+1346059us) service_pool.cc:224] Handling call
0709 13:20:18.527802 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.527963 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.527987 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.528025 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:18.528061 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.528112 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.528218 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.557008 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.557992 19143 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:18.558712 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2415) took 1333 ms. Trace:
I20260709 13:20:18.559088 19143 rpcz_store.cc:276] 0709 13:20:17.225548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.557516 (+1331968us) service_pool.cc:224] Handling call
0709 13:20:18.557810 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.558437 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.558652 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.560400 19143 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:18.512136 19147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.005s	sys 0.039s
I20260709 13:20:18.539723 19214 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:18.562043 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.562716 19214 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:18.563663 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:18.564272 19214 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:18.516166 23901 consensus_queue.cc:260] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.584470 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 594) took 1294 ms. Trace:
I20260709 13:20:18.524801 23860 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.495922 24018 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:18.585130 23899 consensus_queue.cc:1175] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "508ee2e0531b43d7a1c05f950644ae66" responder_term: 14 status { last_received { term: 14 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 14 index: 12 } }
I20260709 13:20:18.589996 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2155) took 2759 ms. Trace:
I20260709 13:20:18.590356 19221 rpcz_store.cc:276] 0709 13:20:15.830892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.343842 (+1512950us) service_pool.cc:224] Handling call
0709 13:20:17.344262 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.837514 (+493252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.589777 (+752263us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540036d154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:18.589940 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132586752}
I20260709 13:20:18.591490 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.592002 22878 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.592253 19221 raft_consensus.cc:2410] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 18 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:18.593308 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.593575 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.592490 22878 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.594458 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.567946 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.595002 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:18.595330 19212 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:18.596616 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2157) took 2101 ms. Trace:
I20260709 13:20:18.536633 19144 rpcz_store.cc:276] 0709 13:20:17.162485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.793500 (+631015us) service_pool.cc:224] Handling call
0709 13:20:17.793868 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.794078 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:18.141077 (+346999us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.443672 (+302595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.443749 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:18.443789 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.443851 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.443986 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":586863,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":4279,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7116,"thread_start_us":588063,"threads_started":2}
I20260709 13:20:18.569664 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:18.593595 19742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 657) took 1485 ms. Trace:
I20260709 13:20:18.600472 19742 rpcz_store.cc:276] 0709 13:20:17.108238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.113073 (+  4835us) service_pool.cc:224] Handling call
0709 13:20:18.593394 (+1480321us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b5400522454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:18.593505 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95736960}
I20260709 13:20:18.584921 19071 rpcz_store.cc:276] 0709 13:20:17.289632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.298915 (+  9283us) service_pool.cc:224] Handling call
0709 13:20:18.584290 (+1285375us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400353ed4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:18.584414 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582836096}
I20260709 13:20:18.602733 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.611035 19221 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:18.611955 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2335) took 2138 ms. Trace:
I20260709 13:20:18.612433 19221 rpcz_store.cc:276] 0709 13:20:16.473475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.592841 (+2119366us) service_pool.cc:224] Handling call
0709 13:20:18.610626 (+ 17785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.611624 (+   998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.611891 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.614674 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2158) took 2118 ms. Trace:
I20260709 13:20:18.551440 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:18.628005 19746 raft_consensus.cc:2368] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:18.573035 24036 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.566066 23925 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.575476 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:18.577616 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 181625us
I20260709 13:20:18.639607 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:18.578110 24056 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.640153 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 562) took 1476 ms. Trace:
I20260709 13:20:18.579286 23889 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:18.552470 23887 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:18.567330 23938 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:18.581722 23978 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.582469 23944 raft_consensus.cc:3055] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:18.582901 23769 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:18.583645 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.583767 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.584565 23901 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.593677 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2170) took 1411 ms. Trace:
I20260709 13:20:18.569883 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2174) took 1322 ms. Trace:
I20260709 13:20:18.597831 19212 rpcz_store.cc:276] 0709 13:20:16.495690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.595936 (+2100246us) service_pool.cc:224] Handling call
0709 13:20:18.596187 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.596345 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.596368 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.596405 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:18.596435 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.596481 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.596567 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.558663 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.617465 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 588) took 1375 ms. Trace:
I20260709 13:20:18.536942 24094 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.618815 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.619800 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:18.620863 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 586) took 1382 ms. Trace:
I20260709 13:20:18.623309 22878 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.570570 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:18.628561 19214 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:18.645435 24061 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.645627 23970 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.635821 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:18.916046 19065 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:18.638211 24036 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:18.640530 19139 rpcz_store.cc:276] 0709 13:20:17.163287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.177175 (+1013888us) service_pool.cc:224] Handling call
0709 13:20:18.177534 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:18.177935 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.177967 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:18.178595 (+   628us) log.cc:844] Serialized 52 byte log entry
0709 13:20:18.447912 (+269317us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:18.447952 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.449175 (+  1223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.639953 (+190778us) raft_consensus.cc:1685] finished
0709 13:20:18.639972 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.640101 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1266,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":268935,"threads_started":1,"wal-append.queue_time_us":457007}
I20260709 13:20:18.936442 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:18.937189 19139 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:18.644146 19146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2182) took 1304 ms (client timeout 1570 ms). Trace:
W20260709 13:20:18.938105 19146 rpcz_store.cc:269] 0709 13:20:17.342117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.528200 (+186083us) service_pool.cc:224] Handling call
0709 13:20:18.643996 (+1115796us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54002d8f54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:18.644093 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739365120}
I20260709 13:20:18.525281 23934 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:18.645558 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 565) took 1476 ms. Trace:
I20260709 13:20:18.943348 19141 rpcz_store.cc:276] 0709 13:20:17.168865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.307054 (+1138189us) service_pool.cc:224] Handling call
0709 13:20:18.307433 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.536403 (+228970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.645337 (+108934us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400189554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:18.645503 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308854016}
I20260709 13:20:18.554772 24088 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:18.792781 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 153241us
I20260709 13:20:18.949822 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:18.799321 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 157767us
I20260709 13:20:18.953392 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:18.954885 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:18.805608 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.615702 23768 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.807958 23785 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:18.898310 24056 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.619556 23790 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.618487 24019 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.619383 24035 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:18.618288 24029 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.638724 23925 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.590853 23906 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.629298 19221 rpcz_store.cc:276] 0709 13:20:16.495941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.613729 (+2117788us) service_pool.cc:224] Handling call
0709 13:20:18.614087 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.614291 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.614322 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.614380 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:18.614422 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.614490 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.614616 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.894387 19069 raft_consensus.cc:2393] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:18.896402 19138 rpcz_store.cc:276] 0709 13:20:17.182490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.539925 (+1357435us) service_pool.cc:224] Handling call
0709 13:20:18.593228 (+ 53303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.593394 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.593416 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.593452 (+    36us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:18.593482 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.593530 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.593627 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.896528 19143 rpcz_store.cc:276] 0709 13:20:17.247547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.559903 (+1312356us) service_pool.cc:224] Handling call
0709 13:20:18.560205 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.560761 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.569819 (+  9058us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:18.806335 24099 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:20:18.897332 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:18.897622 19220 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:18.902681 19064 rpcz_store.cc:276] 0709 13:20:17.238695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.238820 (+   125us) service_pool.cc:224] Handling call
0709 13:20:17.251171 (+ 12351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.257533 (+  6362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.257569 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.267071 (+  9502us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.150097 (+883026us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:18.552812 (+402715us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.620500 (+ 67688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.620596 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.620648 (+    52us) raft_consensus.cc:1685] finished
0709 13:20:18.620666 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.620799 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94648,"raft.queue_time_us":68999,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":10343,"thread_start_us":1218764,"threads_started":2,"wal-append.queue_time_us":719188}
I20260709 13:20:19.057917 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2180) took 1730 ms. Trace:
I20260709 13:20:19.058378 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.058269 19138 rpcz_store.cc:276] 0709 13:20:17.327784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.057203 (+1729419us) service_pool.cc:224] Handling call
0709 13:20:19.057482 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.057647 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.057673 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.057715 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:19.057741 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.057788 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.057870 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.912923 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:18.794752 24093 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.897773 19068 rpcz_store.cc:276] 0709 13:20:17.242545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.249480 (+  6935us) service_pool.cc:224] Handling call
0709 13:20:17.249872 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.250167 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.250208 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.250742 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.144396 (+893654us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:18.547766 (+403370us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.617072 (+ 69306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.617170 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.617238 (+    68us) raft_consensus.cc:1685] finished
0709 13:20:18.617256 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.617398 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165632,"raft.queue_time_us":72556,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":20737,"thread_start_us":1226961,"threads_started":2,"wal-append.queue_time_us":889184}
I20260709 13:20:19.067404 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:19.067978 19068 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.794521 24108 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:18.836122 23773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.011s	sys 0.036s
I20260709 13:20:18.799253 23938 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.947064 23970 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.806011 24069 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:18.946727 24061 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.950488 19070 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:18.965253 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2294) took 1191 ms. Trace:
I20260709 13:20:19.079461 19063 rpcz_store.cc:276] 0709 13:20:17.773382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.773532 (+   150us) service_pool.cc:224] Handling call
0709 13:20:17.773940 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.116388 (+342448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.964942 (+848554us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400057b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:18.965183 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783874304}
I20260709 13:20:18.618986 23583 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.807790 23944 raft_consensus.cc:740] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:18.967800 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:18.618733 24005 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:19.086313 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:18.893774 24113 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.974676 22878 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:18.894111 23889 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:18.943140 23934 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.992267 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.098657 19065 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:19.099259 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2393) took 1090 ms. Trace:
I20260709 13:20:19.042927 24035 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.054590 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:19.055040 19221 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:19.100769 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 709) took 2597 ms. Trace:
I20260709 13:20:19.101202 19221 rpcz_store.cc:276] 0709 13:20:16.503814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.051715 (+2547901us) service_pool.cc:224] Handling call
0709 13:20:19.052084 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.100464 (+ 48380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.100707 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.102450 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:19.103327 19221 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:19.050283 24029 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:19.044543 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2160) took 2548 ms (client timeout 2302 ms). Trace:
W20260709 13:20:19.107255 19217 rpcz_store.cc:269] 0709 13:20:16.496281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.643368 (+147087us) service_pool.cc:224] Handling call
0709 13:20:19.044310 (+2400942us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540035c0d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.044462 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3305287040}
W20260709 13:20:19.108498 19035 leader_election.cc:336] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Timed out: RequestConsensusVote RPC to 127.17.139.2:40307 timed out after 1.570s (SENT)
I20260709 13:20:19.057193 19212 raft_consensus.cc:2393] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:19.111317 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 711) took 2607 ms. Trace:
I20260709 13:20:19.111753 19212 rpcz_store.cc:276] 0709 13:20:16.504318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.110371 (+2606053us) service_pool.cc:224] Handling call
0709 13:20:19.110707 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.110937 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.110974 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.111027 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:19.111078 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.111145 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.111257 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.068929 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2183) took 1721 ms. Trace:
I20260709 13:20:19.113034 19143 rpcz_store.cc:276] 0709 13:20:17.347658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.065667 (+1718009us) service_pool.cc:224] Handling call
0709 13:20:19.068475 (+  2808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.068633 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.068655 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.068691 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.068718 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.068772 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.068861 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:18.805862 24053 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.976339 23902 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.972385 23843 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:19.051389 23925 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.971799 23769 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.986280 23900 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.618237 23965 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:18.940138 24094 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:19.081043 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.034s	sys 0.121s
W20260709 13:20:19.150182 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.034s	sys 0.121s
W20260709 13:20:19.082168 19216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.034s	sys 0.121s
W20260709 13:20:19.150931 19216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.034s	sys 0.121s
W20260709 13:20:19.083413 19184 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.016s	sys 0.019s
W20260709 13:20:19.152047 19184 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.016s	sys 0.019s
W20260709 13:20:19.152390 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 605787us
I20260709 13:20:19.153481 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:19.153903 19068 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
W20260709 13:20:19.084105 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 116407us
I20260709 13:20:19.155997 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:19.080861 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.070847 24103 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:18.983074 19139 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:19.039908 23813 consensus_queue.cc:1059] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:20:19.087688 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.041435 24056 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:18.985760 23785 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:19.091073 19146 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:19.071257 23938 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:19.099635 19065 rpcz_store.cc:276] 0709 13:20:18.008861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.947524 (+938663us) service_pool.cc:224] Handling call
0709 13:20:19.099195 (+151671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.194751 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.246315 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2376) took 1433 ms. Trace:
I20260709 13:20:19.246809 19063 rpcz_store.cc:276] 0709 13:20:17.813177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.194454 (+1381277us) service_pool.cc:224] Handling call
0709 13:20:19.246236 (+ 51782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.247937 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.248754 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2378) took 1431 ms. Trace:
I20260709 13:20:19.249203 19063 rpcz_store.cc:276] 0709 13:20:17.817809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.247625 (+1429816us) service_pool.cc:224] Handling call
0709 13:20:19.248695 (+  1070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.115516 19069 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:19.262979 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.108698 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:19.134203 19145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.032s
W20260709 13:20:19.264381 19145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.007s	sys 0.032s
I20260709 13:20:19.070513 24093 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:19.087253 23841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.026s
W20260709 13:20:19.121045 23814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.030s
I20260709 13:20:19.132885 23790 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:20:19.071476 24108 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.109212 24035 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:19.091787 23624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.025s
I20260709 13:20:19.157338 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:19.294472 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 137217us
I20260709 13:20:19.295233 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:19.109687 23934 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:19.169112 19714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.012s	sys 0.041s
W20260709 13:20:19.171001 19142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.017s	sys 0.042s
I20260709 13:20:19.082356 24069 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.172575 19070 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:19.120750 23902 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:19.326104 23902 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:19.149925 24091 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.012s	sys 0.038s
W20260709 13:20:19.328383 24091 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.014s	sys 0.041s
W20260709 13:20:19.255967 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 685437us
I20260709 13:20:19.330792 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:19.332067 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:19.159544 24005 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.333336 24005 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:19.335438 23773 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:19.335886 23773 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.336277 23773 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:19.097442 24113 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.115074 23889 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.260643 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2330) took 2841 ms. Trace:
W20260709 13:20:19.079963 23644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.004s	sys 0.031s
I20260709 13:20:18.974730 23887 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.266098 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.347903 19063 raft_consensus.cc:2410] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:19.270221 19217 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:20:19.348507 19217 pending_rounds.cc:85] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:19.348888 19217 pending_rounds.cc:107] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:20:19.349241 19217 raft_consensus.cc:2889] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.350004 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2339) took 2070 ms. Trace:
I20260709 13:20:19.350364 19217 rpcz_store.cc:276] 0709 13:20:17.279491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.264794 (+1985303us) service_pool.cc:224] Handling call
0709 13:20:19.265141 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.349763 (+ 84622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.349949 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.353864 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.138271 23843 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.296587 19110 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:19.294016 23978 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:19.343415 24116 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.355s	user 0.001s	sys 0.001s
I20260709 13:20:19.287374 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:19.298233 19714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.012s	sys 0.042s
I20260709 13:20:19.298417 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:19.346993 23644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.004s	sys 0.031s
I20260709 13:20:19.365919 24056 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:19.367492 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.367736 19067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2389) took 1437 ms (client timeout 1540 ms). Trace:
W20260709 13:20:19.368115 19067 rpcz_store.cc:269] 0709 13:20:17.930446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.162829 (+232383us) service_pool.cc:224] Handling call
0709 13:20:19.367568 (+1204739us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540025dd54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.367678 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423419264}
I20260709 13:20:19.304029 23906 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.306478 24093 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:19.307708 24069 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.308318 23785 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:19.314553 24108 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:19.315996 23897 consensus_meta.cc:287] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 1.068s	user 0.004s	sys 0.004s
I20260709 13:20:19.317276 23965 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:19.320245 24119 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:20:19.320986 24110 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:20:19.321787 24127 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:20:19.322432 24124 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:20:19.302254 23900 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:19.281250 23814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.011s	sys 0.032s
I20260709 13:20:19.340266 19064 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:19.343448 19219 rpcz_store.cc:276] 0709 13:20:16.418764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.154080 (+1735316us) service_pool.cc:224] Handling call
0709 13:20:18.154449 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.154722 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:18.464743 (+310021us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.260221 (+795478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.260287 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:19.260356 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.260443 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.260579 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":482985,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":1091772,"threads_started":3,"wal-append.queue_time_us":705159}
W20260709 13:20:19.293962 23624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.011s	sys 0.025s
W20260709 13:20:19.355975 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 59476us
W20260709 13:20:19.298301 19142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.018s	sys 0.042s
I20260709 13:20:19.352248 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2171) took 2042 ms. Trace:
I20260709 13:20:19.356810 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:19.271528 23979 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:19.342418 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:19.282611 23841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.010s	sys 0.026s
W20260709 13:20:19.360836 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 837003us
W20260709 13:20:19.348608 23955 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.000s
I20260709 13:20:19.364064 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2314) took 1165 ms. Trace:
I20260709 13:20:19.361733 23583 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.205061 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:19.368827 23887 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:19.383602 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 427156us
I20260709 13:20:19.393119 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2299) took 1607 ms. Trace:
I20260709 13:20:19.436427 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:19.472908 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 130539us
I20260709 13:20:19.440789 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:19.466632 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:19.445811 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:19.446149 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2331) took 3027 ms. Trace:
I20260709 13:20:19.453258 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:19.476320 19070 raft_consensus.cc:2368] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:19.410312 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2419) took 2138 ms. Trace:
I20260709 13:20:19.467545 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 561) took 2304 ms. Trace:
I20260709 13:20:19.442867 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:19.479197 19069 rpcz_store.cc:276] 0709 13:20:18.198837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.277080 (+1078243us) service_pool.cc:224] Handling call
0709 13:20:19.363999 (+ 86919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.479801 19065 rpcz_store.cc:276] 0709 13:20:17.785481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.374836 (+1589355us) service_pool.cc:224] Handling call
0709 13:20:19.392544 (+ 17708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.392749 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.392777 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.392830 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:19.392864 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.392947 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.393063 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.480677 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:19.444861 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2329) took 3026 ms. Trace:
W20260709 13:20:19.416098 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 262675us
I20260709 13:20:19.441149 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:19.476621 19742 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.478128 19147 rpcz_store.cc:276] 0709 13:20:17.163026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.816368 (+653342us) service_pool.cc:224] Handling call
0709 13:20:17.816726 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.817450 (+   724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.817484 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.818004 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.561194 (+743190us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:18.561238 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.561319 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.467297 (+905978us) raft_consensus.cc:1685] finished
0709 13:20:19.467323 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.467475 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":742730,"threads_started":1,"wal-append.queue_time_us":1260538}
I20260709 13:20:19.480252 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:19.475234 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:19.485602 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42930 (request call id 696) took 1303 ms. Trace:
I20260709 13:20:19.486209 19746 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:19.486123 19749 rpcz_store.cc:276] 0709 13:20:18.182604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.182759 (+   155us) service_pool.cc:224] Handling call
0709 13:20:18.183169 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.185774 (+  2605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.185820 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.189097 (+  3277us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.618650 (+429553us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:18.618705 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.618772 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.485301 (+866529us) raft_consensus.cc:1685] finished
0709 13:20:19.485324 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.485448 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1759,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4199,"thread_start_us":429206,"threads_started":1,"wal-append.queue_time_us":786144}
I20260709 13:20:19.484189 19068 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:19.481966 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 563) took 2318 ms. Trace:
I20260709 13:20:19.489360 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2390) took 1520 ms. Trace:
I20260709 13:20:19.483551 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:19.490037 19068 rpcz_store.cc:276] 0709 13:20:17.969388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.192317 (+1222929us) service_pool.cc:224] Handling call
0709 13:20:19.489304 (+296987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.482640 19139 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:19.491343 19068 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:19.491468 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:19.491918 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2308) took 1682 ms. Trace:
I20260709 13:20:19.492098 19139 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:19.492252 19068 rpcz_store.cc:276] 0709 13:20:17.809495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.490812 (+1681317us) service_pool.cc:224] Handling call
0709 13:20:19.491080 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.491694 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.491873 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.478852 19217 rpcz_store.cc:276] 0709 13:20:17.309889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.351303 (+2041414us) service_pool.cc:224] Handling call
0709 13:20:19.351651 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.351865 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.351901 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.351956 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.351999 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.352056 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.352187 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.493602 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:19.477116 19141 rpcz_store.cc:276] 0709 13:20:17.272162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.950913 (+1678751us) service_pool.cc:224] Handling call
0709 13:20:18.951262 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.951489 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:18.984285 (+ 32796us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.409843 (+425558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.409935 (+    92us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.409993 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.410087 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.410237 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15283,"prepare.queue_time_us":102425,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":3823,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":16322,"thread_start_us":405805,"threads_started":1}
I20260709 13:20:19.495549 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:19.382983 24129 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:20:19.489395 19142 rpcz_store.cc:276] 0709 13:20:17.163545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.191693 (+1028148us) service_pool.cc:224] Handling call
0709 13:20:18.192063 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.192304 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:18.566404 (+374100us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.481537 (+915133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.481600 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:19.481642 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.481811 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.481918 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188983,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":3595,"thread_start_us":1116624,"threads_started":2,"wal-append.queue_time_us":825931}
I20260709 13:20:19.476243 19218 rpcz_store.cc:276] 0709 13:20:16.419010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.164947 (+1745937us) service_pool.cc:224] Handling call
0709 13:20:18.165269 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.165474 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:18.453396 (+287922us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.445843 (+992447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.445893 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.445937 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.445995 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.446098 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2500,"prepare.queue_time_us":472489,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":226331,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":627,"thread_start_us":1277056,"threads_started":3,"wal-append.queue_time_us":915337}
I20260709 13:20:19.497357 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:19.508263 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:19.480787 23901 consensus_meta.cc:287] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.004s
I20260709 13:20:19.501070 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:19.383080 24061 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.445461 24059 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.503544 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.509651 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:19.383240 23970 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.481446 19216 rpcz_store.cc:276] 0709 13:20:16.418471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.150643 (+1732172us) service_pool.cc:224] Handling call
0709 13:20:18.177632 (+ 26989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.177867 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:18.452009 (+274142us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.444504 (+992495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.444553 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.444595 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.444658 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.444798 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7554,"prepare.queue_time_us":460335,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":238592,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":23281,"thread_start_us":1265822,"threads_started":3,"wal-append.queue_time_us":847273}
I20260709 13:20:19.419543 23894 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:19.415055 24108 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.460757 24113 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.478056 23772 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:20:19.431077 23906 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:19.528324 24130 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.145s	user 0.000s	sys 0.003s
I20260709 13:20:19.528446 23906 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:19.482817 23955 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.530463 23906 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.481783 24052 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:19.485302 23965 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:19.531641 23965 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.532140 23965 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:19.509613 24018 consensus_meta.cc:287] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.924s	user 0.008s	sys 0.002s
I20260709 13:20:19.537197 24018 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.539899 24018 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.421248 24069 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:19.541080 24069 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.543663 24069 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.525993 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:19.530493 23955 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:19.537750 24138 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:20:19.381570 23897 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.549702 23897 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.550513 19750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54172 (request call id 608) took 1180 ms. Trace:
I20260709 13:20:19.551036 19750 rpcz_store.cc:276] 0709 13:20:18.369968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.370153 (+   185us) service_pool.cc:224] Handling call
0709 13:20:19.550270 (+1180117us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b54006234d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.550435 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89737984}
I20260709 13:20:19.556847 23965 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.559008 24062 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.559633 23965 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.560297 24050 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.564146 23860 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:19.564690 23860 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:19.565843 23860 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:19.567350 23860 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.579413 23870 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.584280 24029 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.604766 23889 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.509114 24140 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:19.606125 23843 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.608709 23894 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:19.608716 24005 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:19.613977 23902 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:19.621220 24132 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.261s	user 0.004s	sys 0.000s
I20260709 13:20:19.619340 23894 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.639204 24094 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:19.524559 24059 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.640309 23979 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:19.640964 23979 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:19.641943 24059 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.625522 23944 consensus_queue.cc:260] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:19.644447 23944 raft_consensus.cc:3060] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.629388 23902 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:19.646698 24139 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.201s	user 0.000s	sys 0.003s
I20260709 13:20:19.647953 23992 raft_consensus.cc:3055] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:19.648447 23992 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:19.649930 23925 consensus_meta.cc:287] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 13:20:19.649501 23992 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.651091 23992 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:19.624156 23934 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:19.654063 24146 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:20:19.654656 23934 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.656358 24035 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.632136 23938 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.660094 23938 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.662596 24035 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.710971 19038 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:19.721885 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2306) took 1912 ms. Trace:
I20260709 13:20:19.498608 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2309) took 1686 ms. Trace:
I20260709 13:20:19.722615 19063 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:19.722926 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2398) took 1212 ms. Trace:
I20260709 13:20:19.723922 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2274) took 3529 ms. Trace:
I20260709 13:20:19.723407 19068 rpcz_store.cc:276] 0709 13:20:17.812414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.497915 (+1685501us) service_pool.cc:224] Handling call
0709 13:20:19.498165 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.498327 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.498354 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.498393 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:19.498420 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.498469 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.498563 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.725620 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2301) took 1939 ms. Trace:
I20260709 13:20:19.726052 19069 rpcz_store.cc:276] 0709 13:20:17.786098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.479872 (+1693774us) service_pool.cc:224] Handling call
0709 13:20:19.724576 (+244704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.725004 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.725041 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.725128 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:19.725199 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.725282 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.725408 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.727475 19071 raft_consensus.cc:1240] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:19.728329 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2383) took 1902 ms. Trace:
I20260709 13:20:19.728466 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2384) took 1902 ms. Trace:
I20260709 13:20:19.730305 19069 rpcz_store.cc:276] 0709 13:20:17.825697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.727138 (+1901441us) service_pool.cc:224] Handling call
0709 13:20:19.727677 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.728034 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.728080 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.728165 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.728217 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.728289 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.728410 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.729355 19072 raft_consensus.cc:2393] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:19.724704 19066 rpcz_store.cc:276] 0709 13:20:16.194194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.194981 (+   787us) service_pool.cc:224] Handling call
0709 13:20:16.195293 (+   312us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:16.195649 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.195682 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:17.734242 (+1538560us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b180031cf00. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a
0709 13:20:18.169299 (+435057us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b2c00028df8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:20:18.170178 (+   879us) log.cc:844] Serialized 78 byte log entry
0709 13:20:18.616536 (+446358us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:18.616573 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.616640 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.723295 (+1106655us) raft_consensus.cc:1685] finished
0709 13:20:19.723333 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.723718 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3148,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":83171,"spinlock_wait_cycles":49518336,"thread_start_us":445908,"threads_started":1,"wal-append.queue_time_us":921120}
W20260709 13:20:19.732754 19072 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2386) took 1894 ms (client timeout 1603 ms). Trace:
W20260709 13:20:19.733327 19072 rpcz_store.cc:269] 0709 13:20:17.837983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.156594 (+318611us) service_pool.cc:224] Handling call
0709 13:20:19.732442 (+1575848us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54001a8954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.732644 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3612657024}
I20260709 13:20:19.722541 19065 rpcz_store.cc:276] 0709 13:20:17.808965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.480783 (+1671818us) service_pool.cc:224] Handling call
0709 13:20:19.720617 (+239834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.721210 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.721248 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:19.721327 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:19.721355 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.721452 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.721651 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.735678 19072 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:19.736341 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2395) took 1724 ms. Trace:
I20260709 13:20:19.737617 19067 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:19.739223 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2298) took 1954 ms. Trace:
I20260709 13:20:19.739576 19067 rpcz_store.cc:276] 0709 13:20:17.785168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.372693 (+1587525us) service_pool.cc:224] Handling call
0709 13:20:19.737256 (+364563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.738027 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.738989 (+   962us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54001a8950. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.739161 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837238528}
I20260709 13:20:19.729341 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2297) took 1946 ms. Trace:
I20260709 13:20:19.474370 19113 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:19.510072 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:19.742741 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 268321us
W20260709 13:20:19.744365 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 234221us
I20260709 13:20:19.741207 19063 rpcz_store.cc:276] 0709 13:20:17.784758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.362845 (+1578087us) service_pool.cc:224] Handling call
0709 13:20:19.363190 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.723558 (+360368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.728959 (+  5401us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001a9354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:19.729251 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824767872}
I20260709 13:20:19.728760 19071 rpcz_store.cc:276] 0709 13:20:17.825390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.726440 (+1901050us) service_pool.cc:224] Handling call
0709 13:20:19.726932 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.727984 (+  1052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.728247 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.518177 19144 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:19.772972 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33244 (request call id 573) took 1151 ms. Trace:
I20260709 13:20:19.773468 19144 rpcz_store.cc:276] 0709 13:20:18.621877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.912685 (+290808us) service_pool.cc:224] Handling call
0709 13:20:19.772590 (+859905us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54002b7ad4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.772762 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054503808}
I20260709 13:20:19.754602 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 570) took 2570 ms. Trace:
I20260709 13:20:19.775401 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2343) took 1931 ms. Trace:
I20260709 13:20:19.775251 19145 rpcz_store.cc:276] 0709 13:20:17.184171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.553139 (+1368968us) service_pool.cc:224] Handling call
0709 13:20:18.553428 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.553754 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.553781 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.554255 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.264824 (+710569us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:19.304537 (+ 39713us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.304725 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.304790 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.753839 (+449049us) raft_consensus.cc:1685] finished
0709 13:20:19.753898 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.754264 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36874,"prepare.queue_time_us":52647,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":16630,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":15213,"thread_start_us":670411,"threads_started":1,"wal-append.queue_time_us":756368}
I20260709 13:20:19.754683 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2418) took 2482 ms. Trace:
I20260709 13:20:19.754884 19140 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:19.482204 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:19.758492 19214 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:19.760762 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:19.519668 19217 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:19.825946 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:19.826951 19217 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:19.616092 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 140339us
I20260709 13:20:19.618039 19742 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:19.767167 19743 raft_consensus.cc:2368] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17.
I20260709 13:20:19.768006 19749 raft_consensus.cc:1240] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:20:19.767926 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2324) took 3752 ms. Trace:
I20260709 13:20:19.768278 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:19.769353 19219 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.769622 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:19.771225 19751 raft_consensus.cc:1240] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:19.723536 19064 rpcz_store.cc:276] 0709 13:20:18.510056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.058089 (+548033us) service_pool.cc:224] Handling call
0709 13:20:19.722538 (+664449us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54001b8354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.722723 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646060928}
I20260709 13:20:19.736707 19072 rpcz_store.cc:276] 0709 13:20:18.011562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.734812 (+1723250us) service_pool.cc:224] Handling call
0709 13:20:19.735310 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.736085 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.736294 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.778482 19146 rpcz_store.cc:276] 0709 13:20:17.271892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.950844 (+1678952us) service_pool.cc:224] Handling call
0709 13:20:18.965932 (+ 15088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.263764 (+297832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.754006 (+490242us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400327b54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:19.754403 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286861568}
I20260709 13:20:19.801245 23785 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:19.840330 23785 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.843772 23785 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.650447 23925 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.846758 23925 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.813226 23899 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:19.776050 19215 rpcz_store.cc:276] 0709 13:20:17.837387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.149438 (+312051us) service_pool.cc:224] Handling call
0709 13:20:19.545765 (+1396327us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540034b054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.768706 (+222941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872972032}
I20260709 13:20:19.849026 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:19.850633 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:19.813512 23624 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:19.814874 24054 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.863951 24054 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:19.816985 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 65369.7us
W20260709 13:20:19.866267 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.867347 24054 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:19.868014 24054 consensus_queue.cc:1059] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:19.817160 23934 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:19.869362 23934 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:19.817906 23768 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:19.830195 19213 rpcz_store.cc:276] 0709 13:20:16.015101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.246716 (+2231615us) service_pool.cc:224] Handling call
0709 13:20:18.307642 (+ 60926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.308104 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:18.308145 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.308644 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.806461 (+497817us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:18.806510 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.806583 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.339815 (+533232us) raft_consensus.cc:1685] finished
0709 13:20:19.339835 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.767276 (+427441us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b54001ea0d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:19.767697 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3907,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":18033,"spinlock_wait_cycles":139162496,"thread_start_us":497241,"threads_started":1,"wal-append.queue_time_us":937029}
I20260709 13:20:19.872812 23768 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:19.873335 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:19.874240 19213 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:19.874166 23768 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.875433 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:19.855159 19746 raft_consensus.cc:2393] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:19.869768 23899 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:19.872140 23934 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:19.877250 23899 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:20:19.877357 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 395097us
I20260709 13:20:19.878837 23899 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.880327 23899 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:19.882175 24050 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:19.885231 24140 consensus_queue.cc:1059] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:19.889392 24059 raft_consensus.cc:3055] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:19.889642 19714 leader_election.cc:400] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12.
I20260709 13:20:19.889832 24059 raft_consensus.cc:740] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:19.890128 19714 leader_election.cc:403] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:20:19.890892 19216 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:19.891171 24059 consensus_queue.cc:260] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:19.894682 23773 consensus_meta.cc:287] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.558s	user 0.015s	sys 0.000s
I20260709 13:20:19.895298 23773 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:19.910254 23814 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 11. Current term is 12.
W20260709 13:20:19.917523 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.919180 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:19.921667 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:19.922731 24053 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:19.923240 24053 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.923638 24053 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.925323 24103 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:19.876165 19213 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:19.934676 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:19.926041 24103 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:19.938342 19035 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:19.961572 19138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.021s
W20260709 13:20:19.962071 19138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.004s	sys 0.021s
I20260709 13:20:19.963444 23934 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:19.964295 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.964576 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.965004 23785 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:19.965770 19071 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:19.969239 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:19.969930 24059 raft_consensus.cc:3060] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.977396 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2396) took 1467 ms. Trace:
I20260709 13:20:19.977972 19071 rpcz_store.cc:276] 0709 13:20:18.509535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.832387 (+1322852us) service_pool.cc:224] Handling call
0709 13:20:19.955244 (+122857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.973031 (+ 17787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.977326 (+  4295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:19.945650 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:19.982163 19216 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:19.992718 19219 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:19.956282 24050 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:19.996529 19714 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:20.000375 19184 leader_election.cc:400] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:20.002521 19184 leader_election.cc:403] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:20:20.013054 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 75053.3us
I20260709 13:20:20.015421 23644 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:20.016508 23644 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:20.018651 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:20.017081 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:20.017154 23644 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:20.025990 23583 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:20.026737 23583 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.026886 23644 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.028266 23644 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:20.030339 19744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.053s
W20260709 13:20:20.030820 19744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.010s	sys 0.053s
I20260709 13:20:20.036362 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 710) took 3532 ms. Trace:
I20260709 13:20:20.036839 19220 rpcz_store.cc:276] 0709 13:20:16.504069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.058015 (+2553946us) service_pool.cc:224] Handling call
0709 13:20:19.058306 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.352688 (+294382us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:19.374321 (+ 21633us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.760138 (+385817us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.760463 (+   325us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.761365 (+   902us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.761533 (+   168us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:19.761567 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.761725 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.035914 (+274189us) raft_consensus.cc:1685] finished
0709 13:20:20.035931 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.036131 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":115533,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":48282,"raft.queue_time_us":394265,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":13490,"spinlock_wait_cycles":14276480,"thread_start_us":622287,"threads_started":2,"wal-append.queue_time_us":629250}
I20260709 13:20:20.039328 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:20.041505 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 100870us
I20260709 13:20:20.041635 24052 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.042593 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2162) took 3546 ms. Trace:
I20260709 13:20:20.042959 19214 rpcz_store.cc:276] 0709 13:20:16.496573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.903854 (+2407281us) service_pool.cc:224] Handling call
0709 13:20:18.904222 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.823942 (+919720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.042311 (+218369us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540024ca54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:20.042538 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963101568}
I20260709 13:20:20.044283 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:20.045586 19069 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:19.995564 23785 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:20.085561 23769 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:20.049682 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.087128 19220 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.087348 23769 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:20.087862 23769 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.089519 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 2420) took 2265 ms. Trace:
I20260709 13:20:20.090065 19138 rpcz_store.cc:276] 0709 13:20:17.823776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.059473 (+1235697us) service_pool.cc:224] Handling call
0709 13:20:19.070392 (+ 10919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.070578 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:19.375976 (+305398us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.001288 (+625312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.085095 (+ 83807us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:20.085197 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.089292 (+  4095us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.089455 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9891,"prepare.queue_time_us":14046,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3096,"raft.queue_time_us":27173,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":9735,"thread_start_us":880003,"threads_started":2}
I20260709 13:20:20.050124 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:20.093261 19069 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:20.094590 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:20.095911 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:20.051397 19064 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:20:20.072674 19217 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:20.097108 19214 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:20.097450 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:20.098169 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:20.098374 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:20.098896 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:20.099357 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.099640 19064 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:20.099992 23899 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.100471 23899 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.052451 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.100800 23899 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.101969 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.052196 24050 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.104593 24050 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:20.053773 23894 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.055604 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.106914 19145 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:20:20.107761 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.107882 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.056836 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.110740 23894 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.057801 19038 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:20.058785 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:20.112910 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 117104us
I20260709 13:20:20.113449 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.113802 19038 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:20.114683 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.115043 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:20.115885 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.059908 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.116678 23978 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:20.117162 23978 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:20.117448 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.117671 23978 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.118829 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.119493 23979 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.061380 19110 leader_election.cc:400] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17.
I20260709 13:20:20.058923 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:20.120436 19110 leader_election.cc:403] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:20.120844 19072 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:20.121017 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 59884.7us
I20260709 13:20:20.121479 24035 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:20.121984 24035 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:20.122398 24035 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.123270 24054 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.125622 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:20.126528 19145 raft_consensus.cc:2410] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:20.127883 19145 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:20.062211 19218 raft_consensus.cc:2410] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:20.063391 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.147408 19219 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.147020 18970 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 8 to 10, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.150408 24156 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:20.150558 24050 consensus_queue.cc:1059] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:20.151098 24156 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:20.151677 24156 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.152386 24050 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:20.065060 19221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.007s	sys 0.015s
I20260709 13:20:20.152805 24050 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:20:20.153092 19221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.008s	sys 0.015s
W20260709 13:20:20.152983 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 168275us
I20260709 13:20:20.154836 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:20.155339 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2163) took 3628 ms. Trace:
I20260709 13:20:20.065866 24103 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.155984 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:20.065521 23583 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:20.073028 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.073863 19717 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:20.100010 19214 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:20.076766 18969 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60506 (request call id 205) took 73515 ms (client timeout 15000 ms). Trace:
I20260709 13:20:20.077335 23944 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:20.078560 19139 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:20.171108 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.172148 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.080385 19143 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:20.081410 19140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2163) took 2901 ms. Trace:
I20260709 13:20:20.081553 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.057331 23773 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.111573 19147 raft_consensus.cc:2368] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13.
I20260709 13:20:20.119987 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:20.061301 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 81330.2us
I20260709 13:20:20.129523 23992 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:20.142499 19216 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:20.144413 24018 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:20.145723 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.112098 19213 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:20.175489 19141 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:20.151520 23624 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:20.067560 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 50582.2us
I20260709 13:20:20.097450 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.162364 19219 raft_consensus.cc:2468] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:20.166330 19072 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
W20260709 13:20:20.167883 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 94320.1us
I20260709 13:20:20.168848 23791 raft_consensus.cc:2804] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:20.159842 18969 rpcz_store.cc:269] 0709 13:19:06.561208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.562285 (+  1077us) service_pool.cc:224] Handling call
0709 13:20:20.076480 (+73514195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8891,"reported_tablets":44}
I20260709 13:20:20.155678 19221 rpcz_store.cc:276] 0709 13:20:16.526620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.119268 (+2592648us) service_pool.cc:224] Handling call
0709 13:20:19.119575 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.308412 (+188837us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:19.308780 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.656990 (+348210us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180038be40. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:20:20.154076 (+497086us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.154322 (+   246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.154374 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:20.154455 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.155093 (+   638us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540043a154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:20.155132 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.155285 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5326,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":47,"spinlock_wait_cycles":459397760,"thread_start_us":814168,"threads_started":1}
I20260709 13:20:20.176395 19220 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:20.195444 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:20.173005 19140 rpcz_store.cc:276] 0709 13:20:17.180367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.401308 (+1220941us) service_pool.cc:224] Handling call
0709 13:20:18.401644 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.830033 (+1428389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.081164 (+251131us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540017a2d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:20.081355 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110822656}
I20260709 13:20:20.198985 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.160240 18970 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.173596 23644 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:20.209337 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.210964 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:20.211494 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:20.202329 19214 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:20.085745 23785 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.201097 18970 catalog_manager.cc:5697] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 9 to 13, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 13 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.216954 19113 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:20.287012 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 74514.2us
I20260709 13:20:20.289736 19217 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.294373 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:20.214797 24018 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:20.294687 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:20.315272 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 107891us
I20260709 13:20:20.206506 24140 consensus_queue.cc:1059] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:20:20.216774 23791 raft_consensus.cc:697] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:20.323159 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.285552 23644 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:20.309959 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:20.360709 19215 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:20.359820 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:20.365232 19216 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
W20260709 13:20:20.369287 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 56543us
I20260709 13:20:20.371078 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.358670 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:20.352982 24053 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.374305 24053 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.373605 18970 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 6 to 11, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.375165 19071 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:20.322227 24054 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17.
I20260709 13:20:20.355125 23773 raft_consensus.cc:2804] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:20.400612 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 714) took 3895 ms. Trace:
I20260709 13:20:20.400823 24140 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.401372 24140 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.383699 18970 catalog_manager.cc:5697] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 8 to 10, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.401940 24140 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.402698 18970 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.405210 23624 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:20.405833 23624 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:20.405441 18970 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:20.406811 23624 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.407233 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:20.407856 23773 raft_consensus.cc:697] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:20.408636 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:20.409119 24053 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:20.408888 23773 consensus_queue.cc:237] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.409574 24053 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:20.409299 23644 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.410048 24053 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.407199 18970 catalog_manager.cc:5697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 6 to 7, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 7 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.412122 18970 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.413205 23791 consensus_queue.cc:237] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.414037 18970 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.401095 19212 rpcz_store.cc:276] 0709 13:20:16.505253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.112856 (+2607603us) service_pool.cc:224] Handling call
0709 13:20:19.118357 (+  5501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.118587 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:19.145614 (+ 27027us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.778659 (+633045us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b1800440fe0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:20:20.288533 (+509874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.313919 (+ 25386us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:20.322486 (+  8567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.366023 (+ 43537us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.400446 (+ 34423us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37415,"prepare.queue_time_us":26478,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":11822,"raft.queue_time_us":6386,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":25027,"spinlock_wait_cycles":14119808,"thread_start_us":422857,"threads_started":1,"wal-append.queue_time_us":1253077}
I20260709 13:20:20.415537 18970 catalog_manager.cc:5697] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 3 to 12, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 12 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.417270 18970 catalog_manager.cc:5697] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 4 to 11, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 11 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.418751 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 719) took 2241 ms. Trace:
I20260709 13:20:20.419184 19214 rpcz_store.cc:276] 0709 13:20:18.177381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.381414 (+2204033us) service_pool.cc:224] Handling call
0709 13:20:20.418206 (+ 36792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.418416 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.418439 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:20.418494 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:20.418522 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.418572 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.418677 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:20.419008 18970 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 5 to 8, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 8 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:20.421948 24160 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:20.423425 24053 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.424773 23944 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.425570 24053 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.425395 23944 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.424378 24140 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.427439 24053 raft_consensus.cc:2764] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:20.427603 23944 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:20.425045 18970 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.369032 23925 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:20.430984 19142 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:20.411042 24094 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.434340 19213 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:20.439725 19068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2382) took 2605 ms. Trace:
W20260709 13:20:20.448009 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49673.2us
I20260709 13:20:20.451105 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2341) took 2704 ms. Trace:
I20260709 13:20:20.451551 19213 rpcz_store.cc:276] 0709 13:20:17.736140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.322599 (+2586459us) service_pool.cc:224] Handling call
0709 13:20:20.434155 (+111556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.440393 (+  6238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.440621 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:20.442139 19221 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:20.449808 18970 catalog_manager.cc:5697] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 5 to 8, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 8 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.470868 19220 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:20:20.449819 24113 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:20.445545 19068 rpcz_store.cc:276] 0709 13:20:17.824074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.725651 (+1901577us) service_pool.cc:224] Handling call
0709 13:20:19.726180 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.726774 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.726799 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.727792 (+   993us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.954954 (+227162us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:19.955007 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.955100 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.429626 (+474526us) raft_consensus.cc:1685] finished
0709 13:20:20.429654 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.429807 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80029,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":260,"thread_start_us":226616,"threads_started":1,"wal-append.queue_time_us":482068}
I20260709 13:20:20.482252 19184 leader_election.cc:400] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:20.437790 24140 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.471365 19220 pending_rounds.cc:85] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 8
I20260709 13:20:20.478222 23894 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:20.480374 23938 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.449987 23887 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.467371 18970 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 5 to 9, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 9 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.477699 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:20.481110 24094 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.370297 24050 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.487175 19216 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.483762 19220 pending_rounds.cc:107] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:20:20.491263 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.491637 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:20.503062 19220 raft_consensus.cc:2889] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.503305 19213 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.459128 23899 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.501801 19215 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:20.482039 24113 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:20.498836 23979 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:20.512930 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 718) took 2332 ms. Trace:
I20260709 13:20:20.513391 19215 rpcz_store.cc:276] 0709 13:20:18.176539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.366657 (+2190118us) service_pool.cc:224] Handling call
0709 13:20:20.461541 (+ 94884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.508725 (+ 47184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.508977 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:20.561985 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.565356 18970 catalog_manager.cc:5697] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.590852 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.591508 19215 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.486649 24018 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.606825 23899 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.607697 19146 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:20:20.608892 24154 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:20:20.482014 23769 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.611187 23769 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.612175 24113 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:20.613250 24159 log.cc:927] Time spent T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:20:20.614512 23860 consensus_meta.cc:287] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 1.047s	user 0.011s	sys 0.007s
I20260709 13:20:20.615131 19144 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:20.615641 24094 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:20.617733 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.620868 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:20.511704 23894 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.622328 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:20.623121 23894 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:20.511519 24029 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:20.624053 24029 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.626322 24029 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:20.710669 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 237236us
I20260709 13:20:20.488848 24156 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:20.711611 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:20.715227 24156 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:20.720206 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2347) took 2837 ms. Trace:
I20260709 13:20:20.720695 19220 rpcz_store.cc:276] 0709 13:20:17.862293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.365817 (+2503524us) service_pool.cc:224] Handling call
0709 13:20:20.381260 (+ 15443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.699026 (+317766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.699203 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:20.616389 23978 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.725685 18970 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 1 to 12, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 12 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:20.741080 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:20.741801 19220 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.702828 23583 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:20.747313 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.748955 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.504853 23938 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.755151 19217 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:20.759159 19212 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:20.736200 24050 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.763604 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:20.746094 24161 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:20:20.732448 24156 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:20:20.785938 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 74420.5us
W20260709 13:20:20.787647 19066 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.064s	sys 0.154s
I20260709 13:20:20.786738 19217 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:20.738312 24029 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:20.786175 19068 raft_consensus.cc:1240] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:20.802762 19066 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.064s	sys 0.156s
I20260709 13:20:20.749475 23583 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:20.860916 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2388) took 2956 ms. Trace:
W20260709 13:20:20.860839 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 462611us
W20260709 13:20:20.861953 19067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.010s	sys 0.015s
W20260709 13:20:20.896706 19067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.010s	sys 0.015s
I20260709 13:20:20.832216 18970 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 3 to 8, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 8 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:20.802955 19064 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.006s	sys 0.019s
W20260709 13:20:20.897758 19064 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.007s	sys 0.019s
W20260709 13:20:20.877530 19063 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.005s	sys 0.005s
W20260709 13:20:20.868485 19070 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.003s	sys 0.007s
W20260709 13:20:20.898402 19063 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.005s
W20260709 13:20:20.898456 19070 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.003s	sys 0.008s
W20260709 13:20:20.879132 19065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.033s	sys 0.041s
W20260709 13:20:20.899159 19065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.033s	sys 0.042s
W20260709 13:20:20.801712 24103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.013s	sys 0.039s
W20260709 13:20:20.868953 19069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.074s	sys 0.081s
W20260709 13:20:20.905037 19069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.074s	sys 0.081s
W20260709 13:20:20.906997 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 581305us
W20260709 13:20:20.906347 19110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.016s
W20260709 13:20:20.918059 19110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.009s	sys 0.016s
I20260709 13:20:20.911302 19218 raft_consensus.cc:1217] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[11.7-15.9]   Dedup: 11.7->[13.8-15.9]
I20260709 13:20:20.922538 19218 pending_rounds.cc:85] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:20.922840 19218 pending_rounds.cc:107] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:20.923123 19218 raft_consensus.cc:2889] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:20.902558 24103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.013s	sys 0.039s
I20260709 13:20:20.933967 19220 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:20.935582 19215 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:20.937083 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 598) took 2522 ms. Trace:
I20260709 13:20:20.935205 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:20.943555 18970 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.931227 19216 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:20.945679 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2177) took 2535 ms. Trace:
I20260709 13:20:20.946220 19216 rpcz_store.cc:276] 0709 13:20:18.410273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.397332 (+1987059us) service_pool.cc:224] Handling call
0709 13:20:20.467551 (+ 70219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.945349 (+477798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.945613 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:20.938228 19063 rpcz_store.cc:276] 0709 13:20:18.414247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.746217 (+1331970us) service_pool.cc:224] Handling call
0709 13:20:19.746852 (+   635us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:19.747600 (+   748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.747652 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:19.748648 (+   996us) log.cc:844] Serialized 52 byte log entry
0709 13:20:19.870012 (+121364us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b180045a540. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:20:20.312458 (+442446us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:20.903762 (+591304us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.916632 (+ 12870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.916702 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.916737 (+    35us) raft_consensus.cc:1685] finished
0709 13:20:20.933753 (+ 17016us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.937026 (+  3273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12612,"prepare.queue_time_us":166942,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":88495,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":6246,"spinlock_wait_cycles":33002752,"thread_start_us":1012176,"threads_started":2,"wal-append.queue_time_us":633164}
W20260709 13:20:20.933488 23965 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.017s
I20260709 13:20:20.954165 18970 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 7 to 13, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:20.953171 24035 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.830s	user 0.007s	sys 0.007s
W20260709 13:20:20.964013 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 673792us
W20260709 13:20:20.959776 23791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.026s	sys 0.041s
W20260709 13:20:20.960593 23965 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.007s	sys 0.017s
W20260709 13:20:20.961973 23644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.023s
W20260709 13:20:20.961386 24052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.025s	sys 0.079s
I20260709 13:20:20.968659 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:20.974397 24157 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.005s	sys 0.018s
W20260709 13:20:20.974792 24157 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.005s	sys 0.018s
W20260709 13:20:20.975471 23790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.008s	sys 0.015s
W20260709 13:20:20.975879 23790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.008s	sys 0.015s
I20260709 13:20:20.976735 23925 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.977195 24056 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.979553 19744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42932 (request call id 670) took 1512 ms. Trace:
I20260709 13:20:20.895357 19066 rpcz_store.cc:276] 0709 13:20:17.867418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.732006 (+1864588us) service_pool.cc:224] Handling call
0709 13:20:19.732590 (+   584us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:19.733761 (+  1171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.733792 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:19.734619 (+   827us) log.cc:844] Serialized 52 byte log entry
0709 13:20:19.953399 (+218780us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:20.821534 (+868135us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.822976 (+  1442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.823074 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.823128 (+    54us) raft_consensus.cc:1685] finished
0709 13:20:20.823146 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.823317 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":525398,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":28,"raft.queue_time_us":104445,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":42030,"thread_start_us":1078679,"threads_started":2,"wal-append.queue_time_us":315230}
I20260709 13:20:20.960323 23894 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:20.977288 23925 raft_consensus.cc:3060] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.986699 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.986966 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:20.987756 24059 consensus_meta.cc:287] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.996s	user 0.011s	sys 0.001s
I20260709 13:20:20.967918 24035 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.988255 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:20.967530 23583 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:20.990391 24035 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:20.968994 23791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.026s	sys 0.041s
I20260709 13:20:20.979939 19744 rpcz_store.cc:276] 0709 13:20:19.467395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.467543 (+   148us) service_pool.cc:224] Handling call
0709 13:20:19.467932 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.031278 (+563346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.031346 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:20.032174 (+   828us) log.cc:844] Serialized 52 byte log entry
0709 13:20:20.381995 (+349821us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:20.382049 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.398651 (+ 16602us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.979335 (+580684us) raft_consensus.cc:1685] finished
0709 13:20:20.979353 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.979479 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33857,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":6338,"thread_start_us":912118,"threads_started":2,"wal-append.queue_time_us":868478}
I20260709 13:20:20.988194 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:20.970412 23644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.008s	sys 0.023s
I20260709 13:20:20.992362 19213 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
W20260709 13:20:21.005219 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.007140 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 722) took 2476 ms. Trace:
I20260709 13:20:21.007608 19220 rpcz_store.cc:276] 0709 13:20:18.530458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.944385 (+2413927us) service_pool.cc:224] Handling call
0709 13:20:20.966917 (+ 22532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.982716 (+ 15799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.982755 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.001121 (+ 18366us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.006887 (+  5766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.006959 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.007073 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:21.013010 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 115076us
I20260709 13:20:21.007582 23899 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:21.016423 19142 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:20:21.017944 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 4a5c24584b054af68fe8fe327bad2e5b: Illegal state: Replica 0f833abfb3544031bee566e655b7fedc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:21.019024 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 597) took 2605 ms. Trace:
I20260709 13:20:21.019392 19067 rpcz_store.cc:276] 0709 13:20:18.413919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.740501 (+1326582us) service_pool.cc:224] Handling call
0709 13:20:19.780180 (+ 39679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.950654 (+170474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.950702 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.995911 (+ 45209us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.897139 (+901228us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:20.933784 (+ 36645us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.935949 (+  2165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.936040 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.018816 (+ 82776us) raft_consensus.cc:1685] finished
0709 13:20:21.018834 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.018967 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1874,"prepare.queue_time_us":36773,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":21886,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":26090,"thread_start_us":835101,"threads_started":1,"wal-append.queue_time_us":954787}
I20260709 13:20:20.991707 23978 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:21.027509 23887 consensus_meta.cc:287] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:20:21.028563 19216 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:21.029382 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2360) took 2479 ms. Trace:
I20260709 13:20:21.029796 19216 rpcz_store.cc:276] 0709 13:20:18.549699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.963852 (+2414153us) service_pool.cc:224] Handling call
0709 13:20:20.972638 (+  8786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.029062 (+ 56424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.029320 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:21.033473 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 67579.3us
I20260709 13:20:21.038982 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2300) took 3253 ms. Trace:
I20260709 13:20:21.033109 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.036031 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2310) took 2838 ms. Trace:
I20260709 13:20:21.040712 19743 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:21.041363 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.032928 24156 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.033867 23899 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:21.047591 24156 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.048393 23899 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.049924 24156 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:21.053543 19216 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:21.054188 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2185) took 2429 ms. Trace:
I20260709 13:20:21.054499 19216 rpcz_store.cc:276] 0709 13:20:18.624318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.030709 (+2406391us) service_pool.cc:224] Handling call
0709 13:20:21.053165 (+ 22456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.053932 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.054116 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.057186 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:21.058148 23644 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.059494 19035 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.061261 23978 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:21.061648 24184 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.035686 23843 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.062281 24184 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.065109 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 716) took 2889 ms. Trace:
I20260709 13:20:21.066787 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.067448 23938 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:21.046835 24059 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:21.067515 19746 raft_consensus.cc:2393] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:21.068426 24059 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.062718 24072 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.064607 24184 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.067384 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:20.973299 24052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.025s	sys 0.080s
I20260709 13:20:21.070188 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.066385 19219 rpcz_store.cc:276] 0709 13:20:18.175880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.367187 (+2191307us) service_pool.cc:224] Handling call
0709 13:20:20.382592 (+ 15405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.455950 (+ 73358us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:20.951661 (+495711us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.046986 (+ 95325us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.047216 (+   230us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.047376 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.064902 (+ 17526us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.065048 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30173,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":13405,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":106,"thread_start_us":522597,"threads_started":2}
I20260709 13:20:21.037549 23887 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:20.982349 19215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c875508da24d49ae8496600c3e674b63"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:21.076917 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.077407 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2349) took 2585 ms. Trace:
I20260709 13:20:21.078800 19138 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:21.077687 19742 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:21.080495 19215 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:21.081110 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.081525 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.081799 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2187) took 2456 ms. Trace:
I20260709 13:20:21.082165 19220 rpcz_store.cc:276] 0709 13:20:18.625437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.034465 (+2409028us) service_pool.cc:224] Handling call
0709 13:20:21.073603 (+ 39138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.081491 (+  7888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.081514 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.081554 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:21.081606 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.081658 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.081754 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.083204 24180 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:20:21.040735 19065 rpcz_store.cc:276] 0709 13:20:18.197722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.735901 (+1538179us) service_pool.cc:224] Handling call
0709 13:20:19.736328 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.736812 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:20.192606 (+455794us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.035161 (+842555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.035228 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:21.035272 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.035845 (+   573us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.035980 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6501,"prepare.queue_time_us":741626,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":17280,"spinlock_wait_cycles":4746496,"thread_start_us":1181132,"threads_started":3,"wal-append.queue_time_us":749131}
I20260709 13:20:21.085281 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.080945 19215 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.088088 24180 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:21.088500 24180 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.088892 24180 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.087365 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.080864 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.042063 19070 rpcz_store.cc:276] 0709 13:20:17.785793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.477043 (+1691250us) service_pool.cc:224] Handling call
0709 13:20:19.504362 (+ 27319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:19.504763 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.504804 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:19.505522 (+   718us) log.cc:844] Serialized 52 byte log entry
0709 13:20:19.998330 (+492808us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:20.898839 (+900509us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.038553 (+139714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.038683 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.038735 (+    52us) raft_consensus.cc:1685] finished
0709 13:20:21.038756 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.038927 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":318820,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":37,"raft.queue_time_us":23598,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":16285,"thread_start_us":1080490,"threads_started":3,"wal-append.queue_time_us":623872}
I20260709 13:20:21.078806 19217 rpcz_store.cc:276] 0709 13:20:18.491955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.804550 (+2312595us) service_pool.cc:224] Handling call
0709 13:20:20.916232 (+111682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.956611 (+ 40379us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:20.970473 (+ 13862us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.077102 (+106629us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.077148 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:21.077186 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.077245 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.077356 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8488,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":87281,"threads_started":1}
W20260709 13:20:21.094105 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 82302.5us
I20260709 13:20:21.094769 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:21.036943 23894 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.080852 23978 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.098085 24184 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.099787 24179 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.099607 19215 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.102586 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.103771 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.101753 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.107352 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.109884 19146 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.100097 24184 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.108640 19143 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:21.109048 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.113535 19215 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:21.114141 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40764 (request call id 2356) took 2616 ms. Trace:
I20260709 13:20:21.114519 19215 rpcz_store.cc:276] 0709 13:20:18.497364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.950631 (+2453267us) service_pool.cc:224] Handling call
0709 13:20:21.114030 (+163399us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5914}
I20260709 13:20:21.115821 19215 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 16. Ops: []
I20260709 13:20:21.116493 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2366) took 1358 ms. Trace:
I20260709 13:20:21.116858 19215 rpcz_store.cc:276] 0709 13:20:19.758489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.115373 (+1356884us) service_pool.cc:224] Handling call
0709 13:20:21.115653 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.116242 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.116421 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.124768 19217 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:21.109026 24166 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:20:21.130039 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.131590 23894 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.131781 24059 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.133558 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:21.134552 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.134474 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2348) took 2642 ms. Trace:
I20260709 13:20:21.111370 23791 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:21.138145 23925 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.146503 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2190) took 1659 ms. Trace:
W20260709 13:20:21.151062 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.118897 24184 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.157702 19215 raft_consensus.cc:3055] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:20:21.164569 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 57344.7us
I20260709 13:20:21.164885 19215 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:21.159071 19217 rpcz_store.cc:276] 0709 13:20:19.487034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.096845 (+1609811us) service_pool.cc:224] Handling call
0709 13:20:21.112949 (+ 16104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.146195 (+ 33246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.146436 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.167596 19035 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.121345 24052 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.165819 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:21.169093 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 116228us
I20260709 13:20:21.154763 19218 rpcz_store.cc:276] 0709 13:20:18.491628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.717688 (+2226060us) service_pool.cc:224] Handling call
0709 13:20:20.800572 (+ 82884us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:20.949782 (+149210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:20.949836 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:20.962390 (+ 12554us) log.cc:844] Serialized 52 byte log entry
0709 13:20:21.038972 (+ 76582us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:21.039005 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.039068 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.134273 (+ 95205us) raft_consensus.cc:1685] finished
0709 13:20:21.134293 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.134421 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8230,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11594,"thread_start_us":32146,"threads_started":1,"wal-append.queue_time_us":133431}
I20260709 13:20:21.173031 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.156522 24050 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:21.169883 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.176717 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 727) took 1681 ms. Trace:
I20260709 13:20:21.177089 19219 rpcz_store.cc:276] 0709 13:20:19.495272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.098476 (+1603204us) service_pool.cc:224] Handling call
0709 13:20:21.158009 (+ 59533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.176502 (+ 18493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.176522 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.176551 (+    29us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:21.176571 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.176611 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.176680 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2442}
I20260709 13:20:21.178213 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.179323 19145 raft_consensus.cc:2410] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:20:21.183465 19218 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:21.170192 24052 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.188139 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.189134 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2367) took 1284 ms. Trace:
I20260709 13:20:21.189379 19218 rpcz_store.cc:276] 0709 13:20:19.901776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.172240 (+1270464us) service_pool.cc:224] Handling call
0709 13:20:21.181850 (+  9610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.185630 (+  3780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.185799 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:21.185508 19184 connection.cc:256] RPC call timeout handler was delayed by -2.1454124819999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:20:21.181115 23992 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.186813 19215 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.194852 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.193717 19219 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.193715 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 728) took 1431 ms. Trace:
I20260709 13:20:21.195670 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2199) took 1253 ms. Trace:
I20260709 13:20:21.195544 19217 rpcz_store.cc:276] 0709 13:20:19.762680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.167668 (+1404988us) service_pool.cc:224] Handling call
0709 13:20:21.174395 (+  6727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.190346 (+ 15951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.190370 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.190409 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.193497 (+  3088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.193565 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.193661 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.196362 19219 rpcz_store.cc:276] 0709 13:20:19.942292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.186558 (+1244266us) service_pool.cc:224] Handling call
0709 13:20:21.193552 (+  6994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.195457 (+  1905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.195615 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.199433 19218 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.185539 24052 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:21.200510 19184 connection.cc:256] RPC call timeout handler was delayed by -1.9231124820000787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2429s for a response
W20260709 13:20:21.200927 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7702117480000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:20:21.201278 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7477117480000288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:20:21.201453 19184 connection.cc:256] RPC call timeout handler was delayed by -1.7198117479999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:20:21.201606 19184 connection.cc:256] RPC call timeout handler was delayed by -1.6640117479998935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:20:21.201870 19184 connection.cc:256] RPC call timeout handler was delayed by -1.5524117479999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:20:21.202451 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2200) took 1259 ms. Trace:
I20260709 13:20:21.202729 19218 rpcz_store.cc:276] 0709 13:20:19.942638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.189850 (+1247212us) service_pool.cc:224] Handling call
0709 13:20:21.195519 (+  5669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.202286 (+  6767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.202414 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.208377 23978 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.208966 24196 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:21.209964 24186 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:21.210363 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.211385 19745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 609) took 2833 ms. Trace:
I20260709 13:20:21.210390 24186 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:21.227917 19215 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.218828 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.231055 19146 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
W20260709 13:20:21.218317 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 116637us
I20260709 13:20:21.247085 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.243438 23992 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:21.261811 24195 log.cc:927] Time spent T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:21.216732 23785 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:20:21.266268 19071 raft_consensus.cc:1240] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:21.211736 19745 rpcz_store.cc:276] 0709 13:20:18.377585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.377714 (+   129us) service_pool.cc:224] Handling call
0709 13:20:18.385620 (+  7906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.491350 (+105730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.491379 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.495272 (+  3893us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.586205 (+1090933us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b1800408880. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:20:20.032967 (+446762us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:20.503485 (+470518us) log.cc:844] Serialized 14 byte log entry
0709 13:20:20.507743 (+  4258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.210949 (+703206us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54005fcdd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:21.210997 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.211038 (+    41us) raft_consensus.cc:1685] finished
0709 13:20:21.211048 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.211212 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":384115,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":14909,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":110722,"spinlock_wait_cycles":327031424,"thread_start_us":883867,"threads_started":2,"wal-append.queue_time_us":1867943}
I20260709 13:20:21.262035 23992 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.262593 23790 consensus_queue.cc:1059] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:21.223783 23925 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.269622 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2203) took 1326 ms. Trace:
I20260709 13:20:21.269940 19218 rpcz_store.cc:276] 0709 13:20:19.943624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.203263 (+1259639us) service_pool.cc:224] Handling call
0709 13:20:21.203450 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.260599 (+ 57149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.260627 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.269390 (+  8763us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:21.269433 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.269483 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.269575 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.270987 19140 raft_consensus.cc:2468] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:21.215718 24186 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.273708 19219 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:21.274246 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2202) took 1331 ms. Trace:
I20260709 13:20:21.274485 19219 rpcz_store.cc:276] 0709 13:20:19.943286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.197369 (+1254083us) service_pool.cc:224] Handling call
0709 13:20:21.215135 (+ 17766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.274074 (+ 58939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.274209 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.277400 23934 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:21.277833 23934 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:21.279424 23934 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.280613 23934 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.282262 23992 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.279915 24113 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.285555 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:21.289888 24205 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:20:21.290252 24197 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:21.284971 24180 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.291478 19744 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:21.291631 19035 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.292747 23785 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.293112 24180 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.293444 23785 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.294384 23785 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.233088 23768 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.297078 24197 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:21.297401 19147 raft_consensus.cc:2468] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:21.243714 24072 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:20:21.297600 24197 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.299633 24197 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:21.300168 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.301023 24005 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:21.301389 24005 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:21.301429 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.302039 24054 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:21.302318 19071 raft_consensus.cc:2393] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:21.302583 24054 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.296504 19038 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:21.303402 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.288719 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2374) took 1245 ms. Trace:
I20260709 13:20:21.310552 19218 rpcz_store.cc:276] 0709 13:20:20.042858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.270508 (+1227650us) service_pool.cc:224] Handling call
0709 13:20:21.270694 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.288321 (+ 17627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.288348 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.288504 (+   156us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:21.288532 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.288582 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.288671 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.286923 19072 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:20:21.320820 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.323187 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.349383 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.349745 19113 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.350214 19072 raft_consensus.cc:2410] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:21.305313 24054 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.302387 24005 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.357877 24005 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.297194 23768 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.361258 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.362013 19072 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:21.362818 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.363121 23768 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.363399 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.364032 19142 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:21.364238 23860 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:21.299650 23944 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:21.365368 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:21.363909 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.321784 24072 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.269250 24184 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.373318 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.380865 23992 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:20:21.390894 24196 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:21.393472 24196 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:21.393875 23843 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:21.394578 24072 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:21.394444 24196 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.371043 23644 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:21.396207 23992 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:21.396656 19035 leader_election.cc:400] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13.
I20260709 13:20:21.381264 24054 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:21.396991 19035 leader_election.cc:403] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:20:21.398540 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.385414 24200 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:20:21.386150 24056 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:21.387364 24035 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:21.337637 24180 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:21.389262 23785 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.389461 24053 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:21.377354 23978 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:21.393780 24018 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:21.395542 24072 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.382650 23944 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:21.400007 19140 raft_consensus.cc:1240] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.400588 24029 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13.
I20260709 13:20:21.388101 23841 consensus_queue.cc:1059] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:20:21.444641 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 53805.9us
I20260709 13:20:21.369699 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.410693 19215 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:21.416535 23978 consensus_queue.cc:1243] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:21.418614 24180 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.419883 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:21.394465 23843 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.396497 23644 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.424115 23769 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.463249 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.416776 23899 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:20:21.424811 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.464258 19065 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:21.422334 24054 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:21.393482 24184 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.425280 24203 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.425808 23785 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:21.396683 23992 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:21.470894 24054 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.429294 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.428133 23860 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:21.444084 24186 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.471702 23992 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.472626 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.473299 19069 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:21.473558 24186 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:21.474205 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.474501 23925 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:21.474839 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2375) took 1424 ms. Trace:
I20260709 13:20:21.475226 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.475088 23925 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.476346 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.477288 23925 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:21.475256 19221 rpcz_store.cc:276] 0709 13:20:20.050772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.283217 (+1232445us) service_pool.cc:224] Handling call
0709 13:20:21.283521 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.283713 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:21.284012 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.474380 (+190368us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.474554 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.474595 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:21.474633 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.474689 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.474790 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118702,"prepare.queue_time_us":2293,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"thread_start_us":67092,"threads_started":1,"wal-append.queue_time_us":99981}
I20260709 13:20:21.478718 19071 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:21.479161 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:21.429816 24050 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:21.427838 24197 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.431964 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.482940 19066 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:21.482008 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 96241us
I20260709 13:20:21.432914 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.432962 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 726) took 1958 ms. Trace:
I20260709 13:20:21.437513 23944 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.438987 19067 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:21.483901 19216 rpcz_store.cc:276] 0709 13:20:19.474496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.055403 (+1580907us) service_pool.cc:224] Handling call
0709 13:20:21.055796 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.073864 (+ 18068us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:21.073897 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.095531 (+ 21634us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.183724 (+ 88193us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:21.183777 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.183865 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.432720 (+248855us) raft_consensus.cc:1685] finished
0709 13:20:21.432742 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.432904 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13543,"raft.queue_time_us":20895,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":16001,"thread_start_us":87830,"threads_started":1,"wal-append.queue_time_us":225983}
I20260709 13:20:21.432860 24052 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.441742 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.441898 24056 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.442085 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2361) took 2892 ms. Trace:
I20260709 13:20:21.436784 19070 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:21.404251 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:21.488260 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.448242 19218 raft_consensus.cc:2393] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:21.446157 19215 pending_rounds.cc:85] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 6
I20260709 13:20:21.489549 19215 pending_rounds.cc:107] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:21.490070 19215 raft_consensus.cc:2889] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.488095 19213 rpcz_store.cc:276] 0709 13:20:18.550003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.006692 (+2456689us) service_pool.cc:224] Handling call
0709 13:20:21.047035 (+ 40343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.092842 (+ 45807us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:21.109567 (+ 16725us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.183159 (+ 73592us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.307523 (+124364us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b1800346120. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d522 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:20:21.441236 (+133713us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800346120. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f6103582060 00007f6103594716 00007f61035a5287 00007f61035a5208
0709 13:20:21.441624 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.441787 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.441830 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:21.441874 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.441933 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.442033 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140075,"prepare.queue_time_us":10677,"prepare.run_cpu_time_us":157,"prepare.run_wall_time_us":4457,"raft.queue_time_us":269595,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":7076,"spinlock_wait_cycles":12184192,"thread_start_us":42572,"threads_started":1,"wal-append.queue_time_us":146647}
I20260709 13:20:21.465770 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2184) took 3014 ms. Trace:
W20260709 13:20:21.469463 19184 connection.cc:256] RPC call timeout handler was delayed by -1.3832117479998942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 13:20:21.470752 24203 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.494755 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2183) took 3082 ms. Trace:
I20260709 13:20:21.495159 19212 rpcz_store.cc:276] 0709 13:20:18.412228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.415183 (+2002955us) service_pool.cc:224] Handling call
0709 13:20:20.756413 (+341230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.766100 (+  9687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.494584 (+728484us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400003050. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:21.494707 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783926016}
I20260709 13:20:21.473312 23992 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.481398 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 730) took 1435 ms. Trace:
I20260709 13:20:21.481288 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.483934 19068 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.502733 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2197) took 1741 ms. Trace:
I20260709 13:20:21.501048 19219 rpcz_store.cc:276] 0709 13:20:20.045831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.275015 (+1229184us) service_pool.cc:224] Handling call
0709 13:20:21.320052 (+ 45037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.322519 (+  2467us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:21.323404 (+   885us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.480433 (+157029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.480498 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.481175 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.481237 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.481347 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88793,"prepare.queue_time_us":626,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":88912,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4046,"spinlock_wait_cycles":9348480,"thread_start_us":67266,"threads_started":1,"wal-append.queue_time_us":88398}
W20260709 13:20:21.491025 19184 connection.cc:256] RPC call timeout handler was delayed by -1.3597124820000772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30550000000000005s for a response
W20260709 13:20:21.490818 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 91548.5us
I20260709 13:20:21.430423 24179 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.510478 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.511245 19067 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.490949 19214 rpcz_store.cc:276] 0709 13:20:18.451048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.420186 (+1969138us) service_pool.cc:224] Handling call
0709 13:20:20.420539 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.420825 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:20.452869 (+ 32044us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.239627 (+786758us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b180021ef20. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:20:21.465472 (+225845us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.465522 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:21.465559 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.465617 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.465719 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40576,"prepare.queue_time_us":20532,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":68114,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":7603584,"thread_start_us":166323,"threads_started":1,"wal-append.queue_time_us":912015}
I20260709 13:20:21.498342 23785 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:21.499187 19220 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
W20260709 13:20:21.499825 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50953.7us
I20260709 13:20:21.503110 19215 rpcz_store.cc:276] 0709 13:20:19.768677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.117828 (+1349151us) service_pool.cc:224] Handling call
0709 13:20:21.145645 (+ 27817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.502505 (+356860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.502681 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:21.503801 19184 connection.cc:256] RPC call timeout handler was delayed by -1.2598124819999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3166s for a response
W20260709 13:20:21.515813 19184 connection.cc:256] RPC call timeout handler was delayed by -1.2598124819999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3166s for a response
W20260709 13:20:21.516244 19184 connection.cc:256] RPC call timeout handler was delayed by -1.1438117479999619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 13:20:21.501266 19065 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.507372 23894 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.488807 23899 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:21.509166 24052 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.522856 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:21.515655 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.515761 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.468971 23934 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.508430 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:21.468418 23769 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:21.521720 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 152079us
I20260709 13:20:21.521960 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.525574 19215 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.525697 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:21.522863 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.525760 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.518149 23944 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.527715 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.528800 19214 raft_consensus.cc:2393] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:21.530282 24029 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.532089 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.536996 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:21.537883 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.538249 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:21.539389 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.519937 23785 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.540297 24113 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.540784 24113 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:21.541172 24113 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.542948 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:21.545738 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.550446 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.550277 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.554975 19065 raft_consensus.cc:2410] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:20:21.556792 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.558441 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.568166 19215 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:21.521803 23860 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.521557 23899 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:21.499325 24056 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.522027 24050 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.563715 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.572453 19214 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:21.573612 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.574414 19219 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:21.575268 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.577191 19216 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.580040 19138 raft_consensus.cc:1240] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.581557 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2376) took 1526 ms. Trace:
I20260709 13:20:21.581938 19216 rpcz_store.cc:276] 0709 13:20:20.055163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.546309 (+1491146us) service_pool.cc:224] Handling call
0709 13:20:21.576961 (+ 30652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.581236 (+  4275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.581488 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.582542 19139 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.581585 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.583519 19147 raft_consensus.cc:2410] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:21.585487 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2381) took 1441 ms. Trace:
I20260709 13:20:21.587005 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:21.586058 19214 rpcz_store.cc:276] 0709 13:20:20.144230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.531726 (+1387496us) service_pool.cc:224] Handling call
0709 13:20:21.572197 (+ 40471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.580539 (+  8342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.585415 (+  4876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.588891 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2382) took 1444 ms. Trace:
I20260709 13:20:21.589365 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:21.589290 19219 rpcz_store.cc:276] 0709 13:20:20.144510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.533616 (+1389106us) service_pool.cc:224] Handling call
0709 13:20:21.574184 (+ 40568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.588620 (+ 14436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.588822 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.591405 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.569795 23887 raft_consensus.cc:2764] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:21.561111 23938 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.600960 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2206) took 1109 ms. Trace:
I20260709 13:20:21.595167 19749 raft_consensus.cc:2410] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:20:21.596907 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 71253us
I20260709 13:20:21.601444 19220 rpcz_store.cc:276] 0709 13:20:20.492052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.564474 (+1072422us) service_pool.cc:224] Handling call
0709 13:20:21.584765 (+ 20291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.600548 (+ 15783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.600586 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.600640 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:21.600683 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.600756 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.600897 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:21.602276 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.570076 24094 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.524832 23894 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:21.608683 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69362us
I20260709 13:20:21.580183 24052 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.579360 24186 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.606900 19714 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.608336 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.562388 24029 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.640208 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:21.594273 24219 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.608258 23791 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:21.525295 24179 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.588940 24050 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:21.653681 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.653134 19069 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:21.659155 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.659744 19065 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 11.
I20260709 13:20:21.660338 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:21.666251 19221 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:21.644532 23769 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.670962 19146 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:21.670259 19068 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:21.672684 19215 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.628857 23860 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:21.674647 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 67812.2us
W20260709 13:20:21.676455 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 70729.9us
I20260709 13:20:21.680263 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.652767 24180 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.680907 19065 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:21.681865 23644 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.684530 24185 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:21.685043 24185 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:21.685644 24056 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.686061 24185 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.687453 24185 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.648205 24219 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.696547 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:21.697675 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2372) took 1720 ms. Trace:
I20260709 13:20:21.697789 23785 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.698547 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:21.699764 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:21.701052 23887 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:21.701166 23925 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:21.701465 23887 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.701597 23925 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.701934 23887 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:21.701968 23925 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.704033 24094 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.705847 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:21.706874 23934 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.707222 23934 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.707605 23934 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.709949 23860 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.711095 19064 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:21.712127 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:21.712697 19064 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:21.712738 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:21.716328 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.718178 19145 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:21.672369 24186 raft_consensus.cc:2804] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:21.718335 19063 raft_consensus.cc:3055] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:21.749730 19063 raft_consensus.cc:740] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:21.698138 19217 rpcz_store.cc:276] 0709 13:20:19.976821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.214828 (+1238007us) service_pool.cc:224] Handling call
0709 13:20:21.260502 (+ 45674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.443626 (+183124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.443657 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.444090 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.558864 (+114774us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:21.558898 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.559135 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.697388 (+138253us) raft_consensus.cc:1685] finished
0709 13:20:21.697414 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.697593 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170286,"raft.queue_time_us":170463,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"thread_start_us":114442,"threads_started":1,"wal-append.queue_time_us":160979}
I20260709 13:20:21.733434 19714 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:21.753437 19066 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:21.755056 19215 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:20:21.758879 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 6a9f9257bc714987a2bba35964a315cf: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:20:21.759856 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.753707 19063 consensus_queue.cc:260] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.766742 19220 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:21.768324 19065 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:21.715410 24140 raft_consensus.cc:3055] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:21.718389 24157 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.714282 24050 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.773991 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:21.715989 24029 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.777935 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:21.762785 24156 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.769642 24180 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.784783 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 56084.8us
I20260709 13:20:21.789736 19063 raft_consensus.cc:3060] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.791463 19067 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:21.793473 19216 pending_rounds.cc:85] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:21.793776 19216 pending_rounds.cc:107] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:20:21.794045 19216 raft_consensus.cc:2889] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.773681 24140 raft_consensus.cc:740] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:21.674804 23899 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.801857 23899 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:21.801966 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 114358us
I20260709 13:20:21.802451 24219 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.803061 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.803257 23583 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:21.805634 24179 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.806990 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.807588 19144 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:21.808471 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.808655 24219 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:21.814193 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.815388 19143 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:21.817005 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:21.819424 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:21.821058 19144 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:21.821686 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:21.782848 24157 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.794981 24221 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:21.795516 24113 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.797428 24180 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.800848 24052 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.818363 23934 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.868348 23785 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:21.869093 23785 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.820425 23978 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.877425 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:21.878218 19220 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:21.838622 24029 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:21.829464 24094 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.871922 23785 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:21.888379 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 71440.6us
I20260709 13:20:21.833406 24219 consensus_queue.cc:1059] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:20:21.898815 23925 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.900337 19214 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:21.837412 23843 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.903656 23843 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.903762 24180 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:21.885251 24029 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:21.904552 24029 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.901988 24113 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.893356 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:21.907483 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:21.890172 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 122681us
I20260709 13:20:21.892071 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:21.911300 19144 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:20:21.835932 23887 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:21.913661 19220 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:21.915640 19220 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 16. Ops: []
I20260709 13:20:21.917098 23925 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:21.890153 24185 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.919023 19113 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:21.922966 19220 raft_consensus.cc:1275] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:21.927702 19113 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:21.942025 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:21.944327 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 168781us
I20260709 13:20:21.953836 19144 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:21.943509 24052 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:21.963675 24052 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:21.964083 24052 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.957834 23773 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:20:21.965896 23887 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:21.946306 24221 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.969257 24221 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:21.970224 24221 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:21.959244 24186 raft_consensus.cc:697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:21.963165 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:21.960983 23934 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:21.972993 24094 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:21.975837 23860 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:21.973435 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:21.974593 24185 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:21.976706 19147 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
W20260709 13:20:22.004527 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.013406 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 50335.5us
I20260709 13:20:22.015390 19147 pending_rounds.cc:85] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 9
I20260709 13:20:22.015847 19147 pending_rounds.cc:107] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:22.016470 19147 raft_consensus.cc:2889] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.016593 19113 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:21.957692 24054 consensus_queue.cc:1059] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:20:22.016989 24157 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.013350 23860 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:22.016203 24050 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:22.027061 24240 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:22.043108 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.029256 24186 consensus_queue.cc:237] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.029371 24229 consensus_queue.cc:1048] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:20:22.026368 24050 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.063848 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.059942 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.061182 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.066915 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:22.067535 19140 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:22.065932 24050 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:22.066783 23785 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:22.069890 19220 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:20:22.073235 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:22.072923 24234 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:22.075487 23841 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:20:22.058835 24240 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:22.085399 19110 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:22.086561 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:22.088351 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.078830 19212 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:22.091616 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.093779 23769 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:22.093915 24054 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:22.081688 24029 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.098555 19217 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:22.100832 24005 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:22.101645 24233 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.076469 23785 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.098605 24029 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.104169 23785 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.102346 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.106680 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:22.092754 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.107404 19220 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
W20260709 13:20:22.081470 24212 log.cc:927] Time spent T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.669s	user 0.011s	sys 0.016s
I20260709 13:20:22.076117 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:22.108922 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:22.112222 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:22.092212 24185 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.115271 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:22.110679 24184 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:22.124008 24157 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.121719 24054 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:22.124531 24157 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.124972 24157 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.129297 24185 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:22.130743 24185 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.130998 24203 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.131075 24185 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.133227 24157 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.134418 24052 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.135720 24157 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.136371 24052 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.109823 24233 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:22.140642 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 98026.3us
I20260709 13:20:22.142824 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.131630 24185 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.145496 24054 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:22.113209 23624 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:22.146513 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:22.149909 19220 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.075166 23860 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.124253 24184 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
W20260709 13:20:22.165200 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.122324 24229 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:20:22.149755 23938 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:22.172276 23860 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.153498 24050 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:22.177996 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.114348 24240 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.179147 24050 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.180090 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.181732 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:22.182773 24226 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:22.183138 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.183743 24226 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:22.184204 24226 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:22.198851 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.199054 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.202486 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 89049.9us
I20260709 13:20:22.220664 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:22.184777 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:22.184721 24226 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:22.223824 19743 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:22.187446 24241 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:20:22.149559 23624 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.226464 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:22.196300 24184 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.234838 23887 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:22.250279 19220 raft_consensus.cc:2468] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:22.251969 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:22.252718 19220 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:22.267256 19220 raft_consensus.cc:2468] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:22.273993 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:22.289618 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 63254.5us
I20260709 13:20:22.187709 24234 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:22.311271 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.351322 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 166642us
I20260709 13:20:22.351449 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:22.239239 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.353050 19717 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:22.274158 19113 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:22.354449 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:22.362452 19744 raft_consensus.cc:2368] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:20:22.227375 23938 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.238704 23887 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:22.364445 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 90394.3us
I20260709 13:20:22.384256 19035 leader_election.cc:400] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:20:22.392776 19035 leader_election.cc:403] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:20:22.395042 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.417438 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.420830 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.352658 24035 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:22.235893 23624 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.354285 24229 raft_consensus.cc:2764] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:22.357715 24029 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.363232 23790 raft_consensus.cc:2804] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:22.384910 19110 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:22.457329 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 72529.4us
I20260709 13:20:22.390005 24052 raft_consensus.cc:2804] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:22.398831 23887 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.417332 23992 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.354147 23860 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:20:22.490901 24237 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:22.491154 24251 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:22.493985 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 131179us
I20260709 13:20:22.416893 23944 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:20:22.398608 23938 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.470120 23790 raft_consensus.cc:697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:22.456897 24035 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.519814 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2392) took 1074 ms. Trace:
I20260709 13:20:22.521490 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:22.508800 24113 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:22.564124 19213 rpcz_store.cc:276] 0709 13:20:21.445126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.701477 (+256351us) service_pool.cc:224] Handling call
0709 13:20:21.701816 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.756673 (+ 54857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.756702 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.757291 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.958252 (+200961us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:22.013929 (+ 55677us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.014722 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.014800 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.186574 (+171774us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:22.518051 (+331477us) raft_consensus.cc:1685] finished
0709 13:20:22.519525 (+  1474us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.519740 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":562,"prepare.queue_time_us":55684,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2714,"raft.queue_time_us":3801,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":4712,"spinlock_wait_cycles":4884352,"thread_start_us":254956,"threads_started":2,"wal-append.queue_time_us":259003}
I20260709 13:20:22.562737 24251 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:22.583506 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 138163us
I20260709 13:20:22.591984 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.572523 24052 raft_consensus.cc:697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:22.473313 24054 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.583343 24252 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:22.602483 23790 consensus_queue.cc:237] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:22.614012 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.623807 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 102413us
W20260709 13:20:22.637369 24253 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:20:22.640300 24186 consensus_queue.cc:1059] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:22.641564 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.652758 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.661923 23938 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:22.667781 23944 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:22.668551 23944 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:22.669675 24255 log.cc:927] Time spent T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:20:22.671494 23944 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.662869 24237 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:22.589454 24251 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.682847 24052 consensus_queue.cc:237] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.684034 23992 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:20:22.583496 24113 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.701804 19067 raft_consensus.cc:1240] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:22.702432 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 114285us
I20260709 13:20:22.642045 23860 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:22.699954 19069 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.704677 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:22.715987 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:22.716908 19071 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 9.
I20260709 13:20:22.718631 19064 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:22.713805 24252 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:22.722589 24252 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.724920 23992 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.728223 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:22.730113 19066 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:22.725884 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:22.709139 24185 consensus_meta.cc:287] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:20:22.724763 24260 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.735733 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.708740 23860 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:22.725761 23992 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:22.752681 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.757627 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.748555 23938 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.748631 23860 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.724799 23887 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.763614 24113 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.745909 24185 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.759698 24035 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.776780 19110 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:22.781266 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:22.782642 24203 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:22.766812 24234 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.750242 24260 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:22.788906 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.775487 24266 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.791146 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.791307 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.792186 19749 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:22.792189 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:22.796118 24260 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.796128 24234 raft_consensus.cc:2764] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:22.788949 24203 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:22.797639 24203 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.787493 24050 consensus_queue.cc:1059] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:20:22.798058 24203 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:22.798519 24260 raft_consensus.cc:3055] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:22.798745 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:22.799018 24260 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:22.800146 24260 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.801641 24260 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:22.802866 24264 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:22.803493 24264 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.791204 24266 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.806223 24264 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.806877 24266 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:22.807333 24035 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:22.817051 24035 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.818182 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.819260 24035 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.811535 23624 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.819391 19220 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:22.822135 23887 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.823405 23624 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:22.815816 24226 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
I20260709 13:20:22.849053 24226 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.851837 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:22.853119 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:22.854208 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.854770 19215 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 9.
I20260709 13:20:22.855397 19066 pending_rounds.cc:85] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 8
I20260709 13:20:22.855525 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.830626 24185 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:22.838796 24184 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.005s
I20260709 13:20:22.856830 19065 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:22.856984 24184 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.858122 24197 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.859226 24184 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.840342 23992 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.855751 19066 pending_rounds.cc:107] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:20:22.860422 19066 raft_consensus.cc:2889] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.860647 24251 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.862363 19746 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:20:22.862799 24251 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.866581 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:22.826645 19184 leader_election.cc:400] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:22.869773 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:22.870164 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43653.5us
I20260709 13:20:22.870805 19218 raft_consensus.cc:2368] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16.
I20260709 13:20:22.871924 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.873142 24226 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:22.874572 19146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2221) took 1326 ms. Trace:
I20260709 13:20:22.874966 19146 rpcz_store.cc:276] 0709 13:20:21.548578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.587725 (+ 39147us) service_pool.cc:224] Handling call
0709 13:20:22.874376 (+1286651us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b5400220e54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:22.874492 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78735104}
I20260709 13:20:22.875732 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:22.876451 19072 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:22.876233 24197 consensus_queue.cc:1059] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:22.877450 24197 consensus_queue.cc:1243] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 508ee2e0531b43d7a1c05f950644ae66 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:22.879611 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33244 (request call id 587) took 1167 ms. Trace:
I20260709 13:20:22.880141 19143 rpcz_store.cc:276] 0709 13:20:21.712095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.817657 (+105562us) service_pool.cc:224] Handling call
0709 13:20:22.874495 (+1056838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.874684 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.874709 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.874767 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:22.874798 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.874850 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.876255 (+  1405us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400220e50. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:22.879528 (+  3273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429711616}
I20260709 13:20:22.885571 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.887077 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.888350 24103 raft_consensus.cc:3055] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:22.889532 24103 raft_consensus.cc:740] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:22.889756 19218 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:22.890460 24103 consensus_queue.cc:260] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:22.891865 24103 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.891942 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.894356 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.899856 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:22.900194 19218 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:22.900451 19072 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.900974 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:22.894579 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.897040 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:22.897390 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2350) took 1529 ms. Trace:
I20260709 13:20:22.902165 19071 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.902102 19063 rpcz_store.cc:276] 0709 13:20:21.367830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.519074 (+151244us) service_pool.cc:224] Handling call
0709 13:20:21.529291 (+ 10217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.074546 (+545255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.074575 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.074611 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:22.074637 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.897180 (+822543us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400035554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:22.897225 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.897338 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":814,"spinlock_wait_cycles":434475904}
I20260709 13:20:22.902936 23894 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.897822 19144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2234) took 1070 ms. Trace:
I20260709 13:20:22.903527 23894 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:22.903676 19144 rpcz_store.cc:276] 0709 13:20:21.827290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.912041 (+ 84751us) service_pool.cc:224] Handling call
0709 13:20:22.896856 (+984815us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54001798d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:22.897770 (+   914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24767872}
I20260709 13:20:22.856658 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:22.910564 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 265726us
I20260709 13:20:22.910835 24229 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:22.911389 24229 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:22.918185 19072 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:22.918457 24185 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.911448 19071 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:20:22.919077 24203 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.919080 24185 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:22.920228 24250 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.462s	user 0.000s	sys 0.010s
I20260709 13:20:22.922286 24185 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:22.924568 24228 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:22.924979 24228 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:22.925963 24228 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.926996 24228 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.928109 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.929551 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:22.930135 19063 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:22.930956 24254 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:20:22.931520 19744 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:22.930974 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:22.912621 24229 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:22.937861 24229 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.848242 23860 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:22.939286 24247 log.cc:927] Time spent T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.806s	user 0.003s	sys 0.008s
I20260709 13:20:22.940464 23860 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:22.940729 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2215) took 1189 ms. Trace:
I20260709 13:20:22.941553 19216 rpcz_store.cc:276] 0709 13:20:21.751626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.777995 (+ 26369us) service_pool.cc:224] Handling call
0709 13:20:21.793285 (+ 15290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:21.874433 (+ 81148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.874461 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:21.879029 (+  4568us) log.cc:844] Serialized 52 byte log entry
0709 13:20:21.999639 (+120610us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:21.999680 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.999753 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.938542 (+938789us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:22.940446 (+  1904us) raft_consensus.cc:1685] finished
0709 13:20:22.940468 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.940669 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109802,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":30737,"spinlock_wait_cycles":15810944,"thread_start_us":144633,"threads_started":2,"wal-append.queue_time_us":181317}
I20260709 13:20:22.943177 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:22.944346 19072 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 12: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:22.955618 19063 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:22.959439 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:22.964282 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.965449 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:22.968739 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:22.970760 19212 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:22.971813 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 99562.1us
W20260709 13:20:22.972970 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 58795.6us
I20260709 13:20:22.983520 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:22.983780 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:22.984148 19743 raft_consensus.cc:3060] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.975523 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:22.967446 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:22.985899 19218 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:22.985276 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:22.987769 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:22.989863 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:22.991631 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.984376 19215 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.989925 19110 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:22.992744 19142 raft_consensus.cc:1240] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:22.990859 19218 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:23.002897 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:23.006007 19139 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 12: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:23.002991 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:23.003537 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:23.007326 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:22.993732 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:23.009670 19143 raft_consensus.cc:2368] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16.
I20260709 13:20:23.005144 19063 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:22.998441 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:23.005774 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:23.008450 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:23.014122 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:23.014807 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:22.941431 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:23.017213 19144 raft_consensus.cc:606] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.017592 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:23.018733 19110 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:23.019454 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:22.986752 24228 raft_consensus.cc:2764] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:20:23.020568 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:23.024979 19035 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:23.026933 19035 leader_election.cc:400] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16.
I20260709 13:20:23.027303 19035 leader_election.cc:403] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:23.028483 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:23.029271 19212 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:23.004460 24054 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.028529 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:23.031497 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:23.031874 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:23.032325 19218 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:23.032711 19072 raft_consensus.cc:2368] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for earlier term 15. Current term is 16.
I20260709 13:20:23.023213 19110 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:23.034102 19215 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:23.034770 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:23.037776 19139 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:23.007323 24264 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:23.007376 23860 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:23.041706 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:23.041931 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 69376.7us
W20260709 13:20:23.019554 24196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.006s	sys 0.028s
I20260709 13:20:23.042352 19146 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:23.021195 23583 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:23.023932 24260 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:23.029176 24050 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:23.035766 23769 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.008s	sys 0.017s
I20260709 13:20:23.028074 24234 raft_consensus.cc:2764] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:23.030690 23841 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:23.059600 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:23.009994 24251 consensus_queue.cc:1059] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:20:23.030838 24197 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:23.049463 24196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.006s	sys 0.029s
I20260709 13:20:23.075616 19140 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 18.
I20260709 13:20:23.044242 24264 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:23.079540 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2214) took 1337 ms. Trace:
I20260709 13:20:23.080206 19214 rpcz_store.cc:276] 0709 13:20:21.742236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.766471 (+ 24235us) service_pool.cc:224] Handling call
0709 13:20:21.766715 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.900727 (+134012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.079175 (+1178448us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001d6854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:23.079438 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306616576}
I20260709 13:20:23.054967 23583 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:23.082944 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.059834 23769 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.009s	sys 0.018s
I20260709 13:20:23.053593 24228 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.090590 19070 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:23.031417 23791 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:20:23.095813 19213 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:23.096632 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:23.098531 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:23.062117 24180 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:23.099045 19214 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:23.100469 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.064818 23841 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:23.060947 24203 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:23.079679 24197 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.065734 24260 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:23.093027 23583 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.059513 24257 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:20:23.114179 19035 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:23.087088 24264 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.093211 24259 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.127650 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:23.134003 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:23.134728 19146 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:23.114498 23841 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:23.149201 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.120505 23624 raft_consensus.cc:2804] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:23.137084 24259 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.132117 24219 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:23.267791 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 736) took 2198 ms. Trace:
I20260709 13:20:23.268312 19219 rpcz_store.cc:276] 0709 13:20:21.069804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.596398 (+526594us) service_pool.cc:224] Handling call
0709 13:20:21.628856 (+ 32458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.081717 (+452861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.081747 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.081786 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:22.081826 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.267516 (+1185690us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540014b9d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:23.267577 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.267726 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040991616}
I20260709 13:20:23.117744 24197 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.231698 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2224) took 1680 ms. Trace:
I20260709 13:20:23.232316 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2412) took 1063 ms. Trace:
I20260709 13:20:23.270195 19216 rpcz_store.cc:276] 0709 13:20:22.168749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.943560 (+774811us) service_pool.cc:224] Handling call
0709 13:20:23.003286 (+ 59726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.010416 (+  7130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.010461 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.019028 (+  8567us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.104401 (+ 85373us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:23.104460 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.104557 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.232096 (+127539us) raft_consensus.cc:1685] finished
0709 13:20:23.232116 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.232260 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6728,"raft.queue_time_us":13265,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":2383,"thread_start_us":47015,"threads_started":1,"wal-append.queue_time_us":187637}
I20260709 13:20:23.279421 24237 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.281994 19216 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:23.115909 23944 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:23.237282 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:23.282788 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.282658 23944 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.283592 24035 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:23.284364 24214 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.285109 24214 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:23.285372 24196 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:23.286939 23944 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:23.289108 24281 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:20:23.270040 19145 rpcz_store.cc:276] 0709 13:20:21.551208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.759320 (+208112us) service_pool.cc:224] Handling call
0709 13:20:21.773749 (+ 14429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.776667 (+  2918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.776697 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.865342 (+1088645us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b2c0005c228. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:20:22.865708 (+   366us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.059583 (+193875us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:23.059637 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.059787 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.231408 (+171621us) raft_consensus.cc:1685] finished
0709 13:20:23.231429 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.231639 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6894,"raft.queue_time_us":1044,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":1681,"spinlock_wait_cycles":24502528,"thread_start_us":193512,"threads_started":1,"wal-append.queue_time_us":363532}
I20260709 13:20:23.243497 19214 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:23.217926 24260 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.243566 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:23.247840 19743 raft_consensus.cc:2468] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:23.116647 24113 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.241575 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:23.314919 19142 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.095165 24226 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:20:23.292224 19038 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.317819 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2409) took 1194 ms. Trace:
I20260709 13:20:23.318454 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.323038 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.324587 19038 leader_election.cc:400] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16.
I20260709 13:20:23.326234 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.318305 19220 rpcz_store.cc:276] 0709 13:20:22.123309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.822587 (+699278us) service_pool.cc:224] Handling call
0709 13:20:22.822904 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.823283 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.823319 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.823791 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.023923 (+200132us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:23.023967 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.024040 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.317553 (+293513us) raft_consensus.cc:1685] finished
0709 13:20:23.317579 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.317738 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2036,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":199753,"threads_started":1,"wal-append.queue_time_us":415814}
I20260709 13:20:23.343484 19072 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:23.294418 24156 raft_consensus.cc:2764] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:20:23.248507 24203 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:23.361980 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.376978 19066 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
W20260709 13:20:23.389024 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 261452us
I20260709 13:20:23.378535 19220 raft_consensus.cc:1240] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:23.409580 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47696.9us
I20260709 13:20:23.290934 23938 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:23.410681 19038 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.418292 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.294014 23624 raft_consensus.cc:697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:20:23.421280 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.409793 19218 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 10.
I20260709 13:20:23.414265 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:23.360229 24029 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:23.315320 24219 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:23.372867 24214 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:23.375901 24035 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:23.432560 19218 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:23.394454 24196 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.378930 23944 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:23.439954 19219 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:23.412101 24050 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:23.373971 24113 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:23.455179 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.456290 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2220) took 1907 ms. Trace:
I20260709 13:20:23.458060 19147 rpcz_store.cc:276] 0709 13:20:21.548372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.634076 (+ 85704us) service_pool.cc:224] Handling call
0709 13:20:21.646063 (+ 11987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.020907 (+374844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.456009 (+1435102us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400189f54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:23.456223 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759443712}
I20260709 13:20:23.450016 24029 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:23.476662 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 62684.4us
I20260709 13:20:23.477732 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:23.460462 23899 raft_consensus.cc:3055] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:23.433548 23938 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.482205 23944 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.457374 24196 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:23.538141 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 60514us
I20260709 13:20:23.487999 23899 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:23.584295 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:23.566721 24214 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.573119 23934 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:23.575573 24192 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:23.623668 19714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.906s (SENT) [suppressed 10 similar messages]
W20260709 13:20:23.624002 24229 consensus_meta.cc:287] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.005s
I20260709 13:20:23.632334 23934 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:23.633756 24294 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:20:23.637274 24291 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.565603 23624 consensus_queue.cc:237] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.638535 24311 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:23.638798 24285 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:20:23.687037 24295 log.cc:927] Time spent T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:20:23.577131 23944 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.565840 24219 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:23.694202 24256 log.cc:927] Time spent T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 1.165s	user 0.002s	sys 0.008s
I20260709 13:20:23.602243 24050 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.685513 23899 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:23.695164 24290 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:20:23.723204 23899 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.701125 24113 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:23.706507 24196 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:23.708961 24197 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.709707 23938 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:23.713963 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2410) took 1575 ms. Trace:
I20260709 13:20:23.755488 19221 rpcz_store.cc:276] 0709 13:20:22.138384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.933790 (+795406us) service_pool.cc:224] Handling call
0709 13:20:22.995668 (+ 61878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.023708 (+ 28040us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:23.023741 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.048833 (+ 25092us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.411825 (+362992us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:23.411879 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.411976 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.713679 (+301703us) raft_consensus.cc:1685] finished
0709 13:20:23.713718 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.713870 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16894,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7848,"thread_start_us":328630,"threads_started":1,"wal-append.queue_time_us":573752}
I20260709 13:20:23.714047 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 748) took 1571 ms. Trace:
I20260709 13:20:23.757771 19217 rpcz_store.cc:276] 0709 13:20:22.142830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.937508 (+794678us) service_pool.cc:224] Handling call
0709 13:20:22.965461 (+ 27953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.965697 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.965725 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.966269 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.100907 (+134638us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:23.100943 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.101012 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.713771 (+612759us) raft_consensus.cc:1685] finished
0709 13:20:23.713799 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.713979 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38144,"thread_start_us":70893,"threads_started":1,"wal-append.queue_time_us":406037}
I20260709 13:20:23.629458 24259 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:23.767421 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 143774us
W20260709 13:20:23.724721 24228 consensus_meta.cc:287] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 13:20:23.753912 19142 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:23.741143 24237 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:23.763267 23583 consensus_meta.cc:287] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
W20260709 13:20:23.740343 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 156143us
I20260709 13:20:23.776852 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:23.695209 23934 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:23.699517 24264 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.685827 24192 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.769950 24311 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:23.801268 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 381080us
I20260709 13:20:23.802634 19038 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:23.776518 24228 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16.
W20260709 13:20:23.793596 24234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.012s
I20260709 13:20:23.774431 23938 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:23.831425 19069 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 18: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:23.830554 24234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.010s	sys 0.017s
I20260709 13:20:23.828409 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:23.834275 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57521.4us
I20260709 13:20:23.803428 24237 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:23.837260 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:23.838037 19065 raft_consensus.cc:3055] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:23.842885 19065 raft_consensus.cc:740] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:23.811208 24259 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.785017 23583 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.831167 24311 raft_consensus.cc:2764] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:23.828893 23934 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:20:23.854851 23944 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:23.857744 24307 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:23.840101 24263 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:23.859850 24263 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
W20260709 13:20:23.861008 24303 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:23.860824 24263 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.862917 23934 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:23.863262 23934 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:23.863385 19140 raft_consensus.cc:1240] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:23.864243 23934 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.866061 23934 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.866329 24192 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:23.842666 24237 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.873698 24237 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.851500 19065 consensus_queue.cc:260] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.876480 19065 raft_consensus.cc:3060] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.879886 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:23.872609 23841 consensus_meta.cc:287] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.000s
I20260709 13:20:23.892021 19138 raft_consensus.cc:2368] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
W20260709 13:20:23.853451 24236 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.761s	user 0.016s	sys 0.021s
I20260709 13:20:23.834518 23938 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.897667 24259 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:23.897746 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:23.902833 24291 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:23.908388 24140 consensus_queue.cc:260] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:23.909830 24140 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.909991 24259 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.910560 24259 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.913234 24259 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:23.894840 24236 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.804s	user 0.016s	sys 0.022s
I20260709 13:20:23.924697 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:23.925597 19071 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.927829 19065 raft_consensus.cc:1275] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:23.928213 19065 pending_rounds.cc:85] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 10
I20260709 13:20:23.928427 19065 pending_rounds.cc:107] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:23.928898 19065 raft_consensus.cc:2889] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:23.934788 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:23.895519 23841 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:23.938391 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.918756 24234 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.930998 24240 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:23.978821 19071 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
W20260709 13:20:23.979768 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 45069.4us
I20260709 13:20:23.939498 24264 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:23.937429 24197 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:23.938071 24315 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:23.990418 19139 raft_consensus.cc:1240] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:23.993458 24320 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.996765 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:23.975675 24259 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.997552 24259 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.997053 24005 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:23.999097 24005 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:23.999528 24259 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.000025 24005 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:23.933705 24192 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:20:24.001418 24005 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.002562 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2384) took 1030 ms. Trace:
I20260709 13:20:24.002918 19064 rpcz_store.cc:276] 0709 13:20:22.971808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.280171 (+308363us) service_pool.cc:224] Handling call
0709 13:20:23.280457 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.291670 (+ 11213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:23.628192 (+336522us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.834043 (+205851us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.834333 (+   290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.834381 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:23.834428 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.002346 (+167918us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54001b9254. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:24.002391 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.002507 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147112,"prepare.queue_time_us":179563,"prepare.run_cpu_time_us":8563,"prepare.run_wall_time_us":29075,"raft.queue_time_us":2399,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":2486,"spinlock_wait_cycles":25357056,"thread_start_us":381920,"threads_started":2,"wal-append.queue_time_us":301365}
W20260709 13:20:24.005131 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.005234 24320 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.005903 23841 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:24.005798 24320 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:24.007577 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.008111 24320 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:24.014801 19143 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:23.982184 24156 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.017177 24156 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.017889 23583 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.018898 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:24.019860 24156 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:24.020002 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.020393 24156 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:24.020552 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.022053 19140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:24.022791 19140 raft_consensus.cc:606] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:24.028036 19068 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:24.030534 24179 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.031023 24179 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.031193 24246 consensus_queue.cc:1059] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:24.032024 24246 raft_consensus.cc:3055] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:24.032356 24246 raft_consensus.cc:740] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:24.033169 24246 consensus_queue.cc:260] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.034350 24246 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.037336 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.020816 24156 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.038383 24156 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.039448 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:24.044692 24180 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.045209 24180 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.049134 23583 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.049216 24140 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.049710 23583 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.049851 24140 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.051782 23583 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.051883 24140 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.053261 19142 raft_consensus.cc:1275] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:24.049885 19070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2345) took 2780 ms. Trace:
I20260709 13:20:24.054368 19070 rpcz_store.cc:276] 0709 13:20:21.269867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.494649 (+224782us) service_pool.cc:224] Handling call
0709 13:20:21.507497 (+ 12848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.096087 (+1588590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.049653 (+953566us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000a0354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:24.049830 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3640214784}
I20260709 13:20:24.056106 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.057614 19071 raft_consensus.cc:2410] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:24.058606 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:24.058812 19064 raft_consensus.cc:3055] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:24.059321 19064 raft_consensus.cc:740] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:24.060173 19071 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.061226 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:24.065935 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:24.066144 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.069540 19070 raft_consensus.cc:2393] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:24.036700 24005 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.075002 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.070408 19064 consensus_queue.cc:260] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:24.076561 19184 connection.cc:256] RPC call timeout handler was delayed by -1.6322325250000631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:20:24.092736 19184 connection.cc:256] RPC call timeout handler was delayed by -1.3118325249999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 13:20:24.098413 19184 connection.cc:256] RPC call timeout handler was delayed by -1.2470325250001224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 13:20:24.094646 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:24.099668 19147 raft_consensus.cc:2393] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 17: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:24.094988 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.097286 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.095644 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:24.097622 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:24.101620 19146 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.093094 19064 raft_consensus.cc:3060] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.100454 19145 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:24.060395 24140 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.107015 19144 raft_consensus.cc:2393] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:24.107852 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:24.110847 19146 raft_consensus.cc:2410] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:24.112687 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.113358 19146 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:24.114755 24296 raft_consensus.cc:493] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.115434 19146 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:24.068544 23934 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:20:24.116562 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:24.073418 24312 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.124825 24320 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:24.124907 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.125169 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.125972 19147 raft_consensus.cc:2410] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 17 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:20:24.126075 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:24.126681 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.127434 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:24.127784 24226 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:24.128566 24226 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:24.091289 24304 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.126189 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:24.098512 24179 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.129309 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:24.124954 19141 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:24.132920 19071 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:24.133951 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:24.134811 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:24.135188 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.136325 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.134433 24312 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.136471 19068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:24.136930 19063 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:24.137061 19068 raft_consensus.cc:606] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:24.133531 23785 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:20:24.138311 24312 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:24.141458 19069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2385) took 1169 ms. Trace:
I20260709 13:20:24.141851 19069 rpcz_store.cc:276] 0709 13:20:22.972085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.993416 (+ 21331us) service_pool.cc:224] Handling call
0709 13:20:24.141278 (+1147862us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540025d854. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:24.141405 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888345856}
I20260709 13:20:24.143714 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.143931 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:24.144522 19147 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:24.145531 24312 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.145646 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.145975 24312 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:24.146348 24312 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.149204 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.105504 24005 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.149761 19141 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:24.143790 19072 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:24.150535 19064 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:20:24.151324 24005 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.152400 19064 pending_rounds.cc:85] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 6
I20260709 13:20:24.152637 19064 pending_rounds.cc:107] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:20:24.152901 19064 raft_consensus.cc:2889] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.119382 24140 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.154688 19217 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:24.155221 24140 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:24.156823 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.157097 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.157773 19184 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:24.105855 23624 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.160686 19142 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:24.160933 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.163242 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.115253 24296 raft_consensus.cc:515] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:24.169620 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.170666 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:24.170869 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.171594 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.170853 19070 raft_consensus.cc:2393] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:24.175220 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:24.175606 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.176085 19147 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:24.178129 19063 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:20:24.180190 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:24.182067 19141 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:24.182787 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.184639 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.183164 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.185268 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59842 (request call id 623) took 1063 ms. Trace:
I20260709 13:20:24.185448 19212 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:24.185603 19145 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:24.185984 19066 rpcz_store.cc:276] 0709 13:20:23.121455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.243345 (+121890us) service_pool.cc:224] Handling call
0709 13:20:24.185121 (+941776us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54001a9d54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:24.185218 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191649152}
I20260709 13:20:24.185549 19147 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:24.189260 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:24.169829 24320 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:24.191964 19143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2243) took 1244 ms. Trace:
W20260709 13:20:24.196732 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.192404 19143 rpcz_store.cc:276] 0709 13:20:22.947195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.016855 (+ 69660us) service_pool.cc:224] Handling call
0709 13:20:24.191801 (+1174946us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54002b89d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:24.191916 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241786112}
I20260709 13:20:24.247393 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:24.152755 24156 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.251796 19063 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:24.173179 23583 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:24.158236 24304 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.168388 24180 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:24.316133 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.320541 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:24.320541 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.325279 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:24.325795 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:24.325570 19063 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 14. Ops: []
I20260709 13:20:24.326416 19743 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:24.326519 19143 raft_consensus.cc:2393] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 18: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:24.173096 23624 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.327102 19147 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:24.179221 24315 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 13:20:24.282589 24330 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:20:24.282039 24331 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:20:24.182188 24264 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:20:24.330721 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:24.332928 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 85575.3us
I20260709 13:20:24.184047 24240 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 13:20:24.343891 24156 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:24.345574 24313 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:24.325170 24226 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:24.371236 19068 raft_consensus.cc:1240] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:24.346417 19139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2248) took 1332 ms. Trace:
I20260709 13:20:24.184227 24052 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.250989 24234 consensus_queue.cc:1059] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:20:24.386214 24052 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.387316 24234 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:24.387782 24234 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:24.359118 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:24.340660 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:24.360141 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:24.389016 19145 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.389299 19141 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:24.389494 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:24.389647 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:24.367137 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.368409 19069 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:24.368530 19219 raft_consensus.cc:1240] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:20:24.250068 24266 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:24.370033 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.243453 24197 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:24.372965 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:24.377308 19018 auto_rebalancer.cc:629] Failed to schedule move for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28: Illegal state: Replica 55991c1f7f474a9888725d00438d8a83 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:20:24.517807 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 102644us
W20260709 13:20:24.518000 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.377599 24226 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.378207 24240 consensus_queue.cc:1243] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:24.379148 24317 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:24.360281 24186 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.283568 23583 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.385203 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.565279 19214 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 19: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:24.385092 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:24.566097 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 44048.3us
W20260709 13:20:24.570133 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.372450 19139 rpcz_store.cc:276] 0709 13:20:23.014063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.048090 (+ 34027us) service_pool.cc:224] Handling call
0709 13:20:23.048401 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.990945 (+942544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.346192 (+355247us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400189054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:24.346362 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165819136}
I20260709 13:20:24.372571 24315 consensus_queue.cc:1243] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:24.283423 24237 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:24.575691 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.741803 19064 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:24.686748 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2416) took 1771 ms. Trace:
W20260709 13:20:24.743081 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 353625us
I20260709 13:20:24.516248 24230 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.745046 23899 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.745607 24203 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:24.777186 24203 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.779726 24203 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:24.587411 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:24.781831 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:24.782061 19217 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.782804 19068 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:24.672252 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.370462 23791 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.378s
I20260709 13:20:24.414551 24318 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.537434 24320 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:24.763072 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.763764 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:24.763156 19213 rpcz_store.cc:276] 0709 13:20:22.915817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.250673 (+334856us) service_pool.cc:224] Handling call
0709 13:20:23.280838 (+ 30165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.575396 (+294558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.575424 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.575466 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:23.575499 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.686481 (+1110982us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540036ced4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:24.686533 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.686686 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659048320}
I20260709 13:20:24.372045 24313 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:24.522471 24214 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:24.784970 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.758488 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:24.790877 19219 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.462726 24052 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.792822 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.793713 19213 raft_consensus.cc:2410] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:24.799914 19221 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:24.802217 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.802978 19213 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 16: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:24.759672 24291 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:24.817252 19144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.057s	sys 0.141s
W20260709 13:20:24.817713 19144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.057s	sys 0.141s
W20260709 13:20:24.818586 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 428991us
I20260709 13:20:24.570158 24192 consensus_queue.cc:1048] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.227s
I20260709 13:20:24.388742 24234 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.759402 24240 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:24.761336 23934 consensus_queue.cc:1048] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:20:24.829118 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:24.829757 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:24.747578 24317 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.792840 24214 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.797680 23841 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:24.836774 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:24.838613 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.767151 24186 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.792950 24313 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.785967 23899 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.420866 24266 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:24.851487 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.797888 24265 consensus_queue.cc:1059] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:24.853842 19216 raft_consensus.cc:2410] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:24.853605 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:24.856861 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:24.860050 19146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.056s	sys 0.123s
W20260709 13:20:24.861277 19146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.056s	sys 0.123s
I20260709 13:20:24.836632 23841 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.826352 24291 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.836925 24214 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.866823 19217 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:24.869649 19219 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:24.842854 24230 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.842419 24315 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:24.840075 24259 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:24.853228 24234 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.883090 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:24.885246 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.005s	sys 0.008s
W20260709 13:20:24.898710 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.008s
I20260709 13:20:24.890718 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.561765 24197 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:24.877099 24215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.050s	sys 0.060s
I20260709 13:20:24.834486 24240 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.871227 23841 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.911501 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:24.914273 19070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.015s
W20260709 13:20:24.917320 19070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.000s	sys 0.015s
I20260709 13:20:24.883020 24314 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:24.913748 19187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.008s
W20260709 13:20:24.920634 19187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.008s
I20260709 13:20:24.917755 19067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 622) took 1818 ms. Trace:
I20260709 13:20:24.921018 19067 rpcz_store.cc:276] 0709 13:20:23.099463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.284223 (+184760us) service_pool.cc:224] Handling call
0709 13:20:23.284478 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.291067 (+  6589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.291100 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.291148 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:23.291180 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.917519 (+1626339us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b5400056c54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:24.917572 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.917703 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14750464}
I20260709 13:20:24.921483 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.917495 19219 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:24.902537 24180 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:24.913072 24215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.050s	sys 0.062s
I20260709 13:20:24.864749 24318 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:24.931207 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 330690us
I20260709 13:20:24.931384 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:24.937216 19214 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:24.938345 19214 raft_consensus.cc:1240] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:20:24.913753 24304 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:24.940236 24304 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:24.942265 24304 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:24.942762 24304 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.921075 24315 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:24.945391 24304 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:24.922858 23624 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:24.956404 24312 consensus_meta.cc:287] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.001s
I20260709 13:20:24.957873 23899 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.959419 24291 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.960098 24226 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:24.985121 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 193372us
I20260709 13:20:24.985998 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:24.962502 24240 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:24.901527 24259 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:24.977270 19145 consensus_meta.cc:287] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 13:20:24.978222 24186 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:24.923915 24314 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.944650 24237 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:24.931459 24334 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:20:25.018086 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.987066 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:25.003896 24291 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:25.010563 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 253902us
I20260709 13:20:24.985168 23934 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:25.006870 24192 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.982889 23841 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:24.916854 24266 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:24.984658 24312 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.014899 24314 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:25.031855 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.004779 19145 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
W20260709 13:20:25.045166 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58187us
I20260709 13:20:25.067222 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:20:25.049467 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.067353 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.063974 24157 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:25.087427 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.029812 24215 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:25.030771 24291 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:25.104115 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 247288us
I20260709 13:20:25.035315 24180 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.106707 19213 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:25.107393 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.111905 19184 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.101994 24265 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.101444 24237 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.065532 23934 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.107539 24291 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.142719 24315 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.103561 24320 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:25.053601 24192 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.113495 24317 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.156344 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:25.153204 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.156692 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2242) took 2203 ms. Trace:
I20260709 13:20:25.110528 24215 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:25.105500 24157 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.110436 24347 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.157282 19138 rpcz_store.cc:276] 0709 13:20:22.946905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.023100 (+ 76195us) service_pool.cc:224] Handling call
0709 13:20:25.150292 (+2127192us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b540018a954. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:25.150434 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948347776}
I20260709 13:20:25.136595 24226 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:25.159245 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 88625.5us
I20260709 13:20:25.113977 24180 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.149624 23624 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:25.143450 24304 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:20:25.159330 24197 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.160115 24215 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.183499 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:25.184863 24356 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.172505 24246 consensus_meta.cc:287] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 1.138s	user 0.015s	sys 0.000s
I20260709 13:20:25.184857 24349 consensus_queue.cc:1059] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:25.187039 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 116335us
I20260709 13:20:25.185465 23841 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.192600 24214 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:25.194310 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 101725us
I20260709 13:20:25.147939 24237 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.185232 24351 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:25.195968 19216 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:25.166043 24265 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.197867 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.198606 24358 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:25.196601 24215 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.151127 24240 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:20:25.168721 24317 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:25.216048 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 50578.2us
I20260709 13:20:25.190505 24180 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:25.205072 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.170799 23624 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:25.206229 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.180857 24226 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.178109 24350 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.159709 24315 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:25.200089 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43813.8us
I20260709 13:20:25.204646 19035 leader_election.cc:400] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:20:25.231658 19035 leader_election.cc:403] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:25.231947 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:25.216038 24352 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:25.219601 19110 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.227437 23624 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.241055 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.242713 19141 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:25.235351 19138 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:25.235386 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.203212 24259 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.236994 19146 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:25.239379 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.239624 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.241180 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.245275 19147 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.245729 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.246423 19138 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:25.246649 19066 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:25.247346 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.248492 19138 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:25.250022 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:25.063037 24186 consensus_queue.cc:1175] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "55991c1f7f474a9888725d00438d8a83" responder_term: 18 status { last_received { term: 17 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:25.250602 19066 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.250787 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.254025 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.217159 24318 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.266953 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.267462 19141 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.269203 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.274055 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.274451 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.171381 24347 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.202246 24356 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.232488 24197 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.277230 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.282860 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.239302 24240 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:25.271009 24341 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:20:25.280012 19066 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:25.280509 19138 raft_consensus.cc:2393] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:25.275902 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.240341 24352 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:25.242659 24312 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.294178 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:25.295089 19070 raft_consensus.cc:2368] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:25.225751 24317 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.295805 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:25.291963 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.296952 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.297715 19064 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:25.277071 24259 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14.
I20260709 13:20:25.216805 24265 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.213958 24320 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.233533 24226 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:25.313445 24339 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:20:25.313562 24259 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.314159 24259 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.314623 24356 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.315991 24259 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.316490 24259 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.319198 19147 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:25.319869 24366 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:25.320358 24366 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:25.321242 24259 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:25.331799 24340 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:20:25.333164 24259 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.335008 24366 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.344956 24370 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.345639 24370 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.348187 24370 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.349936 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.242072 24350 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.351886 24192 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.349272 24259 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.354969 24313 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.355238 24259 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.338428 23934 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.357282 24259 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.319701 24314 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.359102 24314 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.359939 24230 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.360078 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2240) took 1011 ms. Trace:
I20260709 13:20:25.353029 24370 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:25.353689 24214 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.288519 24197 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.360447 19218 rpcz_store.cc:276] 0709 13:20:24.348944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.349105 (+   161us) service_pool.cc:224] Handling call
0709 13:20:24.349376 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.375693 (+ 26317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.375742 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.376148 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.913543 (+537395us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:25.112839 (+199296us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.113224 (+   385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.113340 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.359871 (+246531us) raft_consensus.cc:1685] finished
0709 13:20:25.359892 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.360020 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35773,"prepare.queue_time_us":246626,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":46377,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":6828,"thread_start_us":713066,"threads_started":2,"wal-append.queue_time_us":629031}
I20260709 13:20:25.370324 24313 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.372821 24197 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.375540 24157 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.377306 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.378103 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2397) took 1010 ms. Trace:
I20260709 13:20:25.378423 19071 rpcz_store.cc:276] 0709 13:20:24.367384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.376106 (+  8722us) service_pool.cc:224] Handling call
0709 13:20:25.377158 (+1001052us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800003698. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f6100465a22 00007f610937ec09 00007f61084d8ee0 00007f61085a20ab 00007f61085a2131 00007f61085500a0 00007f610854f984 00007f6101aca6d4 00007f6101aca662
0709 13:20:25.378041 (+   883us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29542784}
I20260709 13:20:25.379688 24317 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.384548 19214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2427) took 1010 ms. Trace:
W20260709 13:20:25.391404 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 171898us
I20260709 13:20:25.391388 19214 rpcz_store.cc:276] 0709 13:20:24.374313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.938978 (+564665us) service_pool.cc:224] Handling call
0709 13:20:24.939189 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.939375 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:25.154086 (+214711us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.383858 (+229772us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b180044f080. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:20:25.384097 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.384161 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:25.384239 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.384337 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.384480 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266092,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":7109,"spinlock_wait_cycles":22396800,"thread_start_us":281528,"threads_started":2,"wal-append.queue_time_us":146287}
I20260709 13:20:25.365293 24370 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.357293 24347 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.401284 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.403555 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.404369 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.414626 24157 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.418414 24234 consensus_meta.cc:287] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.003s
I20260709 13:20:25.402149 19110 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.404863 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:25.393021 24237 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.392716 24368 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.415294 24157 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:25.420311 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 70443.5us
I20260709 13:20:25.392817 24230 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.401120 24370 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.399300 24352 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.433494 23938 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.433251 24230 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.434111 24352 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.421216 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.435348 24230 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.437455 19141 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:25.437347 24368 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.439678 24368 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.442705 23583 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.444833 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40750 (request call id 2242) took 1095 ms. Trace:
I20260709 13:20:25.399287 24351 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:25.435308 24157 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.445240 19213 rpcz_store.cc:276] 0709 13:20:24.349600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.828195 (+478595us) service_pool.cc:224] Handling call
0709 13:20:25.444676 (+616481us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54000753d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:25.444778 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614908288}
I20260709 13:20:25.446503 24265 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.428797 24226 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.425087 24234 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:25.431102 24350 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.446373 24370 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.447750 19147 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
W20260709 13:20:25.429081 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.455145 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.406654 24304 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:20:25.449714 19065 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:20:25.457232 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 55164.8us
I20260709 13:20:25.460256 19110 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.457687 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.463088 19110 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:25.465170 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.449707 24234 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.473999 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2247) took 1116 ms. Trace:
I20260709 13:20:25.474761 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:25.468452 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:25.475642 19749 raft_consensus.cc:3060] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.469183 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.474364 19219 rpcz_store.cc:276] 0709 13:20:24.357684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.923287 (+565603us) service_pool.cc:224] Handling call
0709 13:20:25.002611 (+ 79324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.004302 (+  1691us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:25.150497 (+146195us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.473288 (+322791us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b180044f020. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f6106f823c7 00007f61035949a7 00007f61035a40bf 00007f61035a4038
0709 13:20:25.473481 (+   193us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.473659 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.473703 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:25.473744 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.473810 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.473945 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9960,"prepare.queue_time_us":202906,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2046,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5668,"spinlock_wait_cycles":14168832,"thread_start_us":190132,"threads_started":2,"wal-append.queue_time_us":134068}
I20260709 13:20:25.467698 24229 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:25.482232 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.482893 19147 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:25.454357 24240 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.458298 24350 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:25.486537 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.487892 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.488605 19143 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:25.492466 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:25.493527 19742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.494071 19184 leader_election.cc:400] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:25.494499 19184 leader_election.cc:403] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:25.495493 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.496110 19143 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:25.468508 24351 consensus_queue.cc:1243] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:25.455901 24265 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:20:25.475980 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.464725 24358 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:25.497270 19745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.499219 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.518457 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:25.500797 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.478363 24234 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.504225 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.504720 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.535310 19138 raft_consensus.cc:2393] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:25.506204 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.535533 19184 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.485613 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.478677 24349 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:25.484383 24054 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:25.508388 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.468254 24367 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:25.462778 23841 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:25.519131 19219 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:25.544844 19219 raft_consensus.cc:1240] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:25.534091 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:25.547977 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.509042 24226 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:25.553177 24226 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.553642 24226 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:25.554332 24215 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.556365 24215 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.533504 24366 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:20:25.541601 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.562839 19750 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:25.496523 24313 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.557971 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:25.559254 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.559660 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.564384 19717 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:25.505751 24157 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.567984 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.568532 19146 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.505348 24368 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:25.508213 24229 raft_consensus.cc:2764] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:25.569522 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:25.574062 19143 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:25.576920 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:25.561829 19749 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:25.579195 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:25.578254 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:25.520218 24237 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.494805 24240 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.584743 24366 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.585376 24366 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.578127 24350 raft_consensus.cc:2804] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:25.586519 24240 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.586655 24350 raft_consensus.cc:697] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:25.587354 24366 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.553232 24367 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:25.562621 24185 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.595646 24185 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.578374 24291 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.597637 24185 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.598973 24291 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.574062 24246 consensus_queue.cc:1059] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:25.599761 19146 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:25.581435 23938 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:25.601183 24296 leader_election.cc:290] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.601197 23938 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:25.603202 23938 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.607095 19138 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:25.610020 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 52169.7us
I20260709 13:20:25.501427 24312 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:25.591045 19147 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:25.589512 19035 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.557125 24370 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.587647 24350 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.593575 24264 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:25.617287 24363 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:25.574115 24157 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.631453 24237 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14.
I20260709 13:20:25.632246 24157 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.569710 24215 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:25.601238 19146 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:25.565378 23934 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.632897 24215 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.633286 24215 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.633260 23934 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.635447 23934 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.619524 24291 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:25.636467 24291 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:25.637029 19744 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:25.637247 24264 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.637737 24264 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.611466 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.640621 19146 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:25.641067 19138 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:25.576915 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.614742 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.642161 19147 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.618175 19072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59842 (request call id 624) took 2389 ms. Trace:
I20260709 13:20:25.643163 19072 rpcz_store.cc:276] 0709 13:20:23.228896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.344460 (+115564us) service_pool.cc:224] Handling call
0709 13:20:24.143618 (+799158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.150491 (+  6873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.618043 (+1467552us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540025d850. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:25.618133 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837034240}
I20260709 13:20:25.571659 23841 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.572702 24245 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:25.608938 24351 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:20:25.651592 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.652580 19146 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:25.615571 19035 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.592692 24054 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:25.622495 24229 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:25.622947 24266 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.624155 24263 raft_consensus.cc:3055] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:25.645107 19143 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.611457 24230 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:25.673657 19143 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:25.674423 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.675127 19146 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:25.648346 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.573201 24313 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.632498 24234 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.645767 24185 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:25.645921 23944 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:25.723423 23944 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:25.723716 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 108243us
I20260709 13:20:25.724658 19035 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:25.725015 24265 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.578191 24368 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.725968 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:25.726915 19071 raft_consensus.cc:2368] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17.
I20260709 13:20:25.688187 19147 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:25.688263 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:25.649407 24245 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.688040 24240 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.693559 24367 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.650455 24312 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:25.689788 24374 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.700986 24291 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.659786 24226 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.702929 24264 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.686446 24237 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.704368 24385 log.cc:927] Time spent T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:20:25.657191 23841 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.726290 24185 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.713138 23887 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:25.721302 24192 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.728566 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:25.731529 19138 raft_consensus.cc:2393] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:25.733385 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.724506 23944 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:25.737421 19071 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:20:25.739189 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.743551 24259 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:25.668977 24230 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.682560 24351 consensus_queue.cc:1243] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:25.659951 24304 consensus_queue.cc:1059] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:20:25.772677 24264 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.745168 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.745750 19072 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:25.805550 19065 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:25.708932 24317 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.731259 24245 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:25.780010 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.809674 19069 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:25.734457 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.733692 24347 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:25.732772 24318 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.825711 24318 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.826815 24215 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.827414 23841 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.827777 24318 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.829051 24234 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.782111 23887 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:25.829715 24234 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:25.829911 24317 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.831924 24317 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.833642 24313 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.768054 24374 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.667902 24263 raft_consensus.cc:740] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:25.837642 24263 consensus_queue.cc:260] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.838850 24263 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.782804 24185 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:25.790380 19147 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:25.747691 24312 consensus_queue.cc:1243] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:25.775421 24237 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:25.859148 19221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 761) took 1702 ms (client timeout 2101 ms). Trace:
W20260709 13:20:25.859531 19221 rpcz_store.cc:269] 0709 13:20:24.156374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.156512 (+   138us) service_pool.cc:224] Handling call
0709 13:20:25.858967 (+1702455us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540032dcd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:25.859093 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476753664}
W20260709 13:20:25.808506 23624 consensus_meta.cc:287] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.003s
I20260709 13:20:25.810930 19066 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
W20260709 13:20:25.821007 19716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.809393 19743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 696) took 1631 ms. Trace:
I20260709 13:20:25.825170 24347 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:25.792670 24192 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:25.786741 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 58278.2us
I20260709 13:20:25.870663 19184 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:25.874185 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:25.874948 19066 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.732391 24240 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.852736 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.790093 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.740442 24265 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:25.855054 19215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2425) took 1496 ms. Trace:
I20260709 13:20:25.855751 24374 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:25.859776 24237 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:25.917423 19065 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:20:25.917663 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.821478 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.918627 19138 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:25.919813 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.920567 19068 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:25.921948 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.862094 19743 rpcz_store.cc:276] 0709 13:20:24.163031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.165075 (+  2044us) service_pool.cc:224] Handling call
0709 13:20:25.794397 (+1629322us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400685454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:25.794566 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334221568}
I20260709 13:20:25.881762 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.882670 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.885973 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.860517 23624 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.894261 19071 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:25.897668 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.927389 19142 raft_consensus.cc:1240] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:25.927692 19749 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:25.903635 19215 rpcz_store.cc:276] 0709 13:20:24.358239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.935917 (+577678us) service_pool.cc:224] Handling call
0709 13:20:25.179051 (+243134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.179289 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:25.218274 (+ 38985us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.300538 (+ 82264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.300585 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:25.300621 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.300681 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.854896 (+554215us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54000749d0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61035898ad 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:25.854998 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247198,"prepare.queue_time_us":33919,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":45939,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11979,"spinlock_wait_cycles":558277376,"thread_start_us":103420,"threads_started":3,"wal-append.queue_time_us":122532}
I20260709 13:20:25.817407 24259 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:25.931984 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.933012 19072 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:25.937668 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.942596 19744 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:25.952570 19749 raft_consensus.cc:1275] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:25.889956 24230 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.903641 24312 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:25.958884 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:25.962685 19065 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:25.959959 23624 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:25.954464 19069 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:20:25.963651 19071 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:25.849745 24264 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.903306 24376 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:25.961665 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.961742 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.791004 24054 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:25.976411 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.926350 24215 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:25.977238 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 111441us
I20260709 13:20:25.982331 19714 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:25.967317 24312 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:25.986853 19066 raft_consensus.cc:2468] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:25.991875 19068 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:25.972193 24357 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.012s	sys 0.001s
W20260709 13:20:25.998170 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.993348 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:25.997303 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:25.971266 24350 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:26.001319 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:26.008540 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:26.003196 24357 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.001s
I20260709 13:20:26.018749 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.019100 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.996063 24157 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:25.996658 24312 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.033021 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.029359 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:26.043301 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:25.990123 24266 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:26.011950 24221 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.048355 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.023111 19143 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
W20260709 13:20:26.023370 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 298757us
I20260709 13:20:26.054674 19035 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:25.974146 24376 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.007757 24342 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.055796 19035 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.072336 19065 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:26.072676 24376 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.068204 24370 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:26.078064 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.079579 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:26.080150 19147 raft_consensus.cc:606] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:26.084484 19145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47594 (request call id 2258) took 1896 ms (client timeout 1931 ms). Trace:
W20260709 13:20:26.085713 19145 rpcz_store.cc:269] 0709 13:20:24.187968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.189047 (+  1079us) service_pool.cc:224] Handling call
0709 13:20:26.084313 (+1895266us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54001798d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:26.084423 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458182016}
I20260709 13:20:26.088238 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:26.061559 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.091624 19063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2398) took 1338 ms. Trace:
I20260709 13:20:26.091984 19063 rpcz_store.cc:276] 0709 13:20:24.752766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.752927 (+   161us) service_pool.cc:224] Handling call
0709 13:20:24.753282 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.923174 (+169892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.923203 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.923245 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:24.923274 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.091403 (+1168129us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001b9754. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:26.091453 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.091567 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390216064}
I20260709 13:20:26.094614 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:26.031286 24157 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.096635 23624 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:26.101104 23624 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:26.101591 23624 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.107117 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:26.109678 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.089048 24388 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:20:26.114080 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.110778 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.115309 19140 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.002512 24347 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.011435 24350 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.111969 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.098728 24376 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:26.124341 19063 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:26.104677 24157 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.091517 24370 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:26.130337 19140 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
W20260709 13:20:26.113363 24383 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:26.044543 24348 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:20:26.139745 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.141448 24370 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.142606 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:26.143303 19147 raft_consensus.cc:606] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:26.143407 24392 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:26.147534 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:26.108661 24246 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:20:26.149056 24390 log.cc:927] Time spent T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:20:26.150472 24391 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:20:26.150671 24264 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.122318 24185 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.154014 24185 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.155258 24192 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.156193 24240 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.070734 24221 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.121361 24318 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.129372 24369 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.106397 23768 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:20:26.163722 19065 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:26.162292 23624 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.040901 24259 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.157332 24376 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:26.180908 19071 pending_rounds.cc:85] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 9
I20260709 13:20:26.182248 19071 pending_rounds.cc:107] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:20:26.182562 19071 raft_consensus.cc:2889] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:26.185948 24226 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.186877 24234 raft_consensus.cc:3055] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:26.187249 24234 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:26.188019 24234 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.190575 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2434) took 1323 ms. Trace:
I20260709 13:20:26.190964 19217 rpcz_store.cc:276] 0709 13:20:24.867280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.882804 (+ 15524us) service_pool.cc:224] Handling call
0709 13:20:26.190372 (+1307568us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54002693d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:26.190509 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201866112}
I20260709 13:20:26.192042 19138 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:26.193171 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2237) took 1845 ms. Trace:
I20260709 13:20:26.194036 24350 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.193553 19220 rpcz_store.cc:276] 0709 13:20:24.347498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.347616 (+   118us) service_pool.cc:224] Handling call
0709 13:20:24.347929 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:24.348269 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.348297 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:25.538472 (+1190175us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b18003767e0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610046b2a6 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a
0709 13:20:25.843948 (+305476us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b2c0003e7c8. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6101e83a11 00007f6101e93372 00007f61035c5a01 00007f610358a43a 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2
0709 13:20:25.844549 (+   601us) log.cc:844] Serialized 52 byte log entry
0709 13:20:25.971938 (+127389us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:26.004280 (+ 32342us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.006357 (+  2077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.006430 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.154825 (+148395us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b18003767e0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610745e58f 00007f610049d571 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd
0709 13:20:26.192943 (+ 38118us) raft_consensus.cc:1685] finished
0709 13:20:26.192967 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.193114 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22215,"prepare.queue_time_us":35790,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":5481,"raft.queue_time_us":10863,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":16523,"spinlock_wait_cycles":47579648,"thread_start_us":126836,"threads_started":1,"wal-append.queue_time_us":285159}
I20260709 13:20:26.199350 19147 raft_consensus.cc:606] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:26.199587 23624 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.199899 19147 raft_consensus.cc:614] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:26.165697 24265 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.204712 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.205164 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:26.205792 19744 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:26.167757 24369 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.166402 24318 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:26.226081 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 126327us
I20260709 13:20:26.229003 19064 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:26.234390 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:26.236039 19070 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
W20260709 13:20:26.246459 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 184494us
I20260709 13:20:26.248926 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:26.249250 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.251035 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:26.253014 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.253162 23768 consensus_queue.cc:1048] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:26.253572 19072 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:26.254684 23768 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:26.253023 23624 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.255883 19751 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:26.258008 24369 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.220703 24245 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.260424 24245 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.261170 19746 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:26.266605 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.268371 19072 raft_consensus.cc:2468] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:26.269327 24376 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:26.274145 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.906s (SENT)
I20260709 13:20:26.275256 19714 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:26.278330 24409 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:26.278868 24409 raft_consensus.cc:493] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.279301 24409 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.280256 24221 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.283727 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:26.285511 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.293105 23934 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:26.295516 24233 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:26.296065 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:26.297845 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.298563 19139 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.300647 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:26.301532 19217 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:26.302577 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:26.309861 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.312433 19110 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.313241 23624 raft_consensus.cc:2804] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:26.313679 23624 raft_consensus.cc:697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:26.313969 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:26.316664 19141 raft_consensus.cc:1240] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 12. Current term is 14. Ops: []
I20260709 13:20:26.318998 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.314426 23624 consensus_queue.cc:237] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:26.340349 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.344110 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:26.324422 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 86710.1us
I20260709 13:20:26.327031 19069 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:26.350889 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:26.302294 24410 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.351227 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46786.5us
I20260709 13:20:26.352864 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.354652 19063 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:26.356979 19717 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:26.322697 23965 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:26.360033 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.362097 24180 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:26.365254 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42382 (request call id 764) took 1317 ms. Trace:
I20260709 13:20:26.365648 19218 rpcz_store.cc:276] 0709 13:20:25.047973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.370322 (+322349us) service_pool.cc:224] Handling call
0709 13:20:25.370574 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.370753 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:25.490218 (+119465us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.364715 (+874497us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b180031bb80. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:20:26.364925 (+   210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.364994 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:26.365034 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.365097 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.365202 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119105,"prepare.queue_time_us":119998,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4320,"spinlock_wait_cycles":45491456,"thread_start_us":50035,"threads_started":1,"wal-append.queue_time_us":84387}
I20260709 13:20:26.367682 24320 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:26.372113 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:26.372824 24397 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.374212 24318 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.378813 24230 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.380750 24397 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:26.381224 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.380327 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:26.382121 19220 raft_consensus.cc:3060] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.382287 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.383092 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.384274 19145 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:26.306891 24411 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:26.386243 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:26.303231 24229 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:20:26.350858 23785 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:26.389268 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.389202 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:26.377390 24312 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.391155 24318 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:26.391527 24397 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:26.391821 24408 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.357703 24265 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:20:26.389171 24221 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:26.394639 24349 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.394979 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.395655 23791 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:26.395692 24237 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.396839 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:26.443837 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47047.1us
I20260709 13:20:26.444926 19184 leader_election.cc:400] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17.
I20260709 13:20:26.398756 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.400384 19139 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:26.447136 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.448849 19139 raft_consensus.cc:1240] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:26.451197 19139 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:26.447396 19714 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:26.320474 24233 consensus_queue.cc:1059] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:20:26.409469 24347 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:26.411056 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.387223 24361 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.388644 23965 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:26.435572 19221 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:26.380821 24230 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.400370 23785 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:26.449615 23791 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.387431 24411 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.358518 24410 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:26.463146 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 72591.2us
I20260709 13:20:26.463212 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:26.429818 24221 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.466039 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.454094 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.430012 24318 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:26.457086 24350 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:26.479838 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.480705 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.401397 24157 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.408075 19220 raft_consensus.cc:2468] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:26.483943 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:26.460063 24408 raft_consensus.cc:2804] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:26.508608 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:26.468279 24226 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:20:26.511025 24312 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.510915 23785 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.512084 23785 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.479907 23791 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.475127 23934 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:20:26.518967 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:26.454116 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 132461us
I20260709 13:20:26.519079 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.459420 24400 consensus_queue.cc:1059] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:20:26.479743 24221 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.456776 24237 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.522825 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:26.449510 24349 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.475795 24411 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.525856 24226 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:26.536504 24226 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:26.536906 24226 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:26.538254 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.489588 24369 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:26.491557 24230 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.539440 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:26.544297 19184 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:26.519430 24351 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:26.545387 24240 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:26.545495 23938 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:26.545836 24240 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:26.545912 23938 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.546291 24240 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:26.547236 24416 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:20:26.536120 24412 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:26.546332 23938 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.549153 24393 raft_consensus.cc:2804] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:26.548960 24369 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.549723 24393 raft_consensus.cc:697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:20:26.549960 24415 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:20:26.550678 24393 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:26.553258 24407 log.cc:927] Time spent T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:20:26.554365 24349 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.521116 24408 raft_consensus.cc:697] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:26.558861 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.558147 24408 consensus_queue.cc:237] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.561288 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.562474 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.565896 24409 raft_consensus.cc:515] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.567533 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.568004 24409 leader_election.cc:290] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.568868 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.569504 23944 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.569792 19067 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:26.569857 23965 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.570922 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.571604 19067 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:26.572806 19067 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:26.545173 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.560225 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.589345 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:26.528010 19035 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.579550 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.593719 19145 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.595510 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:26.527302 24420 log.cc:927] Time spent T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:20:26.467144 24361 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.596073 19221 raft_consensus.cc:3060] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.526324 24312 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:26.543740 24230 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:26.604579 24237 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.607698 24410 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.608186 24157 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.595551 24342 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:26.609740 24361 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.586800 24351 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:26.605007 24312 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.592361 24318 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.615949 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:26.633701 24230 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:26.618417 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 90471.2us
I20260709 13:20:26.619644 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:26.647819 19218 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.637971 24052 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:26.606767 19067 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.627040 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:26.628749 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:26.630632 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.648943 19749 raft_consensus.cc:2368] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:26.649116 19751 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:26.632735 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.635885 24370 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:26.596576 24349 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:26.641992 19747 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:26.642118 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:26.645058 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:26.616565 24350 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:26.649070 19143 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.630996 19145 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:26.649821 19068 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:26.658922 19139 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:26.635088 24374 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:26.641889 24342 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:26.658872 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.652930 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.665514 19035 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:26.644868 24312 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:26.662009 19145 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:26.650516 19184 leader_election.cc:400] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:26.668696 19184 leader_election.cc:403] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:26.662048 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.669093 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:26.666055 19065 raft_consensus.cc:3060] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.659991 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.670050 19139 raft_consensus.cc:2376] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14. Re-sending same reply.
I20260709 13:20:26.661698 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:26.671376 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:26.669483 19067 raft_consensus.cc:2393] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:26.643800 24351 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.659705 24374 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.673849 19216 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:26.674064 19747 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:26.674360 19216 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:26.646697 24157 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:26.703197 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:26.672922 19143 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:26.650652 24052 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:26.675616 19216 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:26.721517 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 56080.4us
I20260709 13:20:26.645634 24237 consensus_queue.cc:1059] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:20:26.720219 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.727685 24430 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:26.723807 24410 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:26.728351 24419 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:20:26.729005 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:26.729465 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.731969 23938 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.655282 24349 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:26.742043 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.746608 19065 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:26.717520 24266 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.667965 24368 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.675557 24370 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:26.667891 24342 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.772431 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.716159 24350 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:26.791574 23938 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.791429 24411 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.792071 24349 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.717643 24245 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:26.660674 24240 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.721601 24409 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.806950 19218 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
W20260709 13:20:26.808207 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 88960.9us
W20260709 13:20:26.814141 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.725978 24186 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:20:26.742879 24320 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:20:26.823443 24226 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.815524 24368 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.824652 24368 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.827929 19066 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:26.836254 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2268) took 1601 ms. Trace:
I20260709 13:20:26.836683 19142 rpcz_store.cc:276] 0709 13:20:25.234479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.234607 (+   128us) service_pool.cc:224] Handling call
0709 13:20:25.234957 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.927920 (+692963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.835999 (+908079us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400189f54. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:26.836176 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591620352}
I20260709 13:20:26.839453 24370 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:26.841013 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.842794 24263 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:26.819242 24397 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:20:26.843215 24263 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:26.812647 24350 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.844738 24226 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.846517 24350 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.853876 19142 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:26.853492 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:26.855903 19714 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:26.832937 24315 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.858078 24264 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:26.862347 24245 raft_consensus.cc:2804] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:26.862990 24245 raft_consensus.cc:697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:26.864566 24245 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.867293 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.867993 24230 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:26.870615 24435 log.cc:927] Time spent T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:26.815809 24052 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.868536 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.875970 24374 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.877310 24368 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.878149 23791 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.878916 19063 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:26.879884 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:26.880358 23791 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.880600 19146 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:26.882048 24052 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:26.882475 23887 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.883450 23887 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.884245 24351 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.885270 19063 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:26.887820 19221 raft_consensus.cc:2468] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:26.826175 24221 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.892087 19717 leader_election.cc:304] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:26.892419 19063 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:20:26.844065 24263 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.889204 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:26.895176 24230 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.895231 24312 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.897868 24312 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.889104 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:26.899688 24221 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.891685 24400 raft_consensus.cc:2749] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:26.902886 24266 raft_consensus.cc:2804] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:26.903410 24266 raft_consensus.cc:697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:26.904145 24411 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.904235 19216 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.901494 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:26.907284 19068 raft_consensus.cc:1240] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:26.872860 24342 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.908353 24351 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:26.911389 24369 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:26.920989 23934 consensus_queue.cc:1059] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:26.922348 24234 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.919315 24411 consensus_queue.cc:1059] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:20:26.905354 24264 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.934325 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.943003 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:26.943732 19751 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
W20260709 13:20:26.949301 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.953457 19216 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:26.954385 24311 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:20:26.939935 24259 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:20:26.958369 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2433) took 2102 ms. Trace:
I20260709 13:20:26.958895 19216 rpcz_store.cc:276] 0709 13:20:24.855579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.214312 (+358733us) service_pool.cc:224] Handling call
0709 13:20:25.214795 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.673751 (+1458956us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b540040a220. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103501dc0 00007f610358c1c0 00007f610358d231 00007f6103589d8f 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c
0709 13:20:26.903889 (+230138us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b540040a220. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61034ffa1d 00007f61034e61a4 00007f6103568447 00007f6103580fe7 00007f61035827de 00007f610358cb49 00007f610358d416 00007f6103589d8f 00007f610358983e 00007f610854e419
0709 13:20:26.954126 (+ 50237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.958302 (+  4176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22147072}
I20260709 13:20:26.961196 19138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47596 (request call id 2483) took 1081 ms. Trace:
I20260709 13:20:26.961750 19138 rpcz_store.cc:276] 0709 13:20:25.879999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.077826 (+197827us) service_pool.cc:224] Handling call
0709 13:20:26.960978 (+883152us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002b98d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:26.961119 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260539648}
W20260709 13:20:26.962854 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.964126 24411 raft_consensus.cc:3055] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:26.964669 24054 raft_consensus.cc:3055] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:26.965250 24054 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:26.974723 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.975939 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.976673 19143 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:26.977258 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.900791 24349 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:26.982339 19219 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.982472 24349 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:26.904238 24266 consensus_queue.cc:237] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:26.919622 24387 log.cc:927] Time spent T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.946s	user 0.019s	sys 0.024s
I20260709 13:20:26.985529 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:26.986374 19140 raft_consensus.cc:2368] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:26.987247 19145 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:26.987869 19218 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.966307 24054 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.991605 19138 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:26.999632 19221 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.993242 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:26.994168 19145 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:26.994602 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af41c4af8a294a729613e88856c064ac" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:27.002031 19139 raft_consensus.cc:2368] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:26.964713 24411 raft_consensus.cc:740] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:26.995983 19140 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:27.005038 19216 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:26.996639 24314 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:26.997643 24439 log.cc:927] Time spent T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:20:26.997596 24157 raft_consensus.cc:3055] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:27.020087 24157 raft_consensus.cc:740] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:27.019958 23934 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:27.004057 19219 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:20:27.004540 19146 raft_consensus.cc:2393] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:27.021413 24405 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:27.021770 24405 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:27.006973 24411 consensus_queue.cc:260] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:26.994112 24054 raft_consensus.cc:3060] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.031893 24411 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.032123 24369 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:20:27.036137 24405 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.038036 24405 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.045506 24035 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:27.046806 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 1.8085e+06us
I20260709 13:20:27.048079 19113 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:27.048977 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.049201 24342 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:27.022543 24186 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:20:27.015386 24347 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:20:27.055344 19144 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:27.057880 19067 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:27.058104 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:27.064518 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:27.070261 19714 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.076511 19747 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:27.076110 24156 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.079680 24344 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:27.068269 24221 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.075788 24179 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.089160 19070 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.091436 24245 consensus_queue.cc:1059] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:27.083822 24314 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.080250 24344 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.104660 24344 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:27.104822 24263 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.088627 24179 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:27.109319 24179 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.110831 23791 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:27.111835 23791 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:27.112176 23791 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:27.113030 23791 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.114290 23791 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.121044 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:27.121663 19066 raft_consensus.cc:3060] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.121510 24314 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.122871 23934 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:27.123265 23934 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:27.123633 24314 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:27.128664 19066 raft_consensus.cc:2468] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:27.124200 23934 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.130592 19072 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:20:27.130831 19746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42930 (request call id 723) took 1193 ms. Trace:
I20260709 13:20:27.131242 19746 rpcz_store.cc:276] 0709 13:20:25.937165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.937378 (+   213us) service_pool.cc:224] Handling call
0709 13:20:27.130660 (+1193282us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400253354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:27.130777 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741815552}
I20260709 13:20:27.136763 19070 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:27.137691 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:27.138578 19144 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 18.
I20260709 13:20:27.142345 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:27.144635 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.144937 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.145612 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:27.148069 19220 raft_consensus.cc:1240] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.149235 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.149853 19218 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 18: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.154160 19220 raft_consensus.cc:1240] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:27.157299 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.157857 19215 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:20:27.158149 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.158601 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec63bca0af2942e1b88ac12d090c139c" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.159631 19220 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.159775 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.160833 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.160837 19218 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:27.163757 19216 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:27.165408 19212 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:27.108022 24234 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:27.168262 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:27.175835 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.176642 19212 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.168817 19215 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 18: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.171023 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.172199 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.179623 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.180415 19213 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:27.181533 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.183698 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.184625 19217 raft_consensus.cc:2393] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:27.185930 19217 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:27.187446 19217 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:20:27.187806 19217 pending_rounds.cc:85] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:27.170639 24259 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:27.189078 24259 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.189568 24259 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.164539 24214 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.193768 24214 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.148921 24342 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.200536 24342 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.204845 24361 raft_consensus.cc:3055] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:27.205410 24361 raft_consensus.cc:740] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:27.206679 24342 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:27.206476 24361 consensus_queue.cc:260] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.188066 19217 pending_rounds.cc:107] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:20:27.210516 19217 raft_consensus.cc:2889] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.212617 19218 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 18: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.214912 19213 raft_consensus.cc:1275] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:27.177817 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.215993 19216 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 18: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.196599 24214 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:27.124719 24179 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.224685 19217 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:27.226542 19216 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:27.148324 24054 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:20:27.207844 24361 raft_consensus.cc:3060] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.228370 19110 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:27.209307 24234 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.236961 24229 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:27.237284 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:27.237975 24449 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:20:27.238402 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.239005 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.239732 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.253859 19214 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:27.243722 19216 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:27.218992 24411 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.254175 19215 raft_consensus.cc:2393] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 14: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.218582 24448 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.255245 19221 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:27.256067 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.257000 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.258384 19214 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 10.
I20260709 13:20:27.258384 19216 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:27.257280 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.259342 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.260013 19216 raft_consensus.cc:2410] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:27.262476 19218 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:27.262741 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.253824 24179 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:27.263298 19215 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.264187 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.265190 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.266187 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.266801 19218 raft_consensus.cc:2393] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 13: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.267467 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.268234 19218 raft_consensus.cc:2410] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:27.268915 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.269395 19218 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:27.269977 24234 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:27.270097 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.270639 19218 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:27.271345 19215 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:27.272163 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.272985 19212 raft_consensus.cc:2410] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:20:27.273085 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.273828 19215 raft_consensus.cc:2393] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:27.274539 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.275023 19215 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:27.275731 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.276242 19215 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:27.276724 19218 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:27.253458 24344 raft_consensus.cc:2804] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:27.277503 24179 consensus_queue.cc:1059] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:27.277633 24344 raft_consensus.cc:697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:27.277633 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.278440 19218 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.278506 24366 raft_consensus.cc:3055] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:27.279006 24366 raft_consensus.cc:740] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:27.278721 24344 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.279827 24366 consensus_queue.cc:260] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.256531 24448 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.281890 19113 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.282125 19217 raft_consensus.cc:2410] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 17 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:27.283037 23965 raft_consensus.cc:2764] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:27.284042 19113 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.284802 23965 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.284622 24259 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.286743 24259 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:27.257869 24411 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:27.287782 19218 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:27.288740 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.289004 19113 leader_election.cc:304] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.289386 24411 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:27.289769 23965 raft_consensus.cc:2749] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.273836 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.277493 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.293224 23965 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:27.262694 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.295258 19216 raft_consensus.cc:2393] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 18: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.298635 19113 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.281208 24366 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.300076 19113 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.308473 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.302719 19216 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:27.310535 19216 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:27.325718 19216 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:27.325999 19220 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:27.326551 19216 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.328358 19216 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:27.328769 19220 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:27.330475 19220 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:20:27.330888 19220 pending_rounds.cc:85] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 7
I20260709 13:20:27.331177 19220 pending_rounds.cc:107] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:27.331465 19220 raft_consensus.cc:2889] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.305370 24179 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:27.307561 24233 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.309410 23899 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.305068 24054 consensus_queue.cc:1059] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:20:27.309547 24234 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.348697 24234 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.350924 24234 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:27.305259 24052 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:20:27.354141 24234 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.354676 24234 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.356751 24234 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:27.358588 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.344236 24233 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:27.361627 24233 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:27.362537 24457 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:27.325270 24221 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:20:27.345368 24179 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:27.346498 24229 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:20:27.395061 19216 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:27.396102 24179 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.400098 19216 pending_rounds.cc:85] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 9
I20260709 13:20:27.400467 19216 pending_rounds.cc:107] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:20:27.396775 23934 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.407730 19216 raft_consensus.cc:2889] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:27.423859 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 112618us
I20260709 13:20:27.426276 19113 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.432955 19113 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.433918 23965 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:27.443372 19221 raft_consensus.cc:1275] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:20:27.443909 19221 pending_rounds.cc:85] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 8
I20260709 13:20:27.444204 19221 pending_rounds.cc:107] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:20:27.444506 19221 raft_consensus.cc:2889] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.453584 19113 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.454630 23965 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:27.454576 19218 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:27.518705 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.455184 23965 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:27.605746 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.623009 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 165522us
I20260709 13:20:27.431886 24366 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.624511 24263 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.624248 24234 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:27.687073 19064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2447) took 1951 ms. Trace:
I20260709 13:20:27.688459 19064 rpcz_store.cc:276] 0709 13:20:25.735914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.789604 (+ 53690us) service_pool.cc:224] Handling call
0709 13:20:25.792059 (+  2455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.231227 (+439168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.686799 (+1455572us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54003a0cd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:27.687005 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004352384}
I20260709 13:20:27.645165 24185 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:27.674345 24264 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:20:27.726919 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.688750 24263 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.634841 23965 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:27.733510 24418 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 1.225s	user 0.005s	sys 0.000s
I20260709 13:20:27.692966 24234 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.736395 24463 consensus_queue.cc:1048] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:27.773031 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2411) took 1609 ms. Trace:
I20260709 13:20:27.773604 19071 rpcz_store.cc:276] 0709 13:20:26.163200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.163367 (+   167us) service_pool.cc:224] Handling call
0709 13:20:26.180631 (+ 17264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.200698 (+ 20067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.200744 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:26.201245 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:20:26.311846 (+110601us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:26.311902 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.312010 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.457110 (+1145100us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:27.769025 (+311915us) raft_consensus.cc:1685] finished
0709 13:20:27.769050 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.772934 (+  3884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7104384,"thread_start_us":110230,"threads_started":1,"wal-append.queue_time_us":258325}
W20260709 13:20:27.783440 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 153752us
I20260709 13:20:27.788851 19221 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:27.805393 24465 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:27.806605 24465 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:27.807062 24465 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:27.807421 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:27.808058 19064 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.807952 24465 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.810525 19746 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:27.809599 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:27.812542 19110 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.819495 19144 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:27.821084 19065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36462 (request call id 2460) took 1053 ms. Trace:
I20260709 13:20:27.821477 19065 rpcz_store.cc:276] 0709 13:20:26.767321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.772087 (+  4766us) service_pool.cc:224] Handling call
0709 13:20:27.820892 (+1048805us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b5400037354. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:27.821025 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120856448}
I20260709 13:20:27.824740 24179 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.830674 19064 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:27.833850 24464 raft_consensus.cc:3055] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:27.835418 24464 raft_consensus.cc:740] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:27.836359 24464 consensus_queue.cc:260] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.837731 24464 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.834731 23899 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:27.838567 23899 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:27.839502 23899 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.840857 23899 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.849860 24263 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:27.851940 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.852556 19218 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:27.852612 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.853533 19214 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:27.848529 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:27.853799 19218 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:27.854616 19038 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.855280 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:27.854640 24197 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:27.855669 19140 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:27.855927 24197 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:27.856344 24197 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:27.860087 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:27.852794 19221 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:27.862767 19038 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.867419 19221 raft_consensus.cc:1240] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.867995 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.859481 24264 raft_consensus.cc:3060] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.859721 23944 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.863044 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:27.863888 24259 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:27.853538 24234 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:27.861933 24376 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:20:27.885362 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50269.7us
I20260709 13:20:27.890017 19221 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:27.877496 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.867434 24465 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.868995 24398 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.895767 24157 consensus_queue.cc:260] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:27.897341 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.898634 24248 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:27.899507 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:27.878379 24411 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.878635 24259 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:27.882112 24233 consensus_meta.cc:287] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.002s
I20260709 13:20:27.882480 23944 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.875591 19214 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 18.
I20260709 13:20:27.864025 24342 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.892616 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:27.904801 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:27.906714 19717 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:27.908354 19038 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.913101 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:27.914000 19749 raft_consensus.cc:2368] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:27.913877 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:27.905756 19747 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 18.
I20260709 13:20:27.916174 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:27.932533 19751 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:27.935164 19140 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:27.905071 24259 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:27.941151 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.941455 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:27.942081 19749 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.945581 24376 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.949296 24376 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.949872 24376 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:27.950385 23944 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:27.951701 19214 raft_consensus.cc:1275] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:27.915258 24398 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.912940 24411 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.915359 24248 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:27.958958 19749 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 19.
W20260709 13:20:27.942096 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.960837 19184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.962525 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:27.963668 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.969987 23965 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.979220 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.968639 24264 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.932545 24054 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 13:20:27.980270 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.970399 19747 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:27.906194 24233 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.979454 23934 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:20:27.985363 24233 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:27.913501 24342 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:27.988629 24342 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:27.989635 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42382 (request call id 792) took 1100 ms. Trace:
I20260709 13:20:27.989974 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:27.990391 24234 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:27.990746 19142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2309) took 1135 ms. Trace:
I20260709 13:20:27.982296 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.958627 24248 raft_consensus.cc:493] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.995668 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:27.999270 19184 leader_election.cc:400] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:27.999672 19184 leader_election.cc:403] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.000816 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:27.983520 19751 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:27.990125 19219 rpcz_store.cc:276] 0709 13:20:26.888841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.888992 (+   151us) service_pool.cc:224] Handling call
0709 13:20:27.989431 (+1100439us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54000758d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:27.989570 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202818304}
I20260709 13:20:27.991158 19142 rpcz_store.cc:276] 0709 13:20:26.855439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.855567 (+   128us) service_pool.cc:224] Handling call
0709 13:20:26.855833 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.856122 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.856141 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:26.856483 (+   342us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.334201 (+477718us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b180046af20. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a0d1 00007f6103545a0f
0709 13:20:27.804250 (+470049us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:27.804302 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.804390 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.990472 (+186082us) raft_consensus.cc:1685] finished
0709 13:20:27.990491 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.990690 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3488,"spinlock_wait_cycles":51723648,"thread_start_us":469827,"threads_started":1,"wal-append.queue_time_us":1118861}
I20260709 13:20:28.017983 24266 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:28.018826 24266 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:28.018875 24156 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:20:27.979559 24361 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.019228 24266 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:28.025174 19035 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:28.002722 24234 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.004005 24248 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.045810 19219 raft_consensus.cc:1275] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:28.032675 24266 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:28.033931 24474 log.cc:927] Time spent T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:20:28.034745 24411 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:28.035866 24240 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:28.039683 24263 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:28.002979 24342 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.044651 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
W20260709 13:20:28.026620 24318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.021s	sys 0.022s
I20260709 13:20:28.042635 24448 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:28.058459 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.063385 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.066522 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.051275 24361 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:28.069593 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.072865 19138 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 19.
I20260709 13:20:28.076627 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.075452 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.078317 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.079516 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
W20260709 13:20:28.066709 24318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.022s	sys 0.022s
I20260709 13:20:28.082041 19144 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:28.089134 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:28.095223 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 94494.5us
I20260709 13:20:28.098304 19184 leader_election.cc:400] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:28.068693 24411 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:28.073969 24266 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:28.090281 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 176458us
I20260709 13:20:28.101190 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:28.096861 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.103508 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.107725 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.111851 19140 raft_consensus.cc:2393] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 14: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:28.080770 24054 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.110316 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:28.121204 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:28.069288 24263 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.124858 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:28.121790 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.126812 19139 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:28.127121 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.127732 19144 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.134543 19147 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:20:28.135073 19147 pending_rounds.cc:85] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 7
I20260709 13:20:28.135375 19147 pending_rounds.cc:107] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:20:28.135681 19147 raft_consensus.cc:2889] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.122160 23944 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.137467 23944 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:28.137849 23944 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.139456 24197 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.145613 24376 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:28.146106 19138 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:28.146311 24376 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.146952 24376 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:28.147444 24376 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.147801 24197 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.157258 24411 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.108052 24234 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:28.163308 24376 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:28.165354 24468 log.cc:927] Time spent T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:20:28.170715 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.171427 19139 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:28.171716 19038 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.173777 19184 leader_election.cc:400] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:28.174247 19184 leader_election.cc:403] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.174109 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:28.178989 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 108512us
I20260709 13:20:28.180728 19038 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.122066 24361 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.182453 19146 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:28.182379 19038 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.180155 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:28.126447 24240 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:28.122926 24054 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.199321 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:28.266047 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:28.252767 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69984.4us
I20260709 13:20:28.131480 24342 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:20:28.184131 24487 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.258214 19139 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.200116 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2451) took 1041 ms. Trace:
I20260709 13:20:28.283636 19213 rpcz_store.cc:276] 0709 13:20:27.158465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.182577 (+ 24112us) service_pool.cc:224] Handling call
0709 13:20:27.182920 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.215304 (+ 32384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.199855 (+984551us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b5400073fd4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:28.200054 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61060864}
W20260709 13:20:28.239086 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.266492 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 67306.4us
I20260709 13:20:28.270615 19142 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:28.193645 24197 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:28.193688 24234 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525) with higher term. Message: Invalid argument: T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:28.221916 24484 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:28.285974 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:28.298761 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:28.300278 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:28.286486 24491 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:28.306241 24361 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:28.305593 24240 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.307531 24448 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:28.325932 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 143608us
I20260709 13:20:28.334532 19143 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:28.311259 24498 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:28.336915 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 69785.8us
I20260709 13:20:28.323773 24361 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.325109 24448 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:28.358160 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 54598.9us
I20260709 13:20:28.325242 24376 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.324510 24491 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
W20260709 13:20:28.366822 24472 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.340s	user 0.000s	sys 0.002s
I20260709 13:20:28.375551 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:28.376983 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49828.1us
I20260709 13:20:28.358906 24361 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.384562 19213 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:20:28.379581 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:28.371670 24448 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.372663 24240 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.400199 24503 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:28.401695 24503 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:28.402048 24503 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.402351 24503 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:28.404616 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.390372 24481 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:20:28.388619 24263 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:28.413508 24488 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:28.413406 24500 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:28.415166 24504 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:28.379930 24342 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:28.385159 24376 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:20:28.423856 24484 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:28.425664 24484 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:28.414366 24494 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:28.440482 19144 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 19.
I20260709 13:20:28.406656 24240 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.417583 24054 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:28.446054 24483 log.cc:927] Time spent T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:20:28.459385 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 79879.3us
I20260709 13:20:28.463770 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:28.469653 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 90106.8us
I20260709 13:20:28.477536 23944 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.479658 23944 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.487946 24361 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:28.489068 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 106753us
I20260709 13:20:28.468904 24342 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:28.444103 24491 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:28.494474 24496 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:20:28.495922 24398 consensus_meta.cc:287] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:20:28.496340 24398 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.507305 24240 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:28.507406 24361 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:28.511574 19217 raft_consensus.cc:1240] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:28.520143 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.498155 24234 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.519781 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.519744 19184 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:28.503777 24342 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:28.534911 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.536130 19038 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:28.537273 23944 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.537410 24264 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.537849 24264 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.538183 24264 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.538234 24513 raft_consensus.cc:2804] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:28.541687 24502 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:20:28.542315 24259 consensus_meta.cc:287] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.001s
I20260709 13:20:28.542459 24498 raft_consensus.cc:2749] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:28.542965 24259 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.545269 24512 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:28.549125 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.551434 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.552101 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.552224 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.552107 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.504503 24376 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:20:28.546247 24411 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:28.559684 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:28.529404 24463 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:28.520716 24398 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:20:28.583514 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.549707 24513 raft_consensus.cc:697] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:28.535264 24493 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:28.529788 24234 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:28.654211 19184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.139.1:33919 timed out after 1.871s (SENT) [suppressed 8 similar messages]
W20260709 13:20:28.653734 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 95917.9us
W20260709 13:20:28.683939 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.560182 24498 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:28.561244 24411 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:28.562675 24502 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.698908 19138 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:28.703608 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.705976 24520 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:28.706231 24493 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:28.706619 24520 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.601960 24513 consensus_queue.cc:237] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.709331 24259 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.704762 24221 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.710933 24221 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.704547 24344 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:28.713696 24234 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:28.713883 24344 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.715389 24520 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.716430 24344 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:28.722950 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 68179.3us
I20260709 13:20:28.564603 24500 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:20:28.661908 24484 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:28.728679 24221 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:28.731379 24264 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:28.625391 24463 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.742568 24463 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:28.733997 24248 consensus_meta.cc:287] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.000s
I20260709 13:20:28.743588 24248 raft_consensus.cc:515] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.655534 24156 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:20:28.734627 24502 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.726401 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:28.739159 24448 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.757495 24248 leader_election.cc:290] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.753089 24266 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:20:28.753695 24203 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:28.689059 24342 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.698264 24498 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.765199 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.782683 19146 raft_consensus.cc:2393] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:28.783298 24264 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.746799 24484 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.790304 24498 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:28.788654 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 125446us
I20260709 13:20:28.792169 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:28.794536 19142 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:28.783849 24203 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:28.756279 24411 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.814000 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:28.814882 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:28.815620 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:28.816458 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:28.816906 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:28.820233 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 166020us
I20260709 13:20:28.823475 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.805912 24156 consensus_queue.cc:1048] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:20:28.826319 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:28.826885 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:28.827049 19215 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.828305 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:28.829619 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:28.829988 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:28.830770 19219 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:28.788077 24503 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.806389 24248 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:28.839443 19038 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.841817 19070 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:28.844099 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:28.845655 19067 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.806555 24266 consensus_queue.cc:1048] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:20:28.848631 19215 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:28.855842 19069 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:20:28.857039 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:28.860816 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 63461.1us
I20260709 13:20:28.862715 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.852980 24523 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.864061 24512 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:28.841307 24502 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:28.864362 24523 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:28.870689 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.874974 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:28.878155 19067 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 19.
I20260709 13:20:28.886461 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28952387f86d4e5892a88c9c3e0173c8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:28.895053 19215 raft_consensus.cc:3060] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.902912 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:28.903863 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:28.865700 24484 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:28.909328 24534 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.910007 24534 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:28.915117 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 117226us
I20260709 13:20:28.917208 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:28.934556 19067 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 17: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:28.937578 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 66967.6us
I20260709 13:20:28.938541 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.939852 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:28.941969 19065 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:20:28.943781 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:28.945485 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 64447.7us
I20260709 13:20:28.952101 19215 raft_consensus.cc:2468] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 19.
W20260709 13:20:28.958962 19714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.961956 19065 raft_consensus.cc:2393] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 13: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:28.963135 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:28.963793 19064 raft_consensus.cc:2468] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:28.965601 19071 raft_consensus.cc:1240] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:28.895833 24511 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:28.977210 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 117597us
I20260709 13:20:28.915921 24512 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.907900 24264 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:28.931632 24534 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:28.881384 24502 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.986955 19065 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:28.967463 24487 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.991809 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:28.977412 24524 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.988427 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:28.998256 19140 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.987805 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:28.989253 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:28.999871 19749 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:29.002573 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.003316 19067 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.947829 24520 consensus_queue.cc:1059] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:28.881600 24203 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:28.983835 24498 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:29.024987 19067 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:28.987242 24430 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:29.013559 19066 raft_consensus.cc:1240] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:29.011051 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:29.026719 19747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:28.981051 24476 consensus_queue.cc:1048] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:20:28.985077 23583 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:20:29.059616 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:29.069257 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.073035 19215 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:29.039510 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:28.988618 24264 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.056740 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:28.986207 24512 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.034539 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.045284 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.042968 19140 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:29.089300 19065 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.097419 19747 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:29.007776 24342 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:29.035413 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:29.078223 24503 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:29.079748 24532 log.cc:927] Time spent T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:20:29.080435 24537 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:20:29.081068 24535 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:20:29.081516 24543 log.cc:927] Time spent T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:29.083247 24264 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:29.086144 24475 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 1.067s	user 0.000s	sys 0.006s
W20260709 13:20:29.087083 24480 log.cc:927] Time spent T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.822s	user 0.002s	sys 0.003s
I20260709 13:20:29.102118 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:29.106949 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:29.087828 24518 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:29.039999 24430 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:29.101141 24470 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 1.282s	user 0.009s	sys 0.000s
W20260709 13:20:29.125283 24533 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:20:29.111994 19067 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 19.
I20260709 13:20:29.108695 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:29.114768 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.120538 19145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2330) took 1035 ms. Trace:
I20260709 13:20:29.150568 19145 rpcz_store.cc:276] 0709 13:20:28.085452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.085619 (+   167us) service_pool.cc:224] Handling call
0709 13:20:28.085984 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.086254 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:28.182931 (+ 96677us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.119996 (+937065us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b18003f8f80. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a
0709 13:20:29.120186 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:29.120252 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:29.120299 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.120366 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.120485 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166939,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":4004,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":41856896,"thread_start_us":200504,"threads_started":2,"wal-append.queue_time_us":171152}
I20260709 13:20:29.152436 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:29.146476 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:29.147238 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:29.153430 19143 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 19.
I20260709 13:20:29.130512 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.033267 24248 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:29.143153 19749 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:29.127813 19212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40764 (request call id 2463) took 1688 ms. Trace:
W20260709 13:20:29.150292 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 210522us
I20260709 13:20:29.178227 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:29.144356 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:29.127939 19147 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:29.017683 23965 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.162647 19065 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:29.177785 19212 rpcz_store.cc:276] 0709 13:20:27.439534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.443647 (+  4113us) service_pool.cc:224] Handling call
0709 13:20:27.444103 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.444531 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.444570 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.445132 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.795388 (+350256us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:27.864801 (+ 69413us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.865014 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.865085 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:29.085596 (+1220511us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:29.127533 (+ 41937us) raft_consensus.cc:1685] finished
0709 13:20:29.127633 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.127756 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69090,"prepare.queue_time_us":73081,"prepare.run_cpu_time_us":309,"prepare.run_wall_time_us":721,"raft.queue_time_us":2603,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":3511,"spinlock_wait_cycles":61543680,"thread_start_us":349876,"threads_started":1,"wal-append.queue_time_us":533506}
I20260709 13:20:29.137120 24430 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:29.213914 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 139536us
W20260709 13:20:29.215631 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 236731us
I20260709 13:20:29.154440 19069 raft_consensus.cc:2393] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 18: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:29.217549 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.218470 19717 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:29.139956 24502 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:29.227480 24520 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:29.126158 24523 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.129369 24512 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.239724 19714 leader_election.cc:304] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:29.103583 24342 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:29.262682 19186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.229918 24405 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.332284 19071 raft_consensus.cc:2468] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
W20260709 13:20:29.334498 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 100711us
W20260709 13:20:29.341595 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 131372us
I20260709 13:20:29.343719 24526 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:29.344020 24523 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:29.241680 24534 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:20:29.361327 19072 raft_consensus.cc:1217] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:20:29.361936 19072 raft_consensus.cc:1240] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:20:29.364555 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.365912 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.366791 19071 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:29.347391 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.353611 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.386860 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.389524 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.389792 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:29.393146 24521 log.cc:927] Time spent T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.686s	user 0.003s	sys 0.003s
I20260709 13:20:29.398355 24342 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:29.402107 24157 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.404075 24318 raft_consensus.cc:3055] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:29.404491 24318 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:29.405376 24405 raft_consensus.cc:2804] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:29.405961 24405 raft_consensus.cc:697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:29.406862 24405 consensus_queue.cc:237] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.357081 23965 consensus_queue.cc:1059] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:20:29.336182 24503 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.410553 24503 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.412442 24503 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:29.415186 19064 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13.
I20260709 13:20:29.415709 19069 raft_consensus.cc:2368] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:29.416301 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.417075 19064 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:29.418637 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.423369 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.428097 19064 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:20:29.429636 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 189986us
W20260709 13:20:29.430374 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 199716us
I20260709 13:20:29.348848 24487 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.434587 19717 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:29.441123 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.445232 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:29.444095 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.344527 24523 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.456378 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
W20260709 13:20:29.450275 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.439829 24203 raft_consensus.cc:3055] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:29.474308 19184 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:29.472144 19065 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:29.477136 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.474449 19035 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:29.445897 24556 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:29.442886 23965 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.478721 24498 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:29.479157 19035 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:29.486707 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.487677 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:29.488363 19072 raft_consensus.cc:2410] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:29.509346 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.514709 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.486192 24318 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.416560 24248 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.509393 19035 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:29.467547 24240 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.485329 24342 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:29.487726 24556 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.520450 23965 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.546775 24466 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.473775 24203 raft_consensus.cc:740] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:29.520097 24502 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:29.520385 24491 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:29.580982 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 105245us
W20260709 13:20:29.597743 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 88440.4us
I20260709 13:20:29.618188 19035 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:29.517364 24487 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:29.609098 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 94523.9us
I20260709 13:20:29.519866 24498 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:29.612826 19069 raft_consensus.cc:1240] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:29.609993 24524 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:29.614880 24556 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.598230 24563 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.618891 24342 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:29.638862 19069 raft_consensus.cc:1240] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:29.621460 24511 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:29.624226 24487 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.654449 24487 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.625671 24318 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.641189 24569 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.661688 24569 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.649959 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:29.640231 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 130086us
I20260709 13:20:29.649016 19746 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 13.
I20260709 13:20:29.651721 19144 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:29.653271 24498 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:29.630071 24524 raft_consensus.cc:493] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.648479 24571 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:29.691210 24571 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.621924 24466 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.669049 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.693496 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.694774 19184 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.676472 19067 raft_consensus.cc:1240] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:29.696663 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.722472 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.665289 24536 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.648036 24464 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:20:29.673262 24157 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.700855 24534 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:29.707394 24491 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.695981 24524 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:29.700850 24361 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:29.725071 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 102650us
I20260709 13:20:29.726613 24513 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:29.728919 19184 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.729974 19110 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.735064 19184 leader_election.cc:400] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16.
I20260709 13:20:29.736123 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.724439 24523 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.673056 24573 consensus_queue.cc:1059] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:20:29.725220 24560 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:29.740017 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.741114 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.741334 19067 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:29.734122 23583 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.743122 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:29.737648 24563 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:20:29.728624 24536 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.744261 24234 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.736961 24157 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.693929 24203 consensus_queue.cc:260] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.744781 24466 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.743060 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.750249 24569 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.732573 24342 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.751885 24405 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:29.756160 24405 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.756484 24405 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.753330 24560 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.760246 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.738677 24361 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.767125 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:29.767916 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:29.768532 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:29.742197 24491 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:29.789621 19063 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:29.787608 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:29.788110 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50026.2us
I20260709 13:20:29.793840 19751 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:29.754685 24448 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:29.806280 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.811017 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:29.814170 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:29.745332 24505 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:20:29.775113 24560 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:29.755364 24571 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.795957 24203 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.790210 24234 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:29.831130 24466 consensus_queue.cc:1059] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:29.831976 24586 consensus_queue.cc:1059] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:29.880906 24157 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:29.881819 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 107012us
I20260709 13:20:29.886584 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
W20260709 13:20:29.917187 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.917379 19038 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:29.919263 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:29.919858 19146 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.920960 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:29.921725 19138 raft_consensus.cc:3060] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:29.928241 24578 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:29.929031 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:29.930160 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:29.935045 19145 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:29.901284 24577 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:29.949679 24596 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:29.950543 24596 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.918685 24523 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.953666 24523 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.954071 24523 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.954147 24581 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:20:29.956926 19717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.961589 19138 raft_consensus.cc:2468] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:29.962419 19146 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 20.
I20260709 13:20:29.924767 24579 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:29.973337 24580 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:20:29.977293 24487 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.985004 24487 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 20 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.958679 24506 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:29.989321 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:29.989789 24506 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.990362 19146 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 20: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:29.992000 24506 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.991629 24523 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:29.994263 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:29.995113 19138 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
W20260709 13:20:29.967422 24584 log.cc:927] Time spent T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:20:29.969861 24405 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.971930 24556 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:29.998311 19221 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:29.999069 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:29.996212 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:30.011169 24578 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:30.011549 24578 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:30.012006 24578 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.022055 24556 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.015096 24157 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:20:30.003717 24579 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.025985 24405 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.027566 24579 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:29.952206 24577 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.031028 24577 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.033051 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:30.035447 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:30.028571 24524 raft_consensus.cc:515] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.042119 24361 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:30.037310 24523 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.046444 24596 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.037547 24578 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.066565 24578 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:30.071162 24565 log.cc:927] Time spent T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.540s	user 0.004s	sys 0.010s
I20260709 13:20:30.070757 24524 leader_election.cc:290] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:30.073622 24561 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.538s	user 0.002s	sys 0.002s
I20260709 13:20:30.073493 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:30.076362 23583 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:30.081635 24568 log.cc:927] Time spent T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.566s	user 0.002s	sys 0.000s
W20260709 13:20:30.081820 24585 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:20:30.085302 24464 raft_consensus.cc:3055] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:30.085843 24464 raft_consensus.cc:740] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:30.086746 24464 consensus_queue.cc:260] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.088013 24464 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:30.094311 24536 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.094964 24411 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.098665 24587 raft_consensus.cc:3055] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:30.099072 24587 raft_consensus.cc:740] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:30.099887 24587 consensus_queue.cc:260] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.101677 23965 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.099895 24583 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:30.107432 24583 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:20:30.108649 24570 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.567s	user 0.002s	sys 0.000s
I20260709 13:20:30.108438 24583 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.110011 24583 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:30.114217 24587 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.154600 19067 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 18: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:30.158509 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.171164 19066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36478 (request call id 2466) took 1185 ms. Trace:
I20260709 13:20:30.171689 19066 rpcz_store.cc:276] 0709 13:20:28.985987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.986130 (+   143us) service_pool.cc:224] Handling call
0709 13:20:29.008341 (+ 22211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.028608 (+ 20267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.170560 (+1141952us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b5400036454. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:30.170979 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11558656}
I20260709 13:20:30.175395 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.181042 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:30.182402 19144 raft_consensus.cc:2393] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 18: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:30.184119 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:30.186554 19141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2350) took 1636 ms. Trace:
I20260709 13:20:30.187036 19141 rpcz_store.cc:276] 0709 13:20:28.549870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.549987 (+   117us) service_pool.cc:224] Handling call
0709 13:20:28.550315 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.743191 (+192876us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:28.753225 (+ 10034us) log.cc:844] Serialized 14 byte log entry
0709 13:20:28.756560 (+  3335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:28.756631 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:28.756688 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.690802 (+934114us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18003fbf20. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d522 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:20:30.186019 (+495217us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400328054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:30.186101 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.186354 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7811,"prepare.queue_time_us":10857,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":4590,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3710,"spinlock_wait_cycles":471899136}
I20260709 13:20:30.202868 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:30.205833 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.895892 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.207798 18963 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 2 to 14, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 14 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:30.210376 19184 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:30.204754 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:30.239213 19746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42932 (request call id 720) took 2336 ms (client timeout 2232 ms). Trace:
W20260709 13:20:30.239847 19746 rpcz_store.cc:269] 0709 13:20:27.902424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.902665 (+   241us) service_pool.cc:224] Handling call
0709 13:20:30.238678 (+2336013us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54005730d4. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:30.238906 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4008913280}
I20260709 13:20:30.242013 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.243616 24408 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.244462 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.244763 24408 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.245663 19064 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:20:30.247268 24448 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:30.247942 24448 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:30.248163 24491 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:30.248411 24408 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.249195 19066 raft_consensus.cc:2376] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 13. Re-sending same reply.
I20260709 13:20:30.243511 24234 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:30.249244 24491 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.247028 24546 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:20:30.274775 18963 catalog_manager.cc:5697] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:30.281426 24240 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.282475 24240 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.283469 24513 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:30.284474 24513 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.285043 24234 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.287577 24583 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:30.287881 24234 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.288321 24583 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.288743 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.289840 19221 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 17: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:30.292403 19221 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:30.295367 24448 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.296427 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.277190 24491 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.303382 24342 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:30.303804 24491 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.304715 24491 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.305576 24361 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:30.314038 24240 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:30.317204 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.318374 19221 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:30.306321 24361 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.304308 24342 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.321511 24361 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.322079 24342 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.329255 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.330891 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.345567 19145 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:30.337980 24234 raft_consensus.cc:2804] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:30.334285 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 128896us
I20260709 13:20:30.372666 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.373674 19064 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:30.352698 24583 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:30.376713 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:30.379616 19067 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:30.379902 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 44808.6us
I20260709 13:20:30.379468 24587 raft_consensus.cc:493] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.387598 24505 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.387509 24587 raft_consensus.cc:515] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.388604 24505 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:30.390978 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.397358 24464 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:30.398164 24464 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.401063 24527 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:30.377562 24234 raft_consensus.cc:697] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:30.402766 24527 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.405436 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:30.406279 19065 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.407159 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:30.408344 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.408584 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:30.398155 24587 leader_election.cc:290] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.421095 24264 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:30.421933 24264 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.423687 24513 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.424379 24264 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.424746 24491 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.406666 24464 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:30.429023 24614 raft_consensus.cc:493] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:30.430945 24546 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:20:30.434203 24234 consensus_queue.cc:237] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.435341 24614 raft_consensus.cc:515] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.436160 24527 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:30.437288 24500 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:30.437708 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:30.438021 24500 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.439384 19068 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:30.440793 24500 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.440824 24560 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:30.440450 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.442482 19213 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:30.440464 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:30.444392 19749 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:30.444754 24615 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:30.442512 24560 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:30.438532 24614 leader_election.cc:290] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:30.450356 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:30.450654 19072 raft_consensus.cc:1240] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:20:30.454620 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 65128.5us
I20260709 13:20:30.458941 24504 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:30.460553 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.461310 19212 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:20:30.464792 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.465545 19072 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:30.470682 18963 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:30.472724 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.473062 24504 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:30.473371 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.474190 24504 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.475129 19066 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:30.481194 19213 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:30.479449 19064 raft_consensus.cc:1275] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:30.483729 19065 raft_consensus.cc:2468] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:30.479424 19070 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:30.483155 24464 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.490911 24560 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:30.505818 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.506834 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.518966 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:30.520532 24487 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:30.531239 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.534108 24563 consensus_queue.cc:1059] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:30.534408 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.535022 24563 raft_consensus.cc:3055] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:30.535367 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:30.529124 19213 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:30.546291 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.546983 19219 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:30.535372 24563 raft_consensus.cc:740] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:30.548095 24563 consensus_queue.cc:260] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.544732 19068 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:30.472812 18963 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 9 to 11, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 11 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.525636 24464 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.577450 19065 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:30.566843 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:30.585935 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 50223.4us
I20260709 13:20:30.586886 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:30.587790 24408 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:30.593235 19071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36462 (request call id 2482) took 1236 ms. Trace:
I20260709 13:20:30.593391 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.593706 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.595021 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.593658 19071 rpcz_store.cc:276] 0709 13:20:29.356286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.426590 (+ 70304us) service_pool.cc:224] Handling call
0709 13:20:29.444075 (+ 17485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.444438 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:29.473536 (+ 29098us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.175081 (+701545us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b180047dc40. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610047fe07 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049cc02 00007f610312420b 00007f6103129d23 00007f610312a23a 00007f6103594a2a
0709 13:20:30.300798 (+125717us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.388944 (+ 88146us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.389214 (+   270us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:30.389364 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.392454 (+  3090us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.589501 (+197047us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b180047dc40. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:20:30.592943 (+  3442us) raft_consensus.cc:1685] finished
0709 13:20:30.592962 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.593080 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23867,"prepare.queue_time_us":29356,"prepare.run_cpu_time_us":210,"prepare.run_wall_time_us":601,"raft.queue_time_us":7641,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":50163,"spinlock_wait_cycles":18408576,"thread_start_us":51153,"threads_started":1,"wal-append.queue_time_us":804299}
I20260709 13:20:30.595610 19212 raft_consensus.cc:1240] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.593235 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.592621 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:30.603260 24617 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:20:30.604740 24525 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:30.607852 24578 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.608449 24578 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.611832 24578 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.614799 18963 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:30.617574 24563 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:30.622251 18970 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60506 (request call id 207) took 31930 ms (client timeout 15000 ms). Trace:
I20260709 13:20:30.639283 24464 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:30.645007 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 194845us
W20260709 13:20:30.664750 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.669653 24185 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:30.670389 24185 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.673748 19145 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:30.674976 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.577253 24505 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.587917 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:30.672667 24185 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:30.686546 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.691602 19071 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 17: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:30.690418 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 151964us
I20260709 13:20:30.698858 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.703434 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:30.705687 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 117883us
I20260709 13:20:30.713140 19067 raft_consensus.cc:2468] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:30.717183 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.717696 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.718051 19069 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:30.719261 19068 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:30.724864 19070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36478 (request call id 2455) took 1812 ms (client timeout 1845 ms). Trace:
W20260709 13:20:30.725476 19070 rpcz_store.cc:269] 0709 13:20:28.898410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.902685 (+  4275us) service_pool.cc:224] Handling call
0709 13:20:30.689660 (+1786975us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001ba154. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:30.711179 (+ 21519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2885814016}
I20260709 13:20:30.616822 18963 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:30.728911 18963 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:30.731079 18963 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 10 to 11, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 11 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.733681 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.715809 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:30.745285 19066 raft_consensus.cc:2393] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:30.719198 24545 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:30.746398 24545 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.746863 24545 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:30.762259 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:30.760058 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 55335us
I20260709 13:20:30.776149 19067 raft_consensus.cc:2410] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:30.786262 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:30.786811 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:30.797078 24263 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:30.797614 24263 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.796815 19714 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:30.798045 24263 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.820139 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:30.622727 18970 rpcz_store.cc:269] 0709 13:19:58.691620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.691984 (+   364us) service_pool.cc:224] Handling call
0709 13:20:30.621982 (+31929998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:21.218621 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:21.219302 (+   681us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:21.219357 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:20:21.219396 (+    39us) tablet.cc:662] Decoding operations
0709 13:20:21.240573 (+ 21177us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:21.240701 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:21.240740 (+    39us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:20:21.242684 (+  1944us) tablet.cc:701] Row locks acquired
0709 13:20:21.242734 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:20:21.242894 (+   160us) write_op.cc:270] Start()
0709 13:20:21.243036 (+   142us) write_op.cc:276] Timestamp: P: 1783603221242828 usec, L: 0
0709 13:20:21.243080 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:20:21.243866 (+   786us) log.cc:844] Serialized 8224 byte log entry
0709 13:20:21.893562 (+649696us) op_driver.cc:464] REPLICATION: finished
0709 13:20:22.111040 (+217478us) write_op.cc:301] APPLY: starting
0709 13:20:22.123597 (+ 12557us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:22.661265 (+537668us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:22.661408 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:23.016463 (+355055us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:23.135459 (+118996us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:20:23.217612 (+ 82153us) write_op.cc:312] APPLY: finished
0709 13:20:23.218276 (+   664us) log.cc:844] Serialized 188 byte log entry
0709 13:20:23.515339 (+297063us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:23.578064 (+ 62725us) write_op.cc:454] Released schema lock
0709 13:20:23.602574 (+ 24510us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:23.633984 (+ 31410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:23.634019 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":367859,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":180346,"apply.run_cpu_time_us":51935,"apply.run_wall_time_us":1543699,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91823,"num_ops":21,"prepare.queue_time_us":134872,"prepare.run_cpu_time_us":14806,"prepare.run_wall_time_us":165096,"raft.queue_time_us":288789,"raft.run_cpu_time_us":26069,"raft.run_wall_time_us":177478,"replication_time_us":633717,"thread_start_us":697599,"threads_started":5,"wal-append.queue_time_us":615086,"wal-append.run_cpu_time_us":32868,"wal-append.run_wall_time_us":2547193}]]}
I20260709 13:20:30.827899 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.828022 24500 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.828855 24500 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.829284 24476 consensus_queue.cc:1059] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:30.829416 24545 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.830251 24476 raft_consensus.cc:3055] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:30.830772 24476 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:30.833195 24545 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.814535 24464 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:30.845010 24505 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:30.847947 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.852403 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:30.850895 24500 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:30.839887 24464 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.834856 24510 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 13:20:30.861027 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.851884 23965 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:30.867837 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 71183.4us
I20260709 13:20:30.857116 24464 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:30.845610 24505 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.874221 24545 consensus_queue.cc:1048] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:20:30.878726 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:30.867070 23965 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.882606 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.831867 24476 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.887187 19714 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:30.898313 24266 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:20:30.898734 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:30.899006 24611 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:30.899520 19140 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:30.899602 24611 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:30.900727 24405 raft_consensus.cc:2804] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:30.901409 24405 raft_consensus.cc:697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:30.881707 24408 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:30.885975 23965 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:30.898761 24476 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.909457 24408 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.912905 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:30.922996 24525 raft_consensus.cc:2804] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:30.923676 24624 log.cc:927] Time spent T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:30.923746 24525 raft_consensus.cc:697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:30.925446 24525 consensus_queue.cc:237] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.937430 24405 consensus_queue.cc:237] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:30.942982 24505 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:30.948640 19215 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:30.824201 18963 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 12 to 15, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 15 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:30.948153 24264 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:30.945609 24408 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.975921 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:30.976768 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 180527us
I20260709 13:20:30.974937 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:30.979116 19214 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.975934 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:30.982105 19215 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:30.981326 19142 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:30.989431 24560 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:30.991542 24560 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.991650 19139 raft_consensus.cc:1275] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:30.991875 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:30.990877 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:31.003357 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 269906us
I20260709 13:20:31.005508 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:31.010790 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:31.011723 19069 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:30.962837 24587 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:30.991914 24560 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.015692 19064 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:31.016327 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:31.017788 19072 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:31.020133 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 137922us
I20260709 13:20:31.021257 19066 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:20:31.032316 19071 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:30.978462 24264 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.036130 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.001907 24610 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:31.044831 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.047196 19067 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:20:31.048597 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.048543 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.029598 24263 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.057989 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:31.067364 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 147535us
I20260709 13:20:31.072690 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:31.082573 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.094838 19139 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:31.095367 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.100608 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:31.102010 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.109548 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.110309 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.112771 19138 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:31.106935 24558 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:31.121680 24625 log.cc:927] Time spent T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:31.122700 18963 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 8 to 11, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:31.112602 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33ef0d891f7b462bafaf9441fbf19e37" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.115696 19110 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:31.127631 24631 log.cc:927] Time spent T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:20:31.111851 24611 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:31.124320 19146 raft_consensus.cc:1275] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:31.130911 24558 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.133011 24558 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.261577 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.265295 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.278654 19221 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:31.248914 24504 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:31.259286 24263 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:31.298290 19751 raft_consensus.cc:1240] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:31.298523 24635 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:31.301594 18963 catalog_manager.cc:5697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.305259 24264 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:31.308907 18963 catalog_manager.cc:5697] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:31.321926 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 217209us
I20260709 13:20:31.299361 24635 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:31.339859 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:31.336611 24408 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.342964 24408 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.343756 19743 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:20:31.336946 24264 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.344923 24264 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.346729 24264 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:31.353215 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.353662 19110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.353996 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 254744us
I20260709 13:20:31.356681 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:31.357426 19067 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
W20260709 13:20:31.358621 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 268519us
I20260709 13:20:31.363819 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.364439 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:31.327127 23965 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.369234 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:31.369767 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.370265 19145 raft_consensus.cc:2393] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:31.370420 19146 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:20:31.370422 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.371428 19221 raft_consensus.cc:2393] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 19: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:31.372252 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.355378 24464 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.374114 19141 raft_consensus.cc:2393] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:31.337419 24504 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.378063 24185 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.378072 19113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.380673 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.381809 23965 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.381446 24635 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.382110 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.382403 18963 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 10 to 13, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 13 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:31.384207 24633 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:31.385258 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:31.385802 19144 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.378687 24185 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.390764 24185 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:31.382261 19111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.395753 19146 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 19.
I20260709 13:20:31.384028 18963 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 1 to 10. New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:31.400067 24504 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:31.404438 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:31.406541 24464 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.407181 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:31.407341 19038 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.408972 19214 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:31.409265 19068 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.410542 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:31.419180 24504 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.419811 24504 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.407402 24500 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.424602 24500 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:31.425854 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 325332us
I20260709 13:20:31.427762 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.428267 24546 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.433954 24611 consensus_queue.cc:1059] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:31.434837 24611 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:31.435688 24505 raft_consensus.cc:3055] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:31.436090 24505 raft_consensus.cc:740] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:31.436559 19038 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.441650 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.441879 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.442444 19215 raft_consensus.cc:2393] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 17: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:31.445047 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.445369 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.445789 19221 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:31.437016 24505 consensus_queue.cc:260] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.453454 24578 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.455905 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.456755 24505 raft_consensus.cc:3060] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.456647 19744 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:31.458156 19750 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:20:31.459502 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49282us
I20260709 13:20:31.446511 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701310a5195343c081bea195df509e65" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.446966 24185 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.447597 19215 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:31.462671 24185 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:31.449236 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.463115 24185 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.462137 19038 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.464702 24578 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:31.438377 24560 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.467306 19213 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:20:31.477372 24560 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:31.478960 24500 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.480334 19147 raft_consensus.cc:1240] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:31.483332 19038 leader_election.cc:304] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.484499 19038 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.486539 18963 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 8 to 10, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 10 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:31.506006 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.490091 24500 raft_consensus.cc:2749] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.490859 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.491703 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:31.507345 19138 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:31.492700 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.497546 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.424626 24504 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.489223 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:31.505162 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 90592.9us
I20260709 13:20:31.490557 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.511508 19068 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:31.484650 24546 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:31.517968 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:31.520148 19141 raft_consensus.cc:2468] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:31.521806 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.525683 19145 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:31.542047 19142 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 11.
I20260709 13:20:31.526834 24500 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.552480 19144 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:31.520224 24525 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
W20260709 13:20:31.561532 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 77114.5us
I20260709 13:20:31.563812 19038 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.573690 19746 raft_consensus.cc:1240] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:31.554528 24587 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:31.581408 19112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.573359 24264 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:31.590745 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 162895us
I20260709 13:20:31.554291 18963 catalog_manager.cc:5697] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:31.593765 24546 consensus_queue.cc:1059] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:31.594849 24560 raft_consensus.cc:3055] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:31.594002 18963 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 7 to 11, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 11 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.595234 24560 raft_consensus.cc:740] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:31.596220 24560 consensus_queue.cc:260] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.597914 24560 raft_consensus.cc:3060] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:31.599241 19187 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.606233 18963 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 8 to 9, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 9 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:31.609038 24613 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:31.610351 24234 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:31.583235 24587 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:31.614490 24587 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.616146 18963 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:31.617960 19038 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.622790 19038 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.625640 24640 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:31.626026 24640 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:31.626925 24640 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.627197 24185 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.629909 24185 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.631027 24578 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.632766 24411 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.634217 19184 leader_election.cc:304] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.638842 24611 raft_consensus.cc:2749] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:31.639910 19185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.641088 24640 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.644351 24546 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:31.645390 24611 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:31.645757 24611 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:31.653190 24611 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.661134 24504 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:31.661726 19038 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:31.662832 24264 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:31.663827 24264 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:31.664798 24611 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.665751 24264 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.667996 24587 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.670697 24587 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.672655 19038 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:31.673674 24504 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.674129 24504 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.674800 24411 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:31.674510 24504 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.676946 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:31.681151 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:31.683288 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 151200us
W20260709 13:20:31.684719 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 157265us
I20260709 13:20:31.688066 19035 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:31.688800 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 159734us
I20260709 13:20:31.694290 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.689458 19110 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:31.699139 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 183129us
I20260709 13:20:31.701180 19035 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.705472 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:31.705615 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:31.705992 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.706040 19072 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.706197 19069 raft_consensus.cc:3060] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.709544 19184 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.702224 24611 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.711066 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.711650 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:31.712560 19214 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:20:31.715461 19214 pending_rounds.cc:85] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 9
I20260709 13:20:31.707098 19714 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:31.718331 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.701792 24411 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.723829 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:31.724573 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:31.724825 19068 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.726480 19070 raft_consensus.cc:1275] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:31.715767 19214 pending_rounds.cc:107] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:20:31.733346 19214 raft_consensus.cc:2889] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.733939 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.735354 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:31.736148 24563 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:31.736611 24563 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.737056 24563 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.740852 24613 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.711306 24525 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:31.712095 24476 raft_consensus.cc:2804] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:31.745390 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.728720 24546 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.714764 24647 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.758709 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.723315 24405 raft_consensus.cc:2804] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:31.773475 19072 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 18.
W20260709 13:20:31.759284 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 45508.4us
I20260709 13:20:31.729439 24411 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.752375 24558 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:31.764983 24611 consensus_queue.cc:1048] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:31.758127 23965 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:20:31.768286 24628 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:31.758281 24234 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.772670 19068 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:31.744944 24510 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.743788 24649 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.753441 24525 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:31.781823 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 55580.8us
I20260709 13:20:31.782292 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.727360 24614 consensus_queue.cc:1048] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:31.787590 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.789723 19110 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:31.769786 24546 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:31.775475 24411 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.783771 24510 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.793859 24510 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.790858 24649 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.795652 24635 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:31.780756 24405 raft_consensus.cc:697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:31.796041 24649 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:31.796209 24635 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:31.788358 24525 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:31.784408 24613 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.796691 24405 consensus_queue.cc:237] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.777362 24263 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:20:31.792024 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.797169 24635 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.775763 24476 raft_consensus.cc:697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:31.809181 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:31.807209 24266 consensus_queue.cc:1048] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:20:31.810318 19715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.780618 24558 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.821980 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:31.808346 24546 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.887109 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:31.879532 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58578.2us
I20260709 13:20:31.821401 24604 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.879740 19072 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 20.
I20260709 13:20:31.829820 19142 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:20:31.881357 19064 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:31.791668 24505 raft_consensus.cc:3060] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.883558 19069 raft_consensus.cc:2468] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:20:31.899341 24604 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:31.904050 24604 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.903537 24476 consensus_queue.cc:237] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.909782 19067 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:20:31.913609 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 127411us
I20260709 13:20:31.914897 19113 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.918561 19113 leader_election.cc:304] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:31.922637 24510 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.923508 19218 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:20:31.961163 19218 pending_rounds.cc:85] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 10
I20260709 13:20:31.961489 19218 pending_rounds.cc:107] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:20:31.961786 19218 raft_consensus.cc:2889] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.910786 24647 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:31.911957 24628 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:31.915992 24652 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:31.926043 24558 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:31.927569 24563 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:31.999250 19113 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:31.917013 24614 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:31.912508 24560 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.899133 24527 consensus_queue.cc:1059] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:31.930593 24504 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:31.935024 19746 raft_consensus.cc:2410] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:31.937299 19140 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:31.949256 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:31.957032 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 186942us
I20260709 13:20:31.937043 24611 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:31.920250 24613 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:20:32.018519 24649 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.066648 24660 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.073637 24185 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:32.073526 24660 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:32.074065 24185 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.074446 24185 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.075762 24660 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:32.068723 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:32.076429 24667 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:32.057173 24659 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:32.077176 24659 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:32.078037 24659 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.079457 24659 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.999989 24628 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:32.017915 24614 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.019157 24558 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 13:20:32.085819 24656 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:20:32.089184 24641 log.cc:927] Time spent T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:32.089193 24587 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.089990 24587 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:32.006492 24647 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.033964 24611 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:32.097949 24661 log.cc:927] Time spent T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:20:32.099088 24611 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.100323 24673 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:32.100907 24673 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.103006 24612 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:32.107487 24611 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:32.107957 24611 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.110014 24510 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.115357 24563 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 20 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:32.117822 24613 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:32.118439 24613 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.122260 24504 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:32.124248 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 149654us
I20260709 13:20:32.194695 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.195766 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.201028 19184 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:32.215282 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 325780us
I20260709 13:20:32.221504 24612 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.222183 24612 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.227195 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7347527d150466586ce647078eff8bb" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.231973 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.213389 24613 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.224618 24612 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.275197 19035 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.261235 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:32.256230 18963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.011s
I20260709 13:20:32.286211 19066 raft_consensus.cc:2393] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 11: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
W20260709 13:20:32.281250 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 332076us
W20260709 13:20:32.290329 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 269891us
I20260709 13:20:32.296044 19113 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.293701 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.255993 24234 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.258220 24527 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.259107 24635 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.263566 24647 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.315097 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
W20260709 13:20:32.291712 18963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.009s	sys 0.011s
I20260709 13:20:32.279249 24669 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:32.274956 24628 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.323663 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.325469 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.287089 24464 raft_consensus.cc:2749] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.291203 24673 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:32.333793 19147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.027s
I20260709 13:20:32.311117 24612 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:32.315613 24476 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.336714 19746 raft_consensus.cc:1240] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:32.338371 19113 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.338549 24663 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.338383 19714 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.349476 19063 raft_consensus.cc:1275] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:20:32.351050 19147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.009s	sys 0.027s
W20260709 13:20:32.353436 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 78313.7us
I20260709 13:20:32.356014 19035 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.363618 24545 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:32.364675 24411 consensus_meta.cc:287] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 13:20:32.341889 24669 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.340696 24611 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.378319 19035 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.378742 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.379988 19221 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.380692 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.382477 19213 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.346535 24674 raft_consensus.cc:2749] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.352159 24264 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.321695 24527 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.355446 24587 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:32.394083 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.394420 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.395004 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.419617 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.365108 24411 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.420390 19146 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:32.422011 24411 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.370577 24545 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:32.423224 24545 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:32.426604 24671 log.cc:927] Time spent T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:20:32.429167 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.429320 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.432821 24682 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.433202 24683 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.433301 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.433879 24683 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.434844 24613 consensus_queue.cc:1059] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:32.435523 24613 consensus_queue.cc:1243] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer 0f833abfb3544031bee566e655b7fedc log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:32.435586 24611 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:32.436137 24683 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.442909 19140 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
W20260709 13:20:32.385341 24525 consensus_meta.cc:287] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 13:20:32.380036 24505 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.373090 24510 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:32.461488 19213 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 18.
I20260709 13:20:32.373342 24669 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.383950 24614 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.356307 24612 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.352619 24635 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.470871 19221 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
W20260709 13:20:32.474020 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 95760.9us
I20260709 13:20:32.422039 24673 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:32.380306 24546 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.462548 23965 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.470276 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:32.495792 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:32.386035 24476 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.469753 24510 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.364997 24663 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:32.502344 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 122854us
I20260709 13:20:32.501894 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.383015 24604 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.489392 24587 raft_consensus.cc:3055] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:32.482419 24673 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:32.502988 24264 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:32.504943 24505 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:32.509207 24510 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.470615 24525 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:32.433368 24682 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.510697 24675 raft_consensus.cc:2749] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:32.541184 19035 consensus_peers.cc:597] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61d161ec86f94a4eaf383729c1ddbc87. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:32.553654 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.555014 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.555750 19066 raft_consensus.cc:2368] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18.
I20260709 13:20:32.556807 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.562665 19147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47594 (request call id 2422) took 1073 ms. Trace:
I20260709 13:20:32.563067 19147 rpcz_store.cc:276] 0709 13:20:31.489713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.495713 (+  6000us) service_pool.cc:224] Handling call
0709 13:20:31.496168 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:31.523912 (+ 27744us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:31.723578 (+199666us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.526240 (+802662us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:32.544714 (+ 18474us) log.cc:844] Serialized 525 byte log entry
0709 13:20:32.544864 (+   150us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:32.544925 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.544998 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.562428 (+ 17430us) raft_consensus.cc:1685] finished
0709 13:20:32.562451 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.562610 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11269,"prepare.queue_time_us":82762,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":132039,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":17356,"thread_start_us":921779,"threads_started":3,"wal-append.queue_time_us":789455}
I20260709 13:20:32.520884 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.516393 24587 raft_consensus.cc:740] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
W20260709 13:20:32.569995 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 49214us
W20260709 13:20:32.567910 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 43593.6us
I20260709 13:20:32.575603 19750 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.525229 24505 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:32.579995 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:32.579573 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 240153us
I20260709 13:20:32.574968 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2bd04462cb41488ea5d3a18b899972" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.582243 19142 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:32.566969 24649 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.597373 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.613094 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:32.615198 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.590317 24505 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.614941 19038 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:32.623735 19138 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:32.626873 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.626116 19038 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:32.631464 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 293165us
I20260709 13:20:32.593286 24464 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:32.632988 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.633672 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:32.622474 24185 consensus_meta.cc:287] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 13:20:32.641047 19070 raft_consensus.cc:1240] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:32.640856 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:32.643087 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.643352 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.638820 24263 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:32.644636 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:32.644958 24696 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.645319 19216 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 19.
I20260709 13:20:32.645463 24696 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:32.645262 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.647804 24696 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.648391 19220 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:32.650098 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:32.650326 19750 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 20.
I20260709 13:20:32.652124 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.652705 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.644656 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:32.654191 24525 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.656677 19068 raft_consensus.cc:1275] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:32.629212 24411 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:32.657891 19220 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.635736 24703 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:32.667060 19213 raft_consensus.cc:2468] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
W20260709 13:20:32.667625 24693 log.cc:927] Time spent T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:20:32.640529 24448 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.669054 24612 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:20:32.670176 24689 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:32.644734 24690 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:32.668792 24448 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.673825 24690 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:32.674299 24690 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.674759 24527 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.675377 24448 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.675818 24682 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.677976 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.682047 24663 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.622228 24679 consensus_queue.cc:1059] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:20:32.686722 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:32.687165 24560 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Time spent flushing consensus metadata: real 0.668s	user 0.003s	sys 0.009s
I20260709 13:20:32.665524 24411 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:32.688133 24604 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.700744 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.714119 24448 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:32.622555 24673 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.715967 19184 leader_election.cc:400] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18.
I20260709 13:20:32.718786 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.721325 19213 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:32.721292 24448 raft_consensus.cc:2749] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.716709 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.700585 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.725080 24650 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:32.725889 24650 consensus_queue.cc:1048] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:32.688720 24703 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:32.727557 24476 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:32.703063 24704 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:32.727382 24703 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.701747 24411 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.744258 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.745405 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:32.707010 24635 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.707484 24546 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.717155 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.694592 24672 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:32.702945 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:32.730098 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.731844 19184 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.743323 19220 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 20.
I20260709 13:20:32.655536 24185 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.744748 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.745985 19217 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:32.657871 24464 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.739333 24560 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.774258 19141 raft_consensus.cc:1240] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 21 FOLLOWER]: Rejecting Update request from peer 55991c1f7f474a9888725d00438d8a83 for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 13:20:32.783375 24669 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.784471 19068 raft_consensus.cc:2368] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17.
I20260709 13:20:32.751240 24640 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:32.779593 19217 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:32.787364 24673 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.786645 24682 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:32.843577 24703 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:32.848783 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.849264 24635 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.849789 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.849745 24635 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.850939 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.851830 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.851972 24476 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.852032 24636 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.852455 19113 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.852663 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:32.850996 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.857430 19147 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
W20260709 13:20:32.840684 24686 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:32.862181 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.863382 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:32.864398 19140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:32.872421 19138 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.852574 24476 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.872448 19140 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.878265 19184 leader_election.cc:400] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17.
I20260709 13:20:32.878568 19184 leader_election.cc:403] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:20:32.880061 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57618.2us
I20260709 13:20:32.880762 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:32.882841 19038 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:32.851835 24635 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.859854 24633 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.886432 19110 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:32.866868 24234 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:32.889533 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.874284 24649 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.892181 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.892107 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.892269 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.879423 23965 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.900626 24678 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:32.904942 24692 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:32.888311 24411 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:32.907148 24659 consensus_meta.cc:287] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Time spent flushing consensus metadata: real 0.827s	user 0.013s	sys 0.001s
I20260709 13:20:32.955060 24560 consensus_queue.cc:1059] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:32.907792 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:32.945312 24678 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.957311 24678 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.957350 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:32.950507 23965 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.959517 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:32.903680 24604 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.852690 24636 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.875578 24510 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.889662 24652 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:32.971529 24652 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 20 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:32.972476 24652 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:32.912021 24705 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.891633 24234 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.889382 24690 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.976303 24234 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.977702 24690 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.893344 24674 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.977507 19142 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:32.921543 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.893774 24408 consensus_queue.cc:1048] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:32.985607 24636 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.985728 19069 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:32.986099 24674 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 16. Current term is 17.
I20260709 13:20:32.986249 24647 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:32.975986 24705 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.923656 24505 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.927417 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:32.987455 24705 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.987752 19147 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.930040 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:32.922853 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.931032 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:32.932156 24614 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.882506 24612 raft_consensus.cc:2749] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:32.935374 19144 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:32.935778 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:32.991742 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:32.941358 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:32.905880 24669 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.995434 24614 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:32.995899 19215 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.997123 19145 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:20:32.997444 19145 pending_rounds.cc:85] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Aborting all ops after (but not including) 8
I20260709 13:20:32.997653 19145 pending_rounds.cc:107] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:20:32.997864 19145 raft_consensus.cc:2889] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:32.998042 24604 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:32.998546 24604 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:32.999946 24510 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:33.000305 19144 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:32.996758 24505 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:32.951787 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:33.007081 24614 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:32.964597 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:33.009860 24405 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.000664 24604 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:32.921166 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 68821.3us
I20260709 13:20:32.995720 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:33.012019 19113 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.013756 19113 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.016073 24702 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:33.016325 19215 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 18.
I20260709 13:20:33.016713 24702 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:20:32.986747 24647 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:33.021891 24647 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.023247 24647 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.932576 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:32.941233 19138 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:32.998451 24587 consensus_queue.cc:260] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:33.010387 24185 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 21 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:33.024608 24476 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.975952 19146 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.960841 23965 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:32.952013 19140 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 18.
I20260709 13:20:33.034081 19147 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 18.
W20260709 13:20:33.038805 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 44209.7us
I20260709 13:20:33.054790 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.055219 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:33.026515 19214 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:33.051779 19113 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.056803 19072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:33.058250 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
W20260709 13:20:33.055542 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 87213.3us
I20260709 13:20:33.063313 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:33.064308 19214 raft_consensus.cc:2393] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 18: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:33.067603 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:33.069705 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:33.070217 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:33.074499 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:33.077137 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:33.053591 24676 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.083369 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:33.080015 19038 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:33.093192 19068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:33.093523 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.094574 19038 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:33.073740 24476 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:33.099280 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:33.099710 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:33.102175 19146 raft_consensus.cc:2368] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18.
I20260709 13:20:33.102939 19065 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:33.088333 24464 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:33.116287 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:33.116822 24718 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:33.116868 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:33.117619 19212 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:33.122301 24684 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:33.098927 24525 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:33.125418 19212 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 12.
I20260709 13:20:33.113152 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:33.126402 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:33.089737 24660 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:33.147423 19038 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:33.128708 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:33.147665 19068 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:33.130111 19184 leader_election.cc:400] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18.
I20260709 13:20:33.104133 24266 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:33.135326 24701 consensus_queue.cc:1059] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:33.138208 24678 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.105676 24587 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.150233 19184 leader_election.cc:403] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:20:33.153002 19066 raft_consensus.cc:2368] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:33.132797 24527 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:33.155619 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.162029 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:33.162791 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:33.176556 19065 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:33.130363 24408 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.109807 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:33.167557 19216 raft_consensus.cc:2410] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc for term 21 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:20:33.169157 24722 ts_tablet_manager.cc:933] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:33.157260 19069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:33.173056 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59836 (request call id 14) took 8364 ms. Trace:
I20260709 13:20:33.174367 24705 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.168612 19217 raft_consensus.cc:1275] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:20:33.178320 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 77133.6us
I20260709 13:20:33.180826 19110 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.182581 19069 raft_consensus.cc:606] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:33.189529 19069 raft_consensus.cc:614] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:33.179728 24718 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:33.167241 24682 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 17. Current term is 18.
W20260709 13:20:33.228034 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47294.3us
I20260709 13:20:33.226058 24185 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:20:33.252703 24500 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:33.253253 24500 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:33.253916 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14973b885f3f4ff1833ff0e215658aa9"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:33.254702 19144 raft_consensus.cc:606] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:33.255084 19144 raft_consensus.cc:614] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:33.255625 24500 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:33.186638 24408 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:33.261474 19217 raft_consensus.cc:1240] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:33.262408 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:33.263051 19217 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:33.265336 19069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:33.265905 19069 raft_consensus.cc:606] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:33.267303 24719 consensus_queue.cc:1059] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:33.268815 24719 raft_consensus.cc:3055] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:33.269150 24719 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:33.269964 24719 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.271219 24719 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.229295 24718 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.230556 24476 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:33.232250 24705 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:33.232741 24699 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:33.232952 24527 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:33.276247 19217 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:20:33.233213 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 45727us
I20260709 13:20:33.280205 24659 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:33.281106 24729 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:33.165282 24464 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:20:33.243438 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:33.182106 24728 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:20:33.275712 24527 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.292193 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:33.248014 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.179747 24578 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:33.184971 24672 rpcz_store.cc:276] 0709 13:20:24.797448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.798517 (+  1069us) service_pool.cc:224] Handling call
0709 13:20:25.440653 (+642136us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b5400025ba0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103507520 00007f6103590b42 00007f610358f800 00007f6108550d29 00007f6101acf1d4 00007f6101acf162 00007f6101acf091 00007f6101acf00c 00007f6101ace2c2 00007f61018c548c
0709 13:20:25.474810 (+ 34157us) log.cc:844] Serialized 499 byte log entry
0709 13:20:25.720563 (+245753us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18000a7020. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f6100417c0a 00007f6109b57219 00007f610049fa40 00007f610049a4e4 00007f610049a455 00007f61034e3b0b 00007f6103568b63 00007f6103590752 00007f6108550d29
0709 13:20:26.163099 (+442536us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b5400025ba0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103503062 00007f61034e3eaa 00007f61034ead53 00007f61034eacd9 00007f61034eac69 00007f61034eac31 00007f61034e9dfd 000000000038f354 000000000038f199 00007f610049d475
0709 13:20:26.361963 (+198864us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5400025ba0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f61034ffdbe 00007f610350a930 00007f610350a8d8 00007f610350a858 00007f610350a813 00007f6103509a9c 00007f61093f5626 00007f61093efdd8 00007f61035467cb 00007f61035492c0
0709 13:20:26.568073 (+206110us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b5400025ba0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f6103503062 00007f61034e3eaa 00007f61034ead53 00007f61034eacd9 00007f61034eac69 00007f61034eac31 00007f61034e9dfd 000000000038f354 000000000038f199 00007f610049d475
0709 13:20:33.134988 (+6566915us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43251,"raft.queue_time_us":85232,"raft.run_cpu_time_us":6038,"raft.run_wall_time_us":1333563,"spinlock_wait_cycles":552101376,"thread_start_us":169360,"threads_started":1,"wal-append.queue_time_us":333075,"wal-append.run_cpu_time_us":4495,"wal-append.run_wall_time_us":1554309}
I20260709 13:20:33.299540 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:33.308784 19141 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
I20260709 13:20:33.309135 19744 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:33.338762 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:33.339624 19144 raft_consensus.cc:606] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:33.313351 24604 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:33.312892 24578 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:33.402261 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:33.429744 19139 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:33.432085 19221 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:33.405684 24722 tablet_copy_client.cc:323] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
W20260709 13:20:33.452780 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 204793us
I20260709 13:20:33.394873 24234 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.456609 19110 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.461695 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.463820 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.465613 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:33.453354 24659 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:33.551453 19220 raft_consensus.cc:1240] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:33.549746 19012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.BulkChangeConfig -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 82381.9us
W20260709 13:20:33.560300 24730 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:33.466642 24464 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.469794 23965 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.468695 24636 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:33.665149 19215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.008s	sys 0.002s
W20260709 13:20:33.665661 19215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.002s
I20260709 13:20:33.547933 24659 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:33.629779 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 226143us
I20260709 13:20:33.569368 24185 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:33.674924 24659 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:33.678828 24736 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.058s	user 0.004s	sys 0.000s
I20260709 13:20:33.546602 24578 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.691447 24718 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:33.721486 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 255920us
I20260709 13:20:33.725358 24652 consensus_queue.cc:1048] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:33.726024 24587 consensus_meta.cc:287] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.002s
I20260709 13:20:33.724045 24718 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.729815 24718 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:33.737092 19064 raft_consensus.cc:1240] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:33.752123 23965 consensus_queue.cc:1059] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:33.753026 23965 raft_consensus.cc:3055] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:33.753360 23965 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:33.754160 23965 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.755259 23965 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.757872 24408 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:33.744163 24234 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:33.774158 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40764 (request call id 2510) took 1131 ms. Trace:
I20260709 13:20:33.774590 19221 rpcz_store.cc:276] 0709 13:20:32.642730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.642869 (+   139us) service_pool.cc:224] Handling call
0709 13:20:33.773947 (+1131078us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400003054. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358e2fa 00007f610854fb17 00007f6101aca6d4 00007f6101aca662 00007f6101aca591 00007f6101aca50c 00007f6101ac97c2 00007f61018c548c 00007f61018c48c6 00007f61018c426f
0709 13:20:33.774054 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599220992}
I20260709 13:20:33.775883 19219 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:33.778832 24694 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:33.779201 24694 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:33.780041 24694 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.781635 19184 leader_election.cc:400] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:33.781972 19184 leader_election.cc:403] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:20:33.782675 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:33.783068 24659 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:33.786659 24673 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 11. Current term is 12.
I20260709 13:20:33.787304 24673 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:33.787626 24673 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.787943 24673 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.793357 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:33.806073 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:33.797257 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:33.811208 19113 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:33.782698 24724 log.cc:927] Time spent T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.639s	user 0.017s	sys 0.038s
W20260709 13:20:33.822729 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.827498 19212 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:33.819291 24694 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.830024 24587 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:20:33.823626 24747 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:33.821806 24718 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:33.851997 24718 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.864179 24673 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:33.847258 24659 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:33.858441 24697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.008s	sys 0.014s
I20260709 13:20:33.869479 24718 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:33.868795 24697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.008s	sys 0.014s
I20260709 13:20:33.856483 24746 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:33.884122 24660 raft_consensus.cc:3055] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:33.884595 24660 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:33.885483 24660 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.890909 24636 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:33.913681 24747 raft_consensus.cc:993] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:33.914314 24747 raft_consensus.cc:1081] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:33.899501 24746 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:33.929677 19066 raft_consensus.cc:2468] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
W20260709 13:20:33.933408 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 98139.9us
I20260709 13:20:33.942505 19216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:33.970716 19216 raft_consensus.cc:493] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.971217 19216 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:33.950580 24673 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:33.985334 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:33.999002 24755 raft_consensus.cc:493] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:33.999610 24755 raft_consensus.cc:515] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.001731 24755 leader_election.cc:290] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:34.007731 24754 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:34.010306 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:34.011169 19219 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
W20260709 13:20:34.017887 24726 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.875s	user 0.004s	sys 0.012s
I20260709 13:20:34.019492 19213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2371) took 1065 ms. Trace:
I20260709 13:20:34.019817 19213 rpcz_store.cc:276] 0709 13:20:32.954497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.002385 (+ 47888us) service_pool.cc:224] Handling call
0709 13:20:33.002661 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:33.003027 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:33.003316 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:20:33.094961 (+ 91645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:33.095354 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.100943 (+  5589us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:33.100981 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.101042 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.017306 (+916264us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b4400022b4c. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f61003c3c85 00007f61003c46a2 00007f61031361db 00007f6103131aaf 00007f610312586e 00007f6103124bb6 00007f61031247d8 00007f610312e221 00007f610312e1d9 00007f610312e169
0709 13:20:34.019228 (+  1922us) raft_consensus.cc:1685] finished
0709 13:20:34.019323 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.019438 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4313,"prepare.queue_time_us":584,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":8104,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":4446,"spinlock_wait_cycles":20915072,"thread_start_us":86953,"threads_started":1,"wal-append.queue_time_us":139328}
I20260709 13:20:34.028780 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:34.028690 24760 log.cc:927] Time spent T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:20:34.033807 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:34.035228 19213 raft_consensus.cc:2393] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 17: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:34.029515 19064 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:34.038520 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:34.038697 19219 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:34.039915 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:20:34.043449 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 57458.1us
I20260709 13:20:34.039960 19743 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:34.045287 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:34.042676 19216 raft_consensus.cc:515] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.046635 19035 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:34.051138 19219 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:34.055537 19217 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:34.046329 19184 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:34.062407 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.066581 19216 leader_election.cc:290] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:34.047004 24692 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.054119 24264 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:34.066340 24234 raft_consensus.cc:2804] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:34.086377 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:34.092420 19139 raft_consensus.cc:3055] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:34.092849 19139 raft_consensus.cc:740] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:34.099057 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 61d161ec86f94a4eaf383729c1ddbc87 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:34.099676 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 61d161ec86f94a4eaf383729c1ddbc87 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-61d161ec86f94a4eaf383729c1ddbc87
I20260709 13:20:34.101414 19035 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:34.103953 24411 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:34.097544 24234 raft_consensus.cc:697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:34.104811 24411 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:34.105978 24234 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.108431 19144 raft_consensus.cc:1240] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:34.115509 19146 raft_consensus.cc:1240] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:34.115701 19082 tablet_copy_source_session.cc:215] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:34.116997 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddcb71ca04ee449ba3db37be4900a2cd" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:34.117580 19069 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.117642 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.118278 19146 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:34.121127 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c875508da24d49ae8496600c3e674b63" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.121742 19146 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.124967 19216 raft_consensus.cc:1240] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Rejecting Update request from peer 508ee2e0531b43d7a1c05f950644ae66 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:34.130872 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:34.122452 19139 consensus_queue.cc:260] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.094709 24264 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:34.131443 19219 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:20:34.136763 19145 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:34.139990 19139 raft_consensus.cc:3060] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.138573 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:34.165601 19138 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:34.191457 19069 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:34.196417 19744 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:34.199764 19184 leader_election.cc:304] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:34.178182 24694 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.206888 24669 consensus_queue.cc:1059] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:34.203704 24694 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.212296 24694 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.206530 24673 raft_consensus.cc:2804] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:34.217387 24673 raft_consensus.cc:697] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:34.218344 24673 consensus_queue.cc:237] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.223703 24264 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.233498 19146 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:34.236387 24669 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:34.238376 24744 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:34.238476 19038 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:34.239710 24744 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:34.241312 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40750 (request call id 2372) took 1286 ms. Trace:
I20260709 13:20:34.241088 24739 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:34.241676 19220 rpcz_store.cc:276] 0709 13:20:32.963041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.002670 (+ 39629us) service_pool.cc:224] Handling call
0709 13:20:33.002934 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.552012 (+549078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.241082 (+689070us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540024c554. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f3571 00007f610358ae01 00007f610358983e 00007f610854e419 00007f6101ac5bd4 00007f6101ac5b62 00007f6101ac5a91 00007f6101ac5a0c 00007f6101ac4cc2 00007f61018c548c 00007f61018c48c6
0709 13:20:34.241235 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251291008}
I20260709 13:20:34.242408 24678 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:34.246296 24746 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:34.254383 24510 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:34.254477 24651 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:34.268838 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:34.270891 19139 raft_consensus.cc:2468] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:34.300354 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.306546 19714 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
W20260709 13:20:34.318435 24761 log.cc:927] Time spent T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:20:34.311693 24759 log.cc:927] Time spent T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:20:34.326764 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:34.319260 24640 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:34.309481 24510 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:34.338750 24722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d161ec86f94a4eaf383729c1ddbc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.330376 24757 raft_consensus.cc:493] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
W20260709 13:20:34.344499 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.345007 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:34.343436 24695 consensus_queue.cc:1059] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:20:34.348634 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7ecd70203b43ca9b21a47be75683e4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:34.340176 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
W20260709 13:20:34.344805 24766 log.cc:927] Time spent T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:20:34.325686 24650 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.357262 19066 raft_consensus.cc:606] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:34.347414 24694 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.372149 19038 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:34.339243 24640 raft_consensus.cc:493] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.382663 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:34.383244 19220 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.373288 24694 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:34.391683 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:34.353051 24731 consensus_queue.cc:1059] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:20:34.383102 24640 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.404620 24613 raft_consensus.cc:493] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:34.376998 24650 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.418963 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:34.419656 19143 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:34.422549 24701 raft_consensus.cc:993] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:34.367130 24510 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.393518 24527 raft_consensus.cc:2749] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.438584 24719 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:34.364615 24757 raft_consensus.cc:515] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.475369 24757 leader_election.cc:290] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:34.469689 24731 consensus_queue.cc:1243] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:34.468060 24613 raft_consensus.cc:515] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.478842 24613 leader_election.cc:290] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:34.476903 24705 raft_consensus.cc:1081] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:34.482787 24650 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:34.483915 24660 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:34.467664 24756 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.484841 24756 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.486915 24756 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:34.457631 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 82231us
I20260709 13:20:34.461776 19138 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:34.465834 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 95668.1us
I20260709 13:20:34.491535 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:34.491568 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.492769 19142 raft_consensus.cc:2410] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:34.499620 19220 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:34.509800 19143 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:34.455582 24718 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:20:34.533818 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 45786.6us
I20260709 13:20:34.543869 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.545667 19142 raft_consensus.cc:2393] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 21: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
W20260709 13:20:34.545553 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56138.3us
I20260709 13:20:34.545496 19138 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 17.
I20260709 13:20:34.547143 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:34.547353 19038 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:34.476084 24719 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.550750 19142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:20:34.551280 19142 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:34.551599 19142 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.554607 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:34.559727 19744 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:34.560984 24640 raft_consensus.cc:515] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.563035 24640 leader_election.cc:290] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:34.565555 24774 log.cc:927] Time spent T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:34.565646 24264 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:34.566277 24264 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:34.567076 24264 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.553512 24742 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:34.576292 24613 raft_consensus.cc:493] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:34.578207 19066 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:34.583896 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:34.584666 19220 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.601097 24719 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:34.605613 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:34.613572 24685 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:34.614049 24685 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:34.614748 24777 log.cc:927] Time spent T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:20:34.614881 24685 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.617131 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:34.617905 19743 raft_consensus.cc:2393] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:20:34.576866 24613 raft_consensus.cc:515] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.618661 24756 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.619129 24756 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.619468 24756 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.595230 24652 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:34.620756 24613 leader_election.cc:290] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:34.653234 19220 raft_consensus.cc:2468] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 18.
I20260709 13:20:34.667811 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:34.669353 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.680683 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:34.681741 19142 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.699055 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.696547 19717 leader_election.cc:304] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:34.634840 24722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42932 (request call id 758) took 1757 ms. Trace:
I20260709 13:20:34.680716 24685 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:34.711102 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:34.711659 19142 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 20 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:34.711669 19067 raft_consensus.cc:3055] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:34.712760 19067 raft_consensus.cc:740] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
W20260709 13:20:34.714231 24778 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.240s	user 0.000s	sys 0.003s
I20260709 13:20:34.720228 24784 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.720799 24784 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.722756 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.723053 24784 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:34.724009 24698 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:34.724715 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.724613 24698 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.726540 19138 raft_consensus.cc:3060] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.726650 24663 raft_consensus.cc:3055] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:34.726840 24698 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:34.727072 24663 raft_consensus.cc:740] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:34.727934 24663 consensus_queue.cc:260] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:34.733914 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 46464.1us
I20260709 13:20:34.737169 19067 consensus_queue.cc:260] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.739784 19067 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.697413 24678 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:34.743878 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8c498b148c4d5db7c4a7d0e2b24360" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:34.761986 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debddc2dd9264017aeda9f1cad516f83" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:34.762530 19751 raft_consensus.cc:3060] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:34.744225 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 186512us
I20260709 13:20:34.745944 19138 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:34.756755 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cdd87d3b9846a1a1863432e72d2d75" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:34.739344 24525 raft_consensus.cc:2804] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:34.758457 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57ee419ffa74c87b2c5eb26b930d9ef" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:34.741178 24663 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.738189 24510 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:34.773041 19067 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 20.
I20260709 13:20:34.772176 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:34.776335 19110 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:34.795710 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:34.790966 24525 raft_consensus.cc:697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:20:34.797411 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:34.804080 19751 raft_consensus.cc:2468] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 20.
I20260709 13:20:34.787381 23965 raft_consensus.cc:2804] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:34.767891 24678 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.806870 19184 leader_election.cc:304] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:34.803777 24692 raft_consensus.cc:2749] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:34.841391 23965 raft_consensus.cc:697] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 20 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:34.842375 23965 consensus_queue.cc:237] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.803339 24652 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:34.828787 19037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.831701 24756 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.804476 24788 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.804600 24747 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.853222 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:34.862375 24747 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.862938 19067 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 20.
I20260709 13:20:34.854423 24678 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:20:34.854869 24786 log.cc:927] Time spent T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:20:34.848549 24652 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.852670 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.870733 19146 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 21.
I20260709 13:20:34.857061 24791 raft_consensus.cc:2749] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:34.858814 24756 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:34.859334 19145 raft_consensus.cc:2368] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 16. Current term is 17.
I20260709 13:20:34.872665 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:34.859774 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:34.874110 19751 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.865669 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75fa1003f49c4855bf92d61c4fc4e4ed" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:34.875322 19064 raft_consensus.cc:3060] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.868003 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:34.876389 19067 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:34.873304 19071 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:34.880012 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:34.880263 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:34.881008 19065 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:34.880589 19139 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:34.705284 24722 rpcz_store.cc:276] 0709 13:20:32.883587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.887845 (+  4258us) service_pool.cc:224] Handling call
0709 13:20:33.217750 (+329905us) ts_tablet_manager.cc:934] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
0709 13:20:34.337409 (+1119659us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:34.536569 (+199160us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:34.536697 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:34.632973 (+ 96276us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:34.634250 (+  1277us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:34.634577 (+   327us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:34.634638 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":300,"tablet-copy.queue_time_us":161394,"thread_start_us":265426,"threads_started":2}
I20260709 13:20:34.890827 24722 tablet_copy_client.cc:806] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:34.891454 24722 tablet_copy_client.cc:670] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:34.882359 19184 leader_election.cc:304] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:34.901427 24652 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:34.879406 24747 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:34.895416 24684 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:34.903023 24684 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.903340 24684 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.910442 19751 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:34.912422 19184 leader_election.cc:304] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:34.918741 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:34.920548 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:34.922369 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:34.925530 24692 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:34.925926 24692 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.926246 24692 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.798333 24525 consensus_queue.cc:237] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:34.923089 24757 raft_consensus.cc:2749] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.943953 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:34.923439 24791 raft_consensus.cc:2749] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.952456 19184 leader_election.cc:304] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:34.952694 19069 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:34.954949 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:34.932475 24678 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:20:34.957794 24757 raft_consensus.cc:2749] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.965059 19113 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:34.971645 24613 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:20:34.982239 24758 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.967083 24791 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:20:34.990921 24684 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:34.993268 24684 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:34.999009 19035 leader_election.cc:400] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 16. Current term is 17.
I20260709 13:20:34.999377 19035 leader_election.cc:403] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:34.999893 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:35.000469 19069 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.011853 19069 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 19.
I20260709 13:20:35.012857 19110 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:35.013338 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:35.015695 24604 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:35.017344 19064 raft_consensus.cc:2468] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 17.
I20260709 13:20:35.018448 19110 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:35.023442 19144 raft_consensus.cc:1275] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:35.035341 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:35.043089 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:35.038373 24500 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 16. Current term is 17.
I20260709 13:20:35.048357 19213 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:35.048888 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409c2d9a573f4e408b732ebafda96921" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:35.060503 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:35.066493 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:34.962517 24692 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.082099 19215 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:35.064139 24758 raft_consensus.cc:2804] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:35.086150 19214 raft_consensus.cc:2368] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 21. Current term is 22.
I20260709 13:20:35.064096 24668 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.064359 24604 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:35.070604 24698 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:35.070847 24678 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.100910 24698 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:35.101399 24698 raft_consensus.cc:3060] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.095705 24668 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.070735 24757 consensus_queue.cc:1048] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:35.106424 24758 raft_consensus.cc:697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:35.184897 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:35.185707 19064 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.213181 19064 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 22.
W20260709 13:20:35.214481 24796 log.cc:927] Time spent T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:35.214658 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:35.215561 24678 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:35.216107 24678 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:35.217345 24678 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.164669 24604 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.212818 24668 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:35.229563 24692 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 22 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:35.206280 24758 consensus_queue.cc:237] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:35.230286 24698 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:35.236753 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 96661.5us
I20260709 13:20:35.269733 24636 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.270328 24636 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.272571 24636 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:35.274716 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:35.280794 19064 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 14.
I20260709 13:20:35.278465 24698 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:35.280036 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:35.281558 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:35.282080 19066 raft_consensus.cc:2393] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:35.282779 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:35.283332 19142 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 14.
I20260709 13:20:35.283349 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:35.284787 24636 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.285176 24636 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.285521 24636 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.297668 19142 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:35.247062 24668 consensus_queue.cc:1059] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:20:35.307881 24668 raft_consensus.cc:3055] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:35.308352 24668 raft_consensus.cc:740] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:35.309389 24668 consensus_queue.cc:260] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:35.312095 24668 raft_consensus.cc:3060] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.315478 24636 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.315579 18969 catalog_manager.cc:5697] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 12 to 13, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:35.333577 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:35.338102 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:35.338341 24578 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.338753 24578 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.339210 24578 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.341818 19743 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:35.343451 24702 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:35.345252 18969 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 17, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 17 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.347026 18969 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.348510 18969 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 16, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 16 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.350659 18969 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.352728 18969 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 14, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 14 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.355005 18969 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 11 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 17 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:35.360471 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 102192us
I20260709 13:20:35.361688 24744 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:35.364288 24744 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:35.361795 19038 leader_election.cc:400] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 21. Current term is 22.
I20260709 13:20:35.366276 19038 leader_election.cc:403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.356844 18969 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 6 to 10, term changed from 13 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:35.396116 19036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.396910 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:35.401363 19744 raft_consensus.cc:1240] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:35.404446 19218 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:20:35.439563 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 62172.3us
I20260709 13:20:35.377238 24659 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345) with higher term. Message: Invalid argument: T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 21. Current term is 22.
I20260709 13:20:35.447532 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
W20260709 13:20:35.450842 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49551.2us
I20260709 13:20:35.449016 24636 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:35.466424 24722 tablet_copy_client.cc:538] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:35.499001 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:35.499651 19142 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.505553 19071 raft_consensus.cc:1275] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:35.509269 19142 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 22.
I20260709 13:20:35.512255 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:35.486037 24701 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:20:35.554721 19218 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:35.559885 19147 raft_consensus.cc:2468] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:20:35.523844 24791 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:20:35.574142 24809 log.cc:927] Time spent T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:20:35.575395 24810 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:20:35.577152 24808 log.cc:927] Time spent T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:20:35.580343 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 113043us
W20260709 13:20:35.587809 24815 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 13:20:35.515188 24636 consensus_queue.cc:1048] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:20:35.596216 24791 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.609308 24791 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:35.625240 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:35.626032 19069 raft_consensus.cc:2368] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 18. Current term is 19.
I20260709 13:20:35.636350 18969 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 17 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:35.637878 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 107640us
I20260709 13:20:35.639212 19184 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:35.619817 24731 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:20:35.644001 24792 raft_consensus.cc:2804] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:35.644975 24792 raft_consensus.cc:697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:35.645956 24792 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.646973 18969 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.648393 18969 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 11 to 13, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:35.652124 24578 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.655561 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:35.655917 19066 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:35.656032 24578 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:35.661216 18969 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 11 to 12, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 12 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:35.662797 18969 catalog_manager.cc:5697] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 9, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 9 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:35.672992 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:35.673743 19142 raft_consensus.cc:2393] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 15: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:20:35.677937 19184 leader_election.cc:400] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 18. Current term is 19.
I20260709 13:20:35.678236 19184 leader_election.cc:403] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.679430 24613 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:20:35.689996 18963 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60514 (request call id 222) took 30135 ms (client timeout 15000 ms). Trace:
I20260709 13:20:35.691430 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:35.694669 18969 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 12 to 14, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 14 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.698202 19065 raft_consensus.cc:1275] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:20:35.698716 19065 pending_rounds.cc:85] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting all ops after (but not including) 13
I20260709 13:20:35.698957 19065 pending_rounds.cc:107] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:35.699208 19065 raft_consensus.cc:2889] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:35.696949 18969 catalog_manager.cc:5697] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.696166 24636 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:35.717309 18969 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 9 to 12, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 12 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:35.690589 18963 rpcz_store.cc:269] 0709 13:20:05.554860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.555187 (+   327us) service_pool.cc:224] Handling call
0709 13:20:35.689887 (+30134700us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:32.362200 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:32.362993 (+   793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:32.363063 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:20:32.363083 (+    20us) tablet.cc:662] Decoding operations
0709 13:20:32.364730 (+  1647us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:32.364819 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:32.364850 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:20:32.710719 (+345869us) tablet.cc:701] Row locks acquired
0709 13:20:32.710768 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:20:32.710924 (+   156us) write_op.cc:270] Start()
0709 13:20:32.711083 (+   159us) write_op.cc:276] Timestamp: P: 1783603232710857 usec, L: 0
0709 13:20:32.711115 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:20:32.711805 (+   690us) log.cc:844] Serialized 7496 byte log entry
0709 13:20:33.168007 (+456202us) op_driver.cc:464] REPLICATION: finished
0709 13:20:33.459965 (+291958us) write_op.cc:301] APPLY: starting
0709 13:20:33.535952 (+ 75987us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:33.709484 (+173532us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:33.709630 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:33.908637 (+199007us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:33.972379 (+ 63742us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:20:33.983279 (+ 10900us) write_op.cc:312] APPLY: finished
0709 13:20:34.000212 (+ 16933us) log.cc:844] Serialized 172 byte log entry
0709 13:20:34.000433 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:34.000609 (+   176us) write_op.cc:454] Released schema lock
0709 13:20:34.000688 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:34.001122 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:34.001154 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3602167,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":269974,"apply.run_cpu_time_us":26485,"apply.run_wall_time_us":550536,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83471,"num_ops":19,"prepare.queue_time_us":618549,"prepare.run_cpu_time_us":18518,"prepare.run_wall_time_us":391781,"raft.queue_time_us":224962,"raft.run_cpu_time_us":67420,"raft.run_wall_time_us":196354,"replication_time_us":447834,"thread_start_us":922144,"threads_started":4,"wal-append.queue_time_us":77071,"wal-append.run_cpu_time_us":30247,"wal-append.run_wall_time_us":2190061}]]}
I20260709 13:20:35.721395 18969 catalog_manager.cc:5697] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.739157 18969 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 9 to 14, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:35.740439 18969 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 12, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 12 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.746918 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:35.758517 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:35.799132 19142 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:20:35.780498 24807 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:35.785509 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:35.802958 24791 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.782009 24408 consensus_queue.cc:1048] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:20:35.802167 24684 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:35.811328 24668 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.811576 24682 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:20:35.886353 24819 log.cc:927] Time spent T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:35.886970 24722 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:35.838258 24684 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.889319 24684 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:35.891606 24820 log.cc:927] Time spent T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:35.894697 19064 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:35.898650 23965 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:35.848551 24698 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:35.904975 24698 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.840674 24668 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:35.907059 24698 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:35.833659 24791 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:35.910642 24824 log.cc:927] Time spent T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:20:35.911755 24791 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:35.915397 24613 raft_consensus.cc:2749] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 18. Current term is 19.
I20260709 13:20:35.894656 19065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:35.919793 19065 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:35.922904 19746 raft_consensus.cc:1275] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:35.923453 19071 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:35.927909 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:35.929122 24684 consensus_queue.cc:1048] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:35.929500 24747 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.940256 24747 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:35.940676 24747 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.941651 24668 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:35.929914 24699 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:35.959949 19218 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:35.972173 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:35.989473 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 221383us
I20260709 13:20:35.996519 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:35.997538 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:35.997279 19218 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
W20260709 13:20:35.995111 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 187987us
I20260709 13:20:36.010547 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:36.011209 19146 raft_consensus.cc:2368] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:36.014180 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:35.989616 24818 raft_consensus.cc:493] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.022676 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:36.034221 24705 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.034682 24705 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.035065 24705 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.036710 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:36.037853 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:36.039011 19063 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:20:36.040588 19184 leader_election.cc:400] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:36.041007 19184 leader_election.cc:403] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:36.041586 19066 raft_consensus.cc:2368] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:36.026832 24818 raft_consensus.cc:515] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:36.021430 24801 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:20:36.064997 24827 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.055456 24804 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:36.093165 24804 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:36.148126 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 65463.9us
I20260709 13:20:36.259524 24818 leader_election.cc:290] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:36.261231 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:36.261871 19743 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 19.
I20260709 13:20:36.264518 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:36.265424 24669 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:36.268291 24669 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:36.268644 24669 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:36.273483 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 204699us
I20260709 13:20:36.279233 19184 leader_election.cc:400] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919) with higher term. Message: Invalid argument: T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:36.283280 19143 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:36.286422 24747 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:36.287413 24834 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:36.314131 24669 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:36.256690 24827 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307) with higher term. Message: Invalid argument: T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 for earlier term 14. Current term is 15.
I20260709 13:20:36.318220 19142 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:36.321703 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:36.366915 19144 raft_consensus.cc:2410] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:20:36.347967 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8a26e15ebb4ecfae8b6eff7a8cc22f" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:36.348093 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:36.367748 19215 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 19: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:36.351713 24669 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:36.291348 24804 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:36.353312 24747 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:36.354233 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:36.360111 24705 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:36.324082 24791 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:36.369902 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:36.397691 19220 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 15: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:36.401897 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:36.402972 19215 raft_consensus.cc:2393] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in current term 19: Already voted for candidate 55991c1f7f474a9888725d00438d8a83 in this term.
I20260709 13:20:36.409852 19038 leader_election.cc:304] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:36.411572 19069 raft_consensus.cc:2393] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in this term.
I20260709 13:20:36.415676 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:36.433164 19746 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 19.
I20260709 13:20:36.440737 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:36.442008 24705 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:36.442425 24604 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:36.414556 24510 raft_consensus.cc:2749] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:36.445218 19066 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:36.453392 19035 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:36.454731 24660 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:36.455224 24660 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:36.456066 24660 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:36.457394 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:36.477478 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:36.478091 19215 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:36.506947 24835 log.cc:927] Time spent T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:20:36.514901 19215 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:36.516757 19038 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:36.537449 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:36.540548 24678 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:36.545171 24264 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:36.563941 24264 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:36.564692 24264 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:36.585726 24834 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:36.767105 18969 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 117) took 15389 ms (client timeout 15000 ms). Trace:
I20260709 13:20:36.774078 18964 catalog_manager.cc:5697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.776660 18964 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 10 to 12, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 12 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:36.771370 18969 rpcz_store.cc:269] 0709 13:20:21.377927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.382856 (+  4929us) service_pool.cc:224] Handling call
0709 13:20:36.767009 (+15384153us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:35.958976 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:36.026233 (+ 67257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:36.028052 (+  1819us) write_op.cc:435] Acquired schema lock
0709 13:20:36.038583 (+ 10531us) tablet.cc:662] Decoding operations
0709 13:20:36.166458 (+127875us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:36.169984 (+  3526us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:36.170018 (+    34us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:20:36.171406 (+  1388us) tablet.cc:701] Row locks acquired
0709 13:20:36.171421 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:20:36.171560 (+   139us) write_op.cc:270] Start()
0709 13:20:36.171666 (+   106us) write_op.cc:276] Timestamp: P: 1783603236171513 usec, L: 0
0709 13:20:36.171684 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:20:36.243167 (+ 71483us) log.cc:844] Serialized 7432 byte log entry
0709 13:20:36.266324 (+ 23157us) op_driver.cc:464] REPLICATION: finished
0709 13:20:36.270780 (+  4456us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b1800266ce0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f61031324bc 00007f610048048b 00007f61092daab9 00007f610049c69b 00007f610049a93f 00007f610049a455 00007f6103507190 00007f6103500ae7 00007f61034ffdd9
0709 13:20:36.441821 (+171041us) write_op.cc:301] APPLY: starting
0709 13:20:36.441910 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:36.613730 (+171820us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:36.613757 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:36.693359 (+ 79602us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:36.693638 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:20:36.693684 (+    46us) write_op.cc:312] APPLY: finished
0709 13:20:36.694043 (+   359us) log.cc:844] Serialized 172 byte log entry
0709 13:20:36.695533 (+  1490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:36.695700 (+   167us) write_op.cc:454] Released schema lock
0709 13:20:36.695756 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:36.721160 (+ 25404us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:36.721191 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":477311,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":152796,"apply.run_cpu_time_us":24291,"apply.run_wall_time_us":279309,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83471,"num_ops":19,"prepare.queue_time_us":179138,"prepare.run_cpu_time_us":14571,"prepare.run_wall_time_us":291532,"raft.queue_time_us":5926,"raft.run_cpu_time_us":30686,"raft.run_wall_time_us":139880,"replication_time_us":93384,"spinlock_wait_cycles":5244672,"thread_start_us":202219,"threads_started":4,"wal-append.queue_time_us":6498}]]}
I20260709 13:20:36.783037 18964 catalog_manager.cc:5697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:36.791028 18964 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 5 to 10, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 10 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:36.801550 24722 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:36.813773 24722 tablet_bootstrap.cc:492] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:36.814592 24722 ts_tablet_manager.cc:1403] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.928s	user 0.039s	sys 0.021s
I20260709 13:20:36.817987 24722 raft_consensus.cc:359] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:36.818796 24722 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:36.819429 24722 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:36.822309 24722 ts_tablet_manager.cc:1434] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:20:36.823952 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-61d161ec86f94a4eaf383729c1ddbc87 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:36.824396 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-61d161ec86f94a4eaf383729c1ddbc87 on tablet 61d161ec86f94a4eaf383729c1ddbc87 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:36.891692 19212 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:36.895490 24578 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:36.896121 24578 consensus_queue.cc:1243] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Peer 55991c1f7f474a9888725d00438d8a83 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:36.898456 19215 pending_rounds.cc:85] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Aborting all ops after (but not including) 12
I20260709 13:20:36.898756 19215 pending_rounds.cc:107] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:20:36.898984 19215 raft_consensus.cc:2889] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:36.921937 19746 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:36.923475 24578 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:36.939728 18966 catalog_manager.cc:5697] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:36.947114 18966 catalog_manager.cc:5697] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:36.965102 18964 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 236) took 39836 ms (client timeout 15000 ms). Trace:
I20260709 13:20:36.966228 19143 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:36.965786 18964 rpcz_store.cc:269] 0709 13:19:57.128308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.134007 (+  5699us) service_pool.cc:224] Handling call
0709 13:20:36.964954 (+39830947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:36.830194 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:36.830773 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:36.830810 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:20:36.830830 (+    20us) tablet.cc:662] Decoding operations
0709 13:20:36.831426 (+   596us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:36.831503 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:36.831531 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:36.831923 (+   392us) tablet.cc:701] Row locks acquired
0709 13:20:36.831942 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:20:36.832087 (+   145us) write_op.cc:270] Start()
0709 13:20:36.832200 (+   113us) write_op.cc:276] Timestamp: P: 1783603236832035 usec, L: 0
0709 13:20:36.832225 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:20:36.833053 (+   828us) log.cc:844] Serialized 1694 byte log entry
0709 13:20:36.834976 (+  1923us) op_driver.cc:464] REPLICATION: finished
0709 13:20:36.835325 (+   349us) write_op.cc:301] APPLY: starting
0709 13:20:36.835410 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:36.837643 (+  2233us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:36.840515 (+  2872us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:36.842953 (+  2438us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:36.843131 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:20:36.843173 (+    42us) write_op.cc:312] APPLY: finished
0709 13:20:36.843375 (+   202us) log.cc:844] Serialized 49 byte log entry
0709 13:20:36.844166 (+   791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:36.844274 (+   108us) write_op.cc:454] Released schema lock
0709 13:20:36.844313 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:36.844650 (+   337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:36.844677 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":5796,"apply.run_wall_time_us":9284,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16704,"num_ops":4,"prepare.queue_time_us":17186,"prepare.run_cpu_time_us":3124,"prepare.run_wall_time_us":4745,"replication_time_us":2613,"thread_start_us":15459,"threads_started":1}]]}
I20260709 13:20:36.990360 19143 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:36.993997 24701 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:37.027087 18963 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 17 to 20, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 20 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.030634 18963 catalog_manager.cc:5697] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.034582 18963 catalog_manager.cc:5697] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.037324 18963 catalog_manager.cc:5697] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 15 to 17, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 17 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.044358 18963 catalog_manager.cc:5697] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.049633 18963 catalog_manager.cc:5697] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 17 to 20, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 20 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:37.051461 18966 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60514 (request call id 221) took 57926 ms (client timeout 15000 ms). Trace:
I20260709 13:20:37.053409 18963 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 14 to 16, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 16 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.056666 19215 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:37.059064 18963 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 9 to 13, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.065992 18963 catalog_manager.cc:5697] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.071902 18963 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 15, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.077889 18963 catalog_manager.cc:5697] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 9 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 17 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.079160 18963 catalog_manager.cc:5697] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 10 to 13, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 13 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:37.052022 18966 rpcz_store.cc:269] 0709 13:19:39.124726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.164567 (+ 39841us) service_pool.cc:224] Handling call
0709 13:20:37.051356 (+57886789us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:36.994906 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:36.995486 (+   580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:36.995525 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:20:36.995547 (+    22us) tablet.cc:662] Decoding operations
0709 13:20:36.995985 (+   438us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:36.996047 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:36.996078 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:20:36.996425 (+   347us) tablet.cc:701] Row locks acquired
0709 13:20:36.996447 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:20:36.996597 (+   150us) write_op.cc:270] Start()
0709 13:20:36.996713 (+   116us) write_op.cc:276] Timestamp: P: 1783603236996550 usec, L: 0
0709 13:20:36.996737 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:36.997547 (+   810us) log.cc:844] Serialized 923 byte log entry
0709 13:20:36.999428 (+  1881us) op_driver.cc:464] REPLICATION: finished
0709 13:20:36.999856 (+   428us) write_op.cc:301] APPLY: starting
0709 13:20:36.999935 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:37.001230 (+  1295us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:37.001325 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:37.002615 (+  1290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:37.002799 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:20:37.002854 (+    55us) write_op.cc:312] APPLY: finished
0709 13:20:37.003056 (+   202us) log.cc:844] Serialized 33 byte log entry
0709 13:20:37.003219 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.003311 (+    92us) write_op.cc:454] Released schema lock
0709 13:20:37.003353 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:37.003718 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.003750 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28680,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":235,"apply.run_cpu_time_us":3806,"apply.run_wall_time_us":3806,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8352,"num_ops":2,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2845,"prepare.run_wall_time_us":2901,"replication_time_us":2572}]]}
I20260709 13:20:37.086342 18963 catalog_manager.cc:5697] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.087374 18963 catalog_manager.cc:5697] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 12 to 13, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 13 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.061604 24746 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:20:37.089881 18963 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 8 to 17, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.091594 18963 catalog_manager.cc:5697] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.094154 18963 catalog_manager.cc:5697] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.103224 19746 raft_consensus.cc:1217] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Deduplicated request from leader. Original: 15.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:20:37.157934 18963 catalog_manager.cc:5697] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:37.221123 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 71944.9us
I20260709 13:20:37.472419 19746 consensus_queue.cc:237] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:37.485358 18967 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.501394 19144 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:37.502898 24857 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:37.508232 19219 raft_consensus.cc:1275] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:37.509505 24701 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.510035 24701 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.510722 18963 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 16 to 19, leader changed from 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 19 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.512164 24701 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:37.513161 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:37.513624 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:37.513803 19142 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:37.514256 19219 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:37.515293 19035 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:37.516135 24701 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:37.516497 24701 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.516836 24701 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:37.521478 18963 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index -1 to 9, term changed from 13 to 17, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:37.510027 24857 consensus_queue.cc:1048] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:20:37.545781 24701 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.552696 24858 raft_consensus.cc:1064] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:37.553889 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:37.556133 24701 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:37.556687 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:37.556340 24858 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:37.557387 19142 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:37.557654 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:37.558163 19212 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:37.578487 24558 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 10 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.581780 19212 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:37.582160 19219 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 10 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.584261 19038 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:37.586172 24860 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:37.586651 24860 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:37.587450 24860 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.597249 19142 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:37.608734 19069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:37.615296 19069 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:20:37.612135 18965 catalog_manager.cc:5697] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.621610 18965 catalog_manager.cc:5697] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 13 to 16, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.623944 18965 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 14 to 16, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:37.618706 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f8c498b148c4d5db7c4a7d0e2b24360 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:37.636647 19746 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:37.627426 18965 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 11 to 15, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 15 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:37.645288 19219 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:37.647019 18965 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.648695 18965 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 10 to 13, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.650480 18965 catalog_manager.cc:5697] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:37.652323 18965 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 7 to 13, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.654181 19069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3627cae163084c338404a5153ef0efb9"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:37.654659 24803 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:37.654256 18967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60506 (request call id 206) took 69265 ms (client timeout 15000 ms). Trace:
I20260709 13:20:37.654942 19069 raft_consensus.cc:606] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:37.654003 19142 raft_consensus.cc:2955] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 10 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.657946 24264 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:37.656318 18967 rpcz_store.cc:269] 0709 13:19:28.389452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.389758 (+   306us) service_pool.cc:224] Handling call
0709 13:20:37.654190 (+69264432us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:37.498355 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:37.498908 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:37.498947 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:20:37.498980 (+    33us) tablet.cc:662] Decoding operations
0709 13:20:37.499317 (+   337us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:37.499375 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:37.499405 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:20:37.499595 (+   190us) tablet.cc:701] Row locks acquired
0709 13:20:37.499611 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:20:37.499751 (+   140us) write_op.cc:270] Start()
0709 13:20:37.499863 (+   112us) write_op.cc:276] Timestamp: P: 1783603237499708 usec, L: 0
0709 13:20:37.499880 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:20:37.500481 (+   601us) log.cc:844] Serialized 538 byte log entry
0709 13:20:37.502089 (+  1608us) op_driver.cc:464] REPLICATION: finished
0709 13:20:37.502605 (+   516us) write_op.cc:301] APPLY: starting
0709 13:20:37.502690 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:37.503459 (+   769us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:37.503552 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:37.504290 (+   738us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:37.504445 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:20:37.504494 (+    49us) write_op.cc:312] APPLY: finished
0709 13:20:37.504663 (+   169us) log.cc:844] Serialized 25 byte log entry
0709 13:20:37.504821 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.504926 (+   105us) write_op.cc:454] Released schema lock
0709 13:20:37.504975 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:37.505265 (+   290us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.505291 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12567,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":292,"apply.run_cpu_time_us":2645,"apply.run_wall_time_us":2645,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":2391,"prepare.run_wall_time_us":2391,"replication_time_us":2071}]]}
I20260709 13:20:37.661582 19144 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:37.664285 19144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:37.664930 19144 raft_consensus.cc:606] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:37.667193 18965 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 8 to 12, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 12 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:37.670852 19069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:37.671566 19069 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Received request to transfer leadership
W20260709 13:20:37.672981 18954 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 61d161ec86f94a4eaf383729c1ddbc87 already in progress [suppressed 7 similar messages]
I20260709 13:20:37.674544 24701 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:37.676653 19069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:37.677211 19069 raft_consensus.cc:606] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:37.670903 18965 catalog_manager.cc:5697] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:37.684979 19147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:37.685655 19147 raft_consensus.cc:606] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:37.689445 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:37.689939 19071 raft_consensus.cc:606] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:37.690263 19071 raft_consensus.cc:614] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:37.693537 18965 catalog_manager.cc:5697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 9 to 16, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.697844 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:37.703859 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:37.706084 18965 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 9 to 11, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.708829 18965 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 12 to 17, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 17 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:37.710726 18965 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.712853 18965 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 13 to 15, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.714905 18965 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 12 to 14, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 14 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.747236 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:37.748544 19071 raft_consensus.cc:606] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:20:37.748766 24858 raft_consensus.cc:993] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:37.749248 24858 raft_consensus.cc:1081] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:37.751456 24701 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 9 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.755268 19746 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 9 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.757424 19219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40750
I20260709 13:20:37.757961 19219 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.758272 19219 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.776989 19219 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:37.783718 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:37.789830 19144 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 9 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.794364 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:37.795678 19069 raft_consensus.cc:3055] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:37.796026 19069 raft_consensus.cc:740] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:37.796464 19212 raft_consensus.cc:1240] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Rejecting Update request from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:37.796751 19069 consensus_queue.cc:260] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:37.797297 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:37.797895 19743 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.797973 19069 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.805758 19069 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:37.809106 19743 raft_consensus.cc:2468] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:20:37.810688 19219 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:37.811429 24578 raft_consensus.cc:993] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:37.811905 24264 raft_consensus.cc:1081] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
W20260709 13:20:37.812048 19018 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7cac62c1d5aa4356b70f6517fe0ba5d6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:37.812425 19018 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 61d161ec86f94a4eaf383729c1ddbc87 already in progress
W20260709 13:20:37.812690 19018 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 61d161ec86f94a4eaf383729c1ddbc87 already in progress
I20260709 13:20:37.813483 19212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3627cae163084c338404a5153ef0efb9"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40750
I20260709 13:20:37.814054 19212 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.814432 19212 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.822129 19212 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.823218 19184 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:37.823884 19212 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:37.824924 24828 raft_consensus.cc:2804] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:37.825466 24828 raft_consensus.cc:697] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:37.826390 24828 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:37.829038 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:37.829694 19069 raft_consensus.cc:3055] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:37.830039 19069 raft_consensus.cc:740] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:37.830821 19069 consensus_queue.cc:260] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.832065 19069 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.838792 19069 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:37.839828 19184 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:37.840637 24828 raft_consensus.cc:2804] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:37.840950 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:37.841120 24828 raft_consensus.cc:697] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:37.841732 19144 raft_consensus.cc:3060] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.842001 24828 consensus_queue.cc:237] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.862949 19144 raft_consensus.cc:2468] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:37.877990 24636 raft_consensus.cc:993] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:37.878472 24636 raft_consensus.cc:1081] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:37.881743 19219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:37.882244 19219 raft_consensus.cc:493] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.882589 19219 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.889797 19219 raft_consensus.cc:515] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.894488 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:37.895000 19069 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.901316 18963 catalog_manager.cc:5697] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 10 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 16 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.904155 19069 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:37.905200 19184 leader_election.cc:304] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:37.905913 24828 raft_consensus.cc:2804] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:37.906430 24828 raft_consensus.cc:697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:37.907239 24828 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.909636 19219 leader_election.cc:290] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:37.909801 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3846ceb53ab145bfa0ae536aa51f05d0" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:37.910385 19144 raft_consensus.cc:3055] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:37.910739 19144 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:37.911650 19144 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:37.912951 19144 raft_consensus.cc:3060] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.922569 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f8c498b148c4d5db7c4a7d0e2b24360 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:37.928378 19144 raft_consensus.cc:2468] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:37.936129 18967 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 9 to 11, term changed from 17 to 18, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to <none>, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:37.965641 24874 tablet_replica.cc:333] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:20:37.997149 24874 raft_consensus.cc:2243] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:37.997833 24874 raft_consensus.cc:2272] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:38.000735 24874 ts_tablet_manager.cc:1916] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:38.031378 18968 catalog_manager.cc:5697] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.032512 24701 raft_consensus.cc:993] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:38.032975 24701 raft_consensus.cc:1081] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:38.033349 18968 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 9 to 13, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.034613 19212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40750
I20260709 13:20:38.035156 19212 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.034886 18968 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.035501 19212 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.036088 18968 catalog_manager.cc:5697] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 16 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 17 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.037604 18968 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.043865 19212 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:38.045608 18965 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60506 (request call id 208) took 15923 ms (client timeout 15000 ms). Trace:
I20260709 13:20:38.046273 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:38.046944 19069 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:38.047503 19069 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:38.048272 19069 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:38.049737 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:38.049927 19069 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.050318 19746 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.039014 18968 catalog_manager.cc:5697] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 13 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.057976 19746 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:38.057942 18968 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 12 to 16, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.059157 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:38.059885 24828 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:38.060591 24828 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:38.061709 24828 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:38.045979 18965 rpcz_store.cc:269] 0709 13:20:22.121744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.121958 (+   214us) service_pool.cc:224] Handling call
0709 13:20:38.045528 (+15923570us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:37.723530 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:37.724022 (+   492us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:37.724053 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:20:37.724068 (+    15us) tablet.cc:662] Decoding operations
0709 13:20:37.725299 (+  1231us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:37.725353 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:37.725383 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:20:37.726523 (+  1140us) tablet.cc:701] Row locks acquired
0709 13:20:37.726536 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:20:37.726663 (+   127us) write_op.cc:270] Start()
0709 13:20:37.726760 (+    97us) write_op.cc:276] Timestamp: P: 1783603237726620 usec, L: 0
0709 13:20:37.726775 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:20:37.727597 (+   822us) log.cc:844] Serialized 6310 byte log entry
0709 13:20:37.730587 (+  2990us) op_driver.cc:464] REPLICATION: finished
0709 13:20:37.732808 (+  2221us) write_op.cc:301] APPLY: starting
0709 13:20:37.732901 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:37.780048 (+ 47147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:37.780144 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:37.840374 (+ 60230us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:37.842860 (+  2486us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:20:37.842906 (+    46us) write_op.cc:312] APPLY: finished
0709 13:20:37.843258 (+   352us) log.cc:844] Serialized 148 byte log entry
0709 13:20:37.844006 (+   748us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.844160 (+   154us) write_op.cc:454] Released schema lock
0709 13:20:37.844212 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:37.850838 (+  6626us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:37.850866 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27402,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":2020,"apply.run_cpu_time_us":19534,"apply.run_wall_time_us":117976,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66816,"num_ops":16,"prepare.queue_time_us":99,"prepare.run_cpu_time_us":4354,"prepare.run_wall_time_us":17491,"replication_time_us":3699}]]}
I20260709 13:20:38.066720 19069 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:38.059595 18968 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 11 to 14, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 14 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.059948 19212 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:38.077963 18968 catalog_manager.cc:5697] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 10 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.083254 18968 catalog_manager.cc:5697] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.087132 18968 catalog_manager.cc:5697] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 12 to 16, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.088644 18968 catalog_manager.cc:5697] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 13 to 16, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.078788 24874 ts_tablet_manager.cc:1929] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:20:38.091621 24874 log.cc:1199] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/6f8c498b148c4d5db7c4a7d0e2b24360
I20260709 13:20:38.093859 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 6f8c498b148c4d5db7c4a7d0e2b24360 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:38.097474 18968 catalog_manager.cc:5697] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.099779 18968 catalog_manager.cc:5697] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.101724 18968 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 13 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.103279 18968 catalog_manager.cc:5697] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 12 to 14, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.104826 18968 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 13 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 14 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.164518 19144 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:38.166188 24578 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:38.213158 19219 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:38.214705 24701 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:38.232398 23965 raft_consensus.cc:993] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:38.232851 23965 raft_consensus.cc:1081] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:38.234869 19220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:38.235412 19220 raft_consensus.cc:493] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.235736 19220 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.242527 18968 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60510 (request call id 237) took 8411 ms. Trace:
I20260709 13:20:38.249311 19220 raft_consensus.cc:515] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:38.288069 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:38.288664 19066 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.289354 19220 leader_election.cc:290] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:38.290472 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8433d8c678614c00ad69faf57a9363de" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:38.291452 19144 raft_consensus.cc:3055] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:38.296866 19144 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:38.243304 18968 rpcz_store.cc:276] 0709 13:20:29.831586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.833443 (+  1857us) service_pool.cc:224] Handling call
0709 13:20:38.242445 (+8409002us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:38.148329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:38.148841 (+   512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:38.148869 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:20:38.148908 (+    39us) tablet.cc:662] Decoding operations
0709 13:20:38.150182 (+  1274us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:38.150237 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:38.150264 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:20:38.151449 (+  1185us) tablet.cc:701] Row locks acquired
0709 13:20:38.151474 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:20:38.151634 (+   160us) write_op.cc:270] Start()
0709 13:20:38.151749 (+   115us) write_op.cc:276] Timestamp: P: 1783603238151586 usec, L: 0
0709 13:20:38.151773 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:38.152423 (+   650us) log.cc:844] Serialized 6695 byte log entry
0709 13:20:38.155059 (+  2636us) op_driver.cc:464] REPLICATION: finished
0709 13:20:38.155423 (+   364us) write_op.cc:301] APPLY: starting
0709 13:20:38.155502 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:38.164806 (+  9304us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:38.164919 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:38.195912 (+ 30993us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:38.196246 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:20:38.196302 (+    56us) write_op.cc:312] APPLY: finished
0709 13:20:38.198728 (+  2426us) log.cc:844] Serialized 156 byte log entry
0709 13:20:38.199150 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.199304 (+   154us) write_op.cc:454] Released schema lock
0709 13:20:38.199357 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:38.199700 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.199730 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":289474,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":198,"apply.run_cpu_time_us":19626,"apply.run_wall_time_us":44223,"cfile_cache_hit":68,"cfile_cache_hit_bytes":70992,"num_ops":17,"prepare.queue_time_us":12773,"prepare.run_cpu_time_us":4364,"prepare.run_wall_time_us":12679,"replication_time_us":3183}]]}
I20260709 13:20:38.312024 19144 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:38.316654 19066 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 20.
I20260709 13:20:38.320772 19144 raft_consensus.cc:3060] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.330155 19144 raft_consensus.cc:2468] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 20.
I20260709 13:20:38.341483 19184 leader_election.cc:304] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:38.342327 24875 raft_consensus.cc:2804] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:38.342855 24875 raft_consensus.cc:697] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:38.346402 24875 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:38.351481 18962 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.366860 19144 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:38.370687 24828 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.370136 18962 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 7 to 16, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 16 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.375840 19066 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:38.384729 19144 raft_consensus.cc:3060] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.389369 24875 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.396593 19144 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:38.398646 19069 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:38.403430 24883 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.401906 24828 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:20:38.428612 19746 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:38.439869 24834 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.447580 24883 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Committing config change with OpId 17.11: config changed from index 9 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:38.480050 19146 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:38.483786 24828 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:38.492453 19069 raft_consensus.cc:1275] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:38.494055 19746 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:38.494683 24875 consensus_queue.cc:1048] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.497010 24885 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.510641 18966 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 16 to 19, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 19 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.513263 18966 catalog_manager.cc:5697] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 16 to 18, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 18 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.515849 18966 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 15 to 17, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.524082 18966 catalog_manager.cc:5697] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.529596 18966 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 11 to 13, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 13 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:38.603453 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 73984.2us
I20260709 13:20:38.605657 18966 catalog_manager.cc:5697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 7 to 12, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 12 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.607673 18966 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.612408 18966 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 16 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.620008 18966 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 14 to 17, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.622709 18966 catalog_manager.cc:5697] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 16 to 18, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 18 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.624775 18966 catalog_manager.cc:5697] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 17 to 18, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 18 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:20:38.626247 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 89047.2us
I20260709 13:20:38.626573 18966 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.629601 18966 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 12 to 16, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.630942 18966 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 10 to 22, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 22 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.632632 18966 catalog_manager.cc:5697] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 16 to 18, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 18 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.634075 18966 catalog_manager.cc:5697] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 13 to 14, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 14 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.635313 18966 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 17 to 18, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 18 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.637060 18966 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.638545 18966 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.639883 18966 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 14 to 16, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 16 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.641333 18966 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 11 to 9, term changed from 18 to 17, leader changed from <none> to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from VOTER to NON_VOTER. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.674528 18962 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60514 (request call id 223) took 8842 ms. Trace:
W20260709 13:20:38.685947 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 64024us
I20260709 13:20:38.699577 19071 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:38.714077 24899 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:20:38.760974 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:38.679947 18962 rpcz_store.cc:276] 0709 13:20:29.832331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.832684 (+   353us) service_pool.cc:224] Handling call
0709 13:20:38.674431 (+8841747us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:38.391076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:38.391617 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:38.391649 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:20:38.391665 (+    16us) tablet.cc:662] Decoding operations
0709 13:20:38.392024 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:38.392078 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:38.392105 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:20:38.399424 (+  7319us) tablet.cc:701] Row locks acquired
0709 13:20:38.399443 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:20:38.399605 (+   162us) write_op.cc:270] Start()
0709 13:20:38.401572 (+  1967us) write_op.cc:276] Timestamp: P: 1783603238399535 usec, L: 0
0709 13:20:38.402128 (+   556us) op_driver.cc:348] REPLICATION: starting
0709 13:20:38.403611 (+  1483us) log.cc:844] Serialized 923 byte log entry
0709 13:20:38.405383 (+  1772us) op_driver.cc:464] REPLICATION: finished
0709 13:20:38.405686 (+   303us) write_op.cc:301] APPLY: starting
0709 13:20:38.405764 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:38.408333 (+  2569us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:38.408429 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:38.409835 (+  1406us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:38.410010 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:20:38.410057 (+    47us) write_op.cc:312] APPLY: finished
0709 13:20:38.411000 (+   943us) log.cc:844] Serialized 33 byte log entry
0709 13:20:38.411175 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.411266 (+    91us) write_op.cc:454] Released schema lock
0709 13:20:38.411306 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:38.425188 (+ 13882us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.425224 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":4045,"apply.run_wall_time_us":19421,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8352,"num_ops":2,"prepare.queue_time_us":4619,"prepare.run_cpu_time_us":2661,"prepare.run_wall_time_us":12779,"replication_time_us":3152}]]}
I20260709 13:20:38.825125 18965 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 9 to 11, term changed from 17 to 18, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:38.869159 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f8c498b148c4d5db7c4a7d0e2b24360 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 10 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:38.869493 18966 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60506 (request call id 209) took 1678 ms. Trace:
I20260709 13:20:38.869848 18966 rpcz_store.cc:276] 0709 13:20:37.190809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.198552 (+  7743us) service_pool.cc:224] Handling call
0709 13:20:38.869408 (+1670856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:38.664169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:38.664652 (+   483us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:38.664680 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:20:38.664698 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:38.666125 (+  1427us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:38.666183 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:38.666229 (+    46us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:20:38.668844 (+  2615us) tablet.cc:701] Row locks acquired
0709 13:20:38.668858 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:20:38.669018 (+   160us) write_op.cc:270] Start()
0709 13:20:38.669115 (+    97us) write_op.cc:276] Timestamp: P: 1783603238668974 usec, L: 0
0709 13:20:38.669135 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:20:38.669807 (+   672us) log.cc:844] Serialized 8292 byte log entry
0709 13:20:38.724845 (+ 55038us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b540014f3a0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f4090 00007f61035016b8 00007f61035012fa 00007f6103585965 00007f6103585e09 00007f6106fc0581 00007f6106fbfd58 00007f6106fc49f1 00007f6106fc49a9 00007f6106fc4939 00007f6106fc4901
0709 13:20:38.760036 (+ 35191us) op_driver.cc:464] REPLICATION: finished
0709 13:20:38.765710 (+  5674us) write_op.cc:301] APPLY: starting
0709 13:20:38.767564 (+  1854us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:38.790624 (+ 23060us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:38.790654 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:38.807541 (+ 16887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:38.807809 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:20:38.807847 (+    38us) write_op.cc:312] APPLY: finished
0709 13:20:38.808162 (+   315us) log.cc:844] Serialized 188 byte log entry
0709 13:20:38.808909 (+   747us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.809087 (+   178us) write_op.cc:454] Released schema lock
0709 13:20:38.809134 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:38.809491 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.809518 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33487,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":1287,"apply.run_cpu_time_us":25759,"apply.run_wall_time_us":46747,"cfile_cache_hit":84,"cfile_cache_hit_bytes":87696,"num_ops":21,"prepare.queue_time_us":770,"prepare.run_cpu_time_us":8781,"prepare.run_wall_time_us":62194,"replication_time_us":60102,"spinlock_wait_cycles":4231936}]]}
W20260709 13:20:38.877843 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 150512us
I20260709 13:20:38.902191 19143 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:38.924203 24885 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.925611 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 6f8c498b148c4d5db7c4a7d0e2b24360 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:38.916131 18968 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.944254 19066 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:38.949757 24885 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.951713 18965 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 14 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:38.990061 18966 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 16 to 17, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:38.991709 18966 catalog_manager.cc:5697] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 16 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
I20260709 13:20:39.055190 19071 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:20:39.077279 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 341653us
I20260709 13:20:39.081154 18966 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 19 to 20, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 20 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } }
W20260709 13:20:39.108089 19035 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61d460e2151b412d8e1e8208d00679bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.108650 19146 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:39.111307 24264 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:39.121093 24903 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.122189 19146 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.141842 19215 consensus_queue.cc:237] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:39.153317 19220 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:39.166883 24701 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:39.178206 19066 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:39.199115 19220 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.236841 19746 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:39.232997 18962 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.240939 19146 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:20:39.242540 19035 consensus_peers.cc:597] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f49755f447d4bfba9fb1a68e2fedfa3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.243541 24578 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:39.253377 19212 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:39.256664 19144 raft_consensus.cc:1275] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:39.258388 24898 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:39.263624 24660 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:39.263789 24901 consensus_queue.cc:1048] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:39.296868 19212 consensus_queue.cc:237] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:39.351060 24885 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index 6 to 10, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:39.353571 19746 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:39.353287 19751 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 6 to 10, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:39.355010 24901 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:39.365379 24901 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 11 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:39.370463 18962 catalog_manager.cc:5697] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 6 to 10, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:39.373945 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b07ef65c060943509b105c2f74e22ff5 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:39.375975 19751 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:39.389537 19146 raft_consensus.cc:1275] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:39.395251 24264 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.420284 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 61d161ec86f94a4eaf383729c1ddbc87 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:39.417375 19146 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.494529 18966 catalog_manager.cc:5697] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 11 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 18 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.495524 18962 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:39.524001 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 100165us
I20260709 13:20:39.502231 24898 consensus_queue.cc:1048] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
W20260709 13:20:39.529589 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 109753us
I20260709 13:20:39.545421 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet b07ef65c060943509b105c2f74e22ff5 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:39.605618 19054 tablet_service.cc:1558] Processing DeleteTablet for tablet 61d161ec86f94a4eaf383729c1ddbc87 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:39.612958 19219 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.621172 24922 tablet_replica.cc:333] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
W20260709 13:20:39.622651 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 94066.2us
I20260709 13:20:39.626652 19146 raft_consensus.cc:2955] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 6 to 10, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:39.644743 24922 raft_consensus.cc:2243] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:39.645768 24922 raft_consensus.cc:2272] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:39.657461 24922 ts_tablet_manager.cc:1916] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:20:39.675515 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 88709.4us
I20260709 13:20:39.687441 19142 raft_consensus.cc:2955] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:39.700702 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 85103.5us
W20260709 13:20:39.705178 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 62352.5us
I20260709 13:20:39.709530 19215 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:39.792778 24922 ts_tablet_manager.cc:1929] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.9
I20260709 13:20:39.793394 24922 log.cc:1199] T b07ef65c060943509b105c2f74e22ff5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/b07ef65c060943509b105c2f74e22ff5
I20260709 13:20:39.795439 24922 tablet_replica.cc:333] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:20:39.795882 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet b07ef65c060943509b105c2f74e22ff5 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:39.796541 24922 raft_consensus.cc:2243] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:39.797343 24922 raft_consensus.cc:2272] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:39.800346 24922 ts_tablet_manager.cc:1916] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:39.802342 19064 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:20:39.803614 19184 consensus_peers.cc:597] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e32daa1d5e3443eaaf7b1e03100b270. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.804188 19147 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:39.804458 24921 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:39.822492 24921 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:39.845993 24922 ts_tablet_manager.cc:1929] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:20:39.846560 24922 log.cc:1199] T 61d161ec86f94a4eaf383729c1ddbc87 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/61d161ec86f94a4eaf383729c1ddbc87
I20260709 13:20:39.848014 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 61d161ec86f94a4eaf383729c1ddbc87 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:39.867738 19142 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Committing config change with OpId 22.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.866070 24898 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Committing config change with OpId 22.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.877391 24931 ts_tablet_manager.cc:933] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:39.915681 19064 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Committing config change with OpId 22.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:39.937964 19215 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:39.934134 24934 ts_tablet_manager.cc:933] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:39.933014 18962 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 22 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:39.948057 24931 tablet_copy_client.cc:323] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:39.953430 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 61d460e2151b412d8e1e8208d00679bc from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:39.954038 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 61d460e2151b412d8e1e8208d00679bc from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-61d460e2151b412d8e1e8208d00679bc
I20260709 13:20:39.964534 19082 tablet_copy_source_session.cc:215] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:39.971199 24934 tablet_copy_client.cc:323] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:39.976284 19147 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:39.977519 19071 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:20:39.986135 19184 consensus_peers.cc:597] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3846ceb53ab145bfa0ae536aa51f05d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.990639 19081 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 5f49755f447d4bfba9fb1a68e2fedfa3 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:39.991214 19081 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 5f49755f447d4bfba9fb1a68e2fedfa3 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-5f49755f447d4bfba9fb1a68e2fedfa3
I20260709 13:20:39.992719 24900 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:39.994724 24900 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:39.998998 19081 tablet_copy_source_session.cc:215] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:40.002619 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:40.009382 24934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f49755f447d4bfba9fb1a68e2fedfa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.012351 24931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d460e2151b412d8e1e8208d00679bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.087069 24904 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:40.090615 19066 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:40.104977 24934 tablet_copy_client.cc:806] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:40.105711 24934 tablet_copy_client.cc:670] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:40.115304 24934 tablet_copy_client.cc:538] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:40.134322 24931 tablet_copy_client.cc:806] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:40.137980 24931 tablet_copy_client.cc:670] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:40.142696 24934 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:40.144865 24931 tablet_copy_client.cc:538] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:40.155333 18962 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:40.158495 19147 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:40.177538 24931 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:40.282887 24942 ts_tablet_manager.cc:933] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:40.317327 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:40.317950 19066 raft_consensus.cc:606] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:40.330128 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:40.330884 19071 raft_consensus.cc:606] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:40.338762 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:40.339287 19071 raft_consensus.cc:606] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:40.340867 24934 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:40.342239 19071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3bb7a633516455782a998ee89832b55"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:40.343140 19071 raft_consensus.cc:606] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:40.346630 24934 tablet_bootstrap.cc:492] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:40.347440 24934 ts_tablet_manager.cc:1403] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.205s	user 0.033s	sys 0.022s
I20260709 13:20:40.347894 19066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:40.348532 19066 raft_consensus.cc:606] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:40.350796 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:40.353063 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:40.397995 24942 tablet_copy_client.cc:323] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:20:40.401328 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 1e32daa1d5e3443eaaf7b1e03100b270 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:20:40.401927 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 1e32daa1d5e3443eaaf7b1e03100b270 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-1e32daa1d5e3443eaaf7b1e03100b270
I20260709 13:20:40.411360 24934 raft_consensus.cc:359] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:40.412245 24934 raft_consensus.cc:740] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:40.412856 24934 consensus_queue.cc:260] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:40.416648 19230 tablet_copy_source_session.cc:215] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:40.421576 24934 ts_tablet_manager.cc:1434] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.004s
W20260709 13:20:40.473493 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 143342us
I20260709 13:20:40.520242 24931 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:40.528952 24931 tablet_bootstrap.cc:492] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:40.531080 24931 ts_tablet_manager.cc:1403] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.361s	user 0.040s	sys 0.015s
I20260709 13:20:40.542353 24942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32daa1d5e3443eaaf7b1e03100b270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.562687 24931 raft_consensus.cc:359] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:40.574164 24931 raft_consensus.cc:740] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:40.575423 24931 consensus_queue.cc:260] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:40.583014 24918 raft_consensus.cc:993] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:40.583690 24918 raft_consensus.cc:993] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:40.587815 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-5f49755f447d4bfba9fb1a68e2fedfa3 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:40.588563 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-5f49755f447d4bfba9fb1a68e2fedfa3 on tablet 5f49755f447d4bfba9fb1a68e2fedfa3 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:40.585163 24952 raft_consensus.cc:1081] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:40.596031 24931 ts_tablet_manager.cc:1434] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.064s	user 0.011s	sys 0.003s
I20260709 13:20:40.608285 24918 raft_consensus.cc:1081] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:40.619089 24934 ts_tablet_manager.cc:933] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:40.623270 19147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:20:40.624130 19147 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:40.624547 19147 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.659122 19144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:20:40.659924 19144 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:40.660363 19144 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.686040 19147 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:40.707587 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-61d460e2151b412d8e1e8208d00679bc received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:40.708196 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-61d460e2151b412d8e1e8208d00679bc on tablet 61d460e2151b412d8e1e8208d00679bc with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:40.719738 24803 raft_consensus.cc:993] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:40.720332 24803 raft_consensus.cc:1081] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:40.733294 19147 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:40.755169 19142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:20:40.755954 19142 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:40.756397 19142 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.781706 19142 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:40.790693 24934 tablet_copy_client.cc:323] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:20:40.793033 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 3846ceb53ab145bfa0ae536aa51f05d0 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:20:40.793761 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 3846ceb53ab145bfa0ae536aa51f05d0 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-3846ceb53ab145bfa0ae536aa51f05d0
I20260709 13:20:40.795565 19142 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:40.835525 19144 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:40.843918 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:40.844700 19071 raft_consensus.cc:3055] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:40.845001 19071 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:40.845803 19071 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:40.847277 19071 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.860388 19230 tablet_copy_source_session.cc:215] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:40.861958 19144 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:40.877157 24934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3846ceb53ab145bfa0ae536aa51f05d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.887523 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:40.888236 19215 raft_consensus.cc:3060] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.893072 19746 raft_consensus.cc:1217] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:20:40.897280 19066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:40.901057 19066 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:40.901337 19066 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:40.906704 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:40.907385 19213 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.916929 19744 raft_consensus.cc:1217] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:20:40.926218 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:40.926781 19751 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.933318 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:40.933971 19069 raft_consensus.cc:3055] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:40.934293 19069 raft_consensus.cc:740] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:40.935640 19213 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:40.912102 19066 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:40.937956 19066 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.935346 19069 consensus_queue.cc:260] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:40.941457 19069 raft_consensus.cc:3060] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.942514 19215 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:40.945214 19751 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:40.955118 19066 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:40.960836 19071 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:20:40.967528 24942 tablet_copy_client.cc:806] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:40.968324 24942 tablet_copy_client.cc:670] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:40.973755 19110 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:40.996457 19110 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:40.998337 24928 raft_consensus.cc:2804] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:40.998836 24928 raft_consensus.cc:697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:40.999883 24928 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.002208 24949 raft_consensus.cc:2804] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:41.002771 24949 raft_consensus.cc:697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:41.003767 24949 consensus_queue.cc:237] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:40.975147 19113 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:41.007701 24950 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:41.008252 24950 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:40.999246 19069 raft_consensus.cc:2468] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
I20260709 13:20:41.018605 24950 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.030332 24942 tablet_copy_client.cc:538] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:40.983047 24934 tablet_copy_client.cc:806] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:40.986616 24903 raft_consensus.cc:993] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:40.989276 24948 raft_consensus.cc:993] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:41.042438 24947 raft_consensus.cc:1081] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:41.042526 24948 raft_consensus.cc:1081] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:41.044643 19213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3bb7a633516455782a998ee89832b55"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40750
I20260709 13:20:41.044793 19144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:20:41.045042 24934 tablet_copy_client.cc:670] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:41.045274 19213 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.045473 19144 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:41.045768 19213 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.046039 19144 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.054812 19144 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.056960 24934 tablet_copy_client.cc:538] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:41.057190 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:41.057792 19071 raft_consensus.cc:3055] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:41.058112 19071 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:41.058872 19071 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.059896 19071 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.064273 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:41.064903 19212 raft_consensus.cc:3060] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.073233 19071 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:41.064925 19213 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.079051 19213 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:41.079274 19110 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:41.057367 19144 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:41.080058 24949 raft_consensus.cc:2804] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.080819 24949 raft_consensus.cc:697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:41.081687 24949 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.086822 24942 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:41.076496 19212 raft_consensus.cc:2468] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:41.107793 24934 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:41.116540 18962 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 14 to 15, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 15 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.148748 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:41.149390 19071 raft_consensus.cc:3055] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:41.152611 19071 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:41.153527 19071 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.154810 19071 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.157696 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3bb7a633516455782a998ee89832b55" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:41.158280 19145 raft_consensus.cc:3060] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.173754 19145 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:41.165230 19071 raft_consensus.cc:2468] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 14.
I20260709 13:20:41.206051 19184 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:20:41.213415 24900 raft_consensus.cc:2804] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:41.213917 24900 raft_consensus.cc:697] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:41.214758 24900 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:41.312749 24947 raft_consensus.cc:1064] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:41.315626 24947 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:41.405577 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:41.426960 18962 catalog_manager.cc:5697] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 15 to 16, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.429150 18962 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 14 to 15, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 15 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.431162 18962 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 17 to 18, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.441480 19751 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:41.445561 24949 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:41.453835 18965 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 13 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 14 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:41.469341 19213 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:41.472214 24928 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:41.488481 19215 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:41.489919 19213 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:41.497670 24950 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:41.498768 24972 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:41.501016 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 95617.8us
I20260709 13:20:41.514448 24934 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:41.532305 19751 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:41.539011 24934 tablet_bootstrap.cc:492] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:41.539399 19071 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:41.539857 24934 ts_tablet_manager.cc:1403] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.432s	user 0.037s	sys 0.014s
I20260709 13:20:41.541452 24951 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:41.538918 19144 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:41.582839 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 55095us
I20260709 13:20:41.584177 19066 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:41.588318 24920 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:41.591034 24934 raft_consensus.cc:359] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:41.682951 24934 raft_consensus.cc:740] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:41.683670 24934 consensus_queue.cc:260] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:41.670089 24903 raft_consensus.cc:1064] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:41.719102 19214 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:41.721396 24949 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:41.582788 24971 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.147s
W20260709 13:20:41.730523 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58100.2us
I20260709 13:20:41.754710 19071 raft_consensus.cc:1275] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:41.762882 19064 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:41.763752 24934 ts_tablet_manager.cc:1434] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.224s	user 0.010s	sys 0.001s
I20260709 13:20:41.742843 24948 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:41.781796 19065 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:41.815053 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 68202us
I20260709 13:20:41.834815 19144 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:41.944802 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 120124us
W20260709 13:20:41.947115 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 81509.5us
W20260709 13:20:41.947213 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 178642us
I20260709 13:20:41.961872 24990 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:20:41.965446 24992 consensus_queue.cc:1048] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:20:41.965984 24903 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:41.969225 24942 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:42.020093 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-3846ceb53ab145bfa0ae536aa51f05d0 received from {username='slave'} at 127.0.0.1:42382
I20260709 13:20:42.135469 24942 tablet_bootstrap.cc:492] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:42.136518 24942 ts_tablet_manager.cc:1403] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 1.050s	user 0.072s	sys 0.017s
I20260709 13:20:42.136936 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-3846ceb53ab145bfa0ae536aa51f05d0 on tablet 3846ceb53ab145bfa0ae536aa51f05d0 with peer 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:20:42.264765 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 325056us
W20260709 13:20:42.410634 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 153121us
W20260709 13:20:42.401343 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 85703.8us
W20260709 13:20:42.427425 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 113863us
W20260709 13:20:42.489481 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:42.501878 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 79177.6us
W20260709 13:20:42.562755 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47400.4us
W20260709 13:20:42.589699 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 86005.7us
W20260709 13:20:42.590283 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 84236us
W20260709 13:20:42.591243 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 106608us
W20260709 13:20:42.561900 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 76031.6us
I20260709 13:20:42.614812 24994 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
W20260709 13:20:42.615299 25011 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:20:42.615587 25016 log.cc:927] Time spent T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:42.604575 24950 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:42.637555 24904 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:20:42.647039 24950 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:20:42.670362 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 58844.6us
W20260709 13:20:42.674795 24903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.018s
W20260709 13:20:42.675235 24903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.018s
W20260709 13:20:42.675436 19035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.597687 24942 raft_consensus.cc:359] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:42.685736 25013 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:42.686352 25013 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:42.686743 24996 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:42.687402 24996 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:42.688450 25013 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:42.683238 24942 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:42.736039 24942 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:42.738086 24942 ts_tablet_manager.cc:1434] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.572s	user 0.008s	sys 0.000s
W20260709 13:20:42.738376 24942 ts_tablet_manager.cc:1467] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Tablet startup took 572ms
I20260709 13:20:42.739639 19145 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:42.741194 19751 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:42.743688 25000 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:42.726009 25031 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:42.728278 24996 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:42.730580 24950 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:20:42.710261 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 87916.4us
I20260709 13:20:42.751672 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:42.752414 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:42.759788 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 146123us
W20260709 13:20:42.738729 24942 ts_tablet_manager.cc:1469] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Trace:
0709 13:20:40.247749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.247857 (+   108us) service_pool.cc:224] Handling call
0709 13:20:40.283227 (+ 35370us) ts_tablet_manager.cc:934] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
0709 13:20:40.539589 (+256362us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:40.746903 (+207314us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:40.747034 (+   131us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:40.966251 (+219217us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:40.966546 (+   295us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:40.966860 (+   314us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:40.966987 (+   127us) inbound_call.cc:177] Queueing success response
0709 13:20:41.086380 (+119393us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:20:42.165820 (+1079440us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:20:42.238042 (+ 72222us) tablet_replica.cc:261] Starting instrumentation
0709 13:20:42.238827 (+   785us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":1596,"mutex_wait_us":37208,"raft.queue_time_us":435,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"tablet-copy.queue_time_us":34546,"tablet-download-pool.queue_time_us":2032,"tablet-download-pool.run_cpu_time_us":1083,"tablet-download-pool.run_wall_time_us":19975,"thread_start_us":101280,"threads_started":2}
I20260709 13:20:42.762781 25031 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:42.787300 25031 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:42.792936 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:42.788074 25025 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:42.826843 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:42.836472 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:42.850687 19038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.004s
W20260709 13:20:42.851064 19038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.005s	sys 0.005s
W20260709 13:20:42.851303 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 548846us
I20260709 13:20:42.862919 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:42.865649 19184 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:42.885277 19214 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:42.891104 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:42.902233 25023 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:42.902801 25023 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:42.907260 24994 raft_consensus.cc:493] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:42.907569 24904 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:42.907832 24994 raft_consensus.cc:515] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:42.908078 24904 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:42.910072 24904 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:42.915222 24995 raft_consensus.cc:493] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:42.915944 24995 raft_consensus.cc:515] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:42.883359 24996 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:42.918926 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:42.929103 24897 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:42.929836 24897 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:42.931296 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:42.975553 24897 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:42.961730 24803 raft_consensus.cc:493] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:43.028966 24897 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
W20260709 13:20:43.033406 25039 log.cc:927] Time spent T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.003s
I20260709 13:20:43.033849 24982 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:43.045027 24982 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.047606 24982 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:43.034013 25020 raft_consensus.cc:493] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 508ee2e0531b43d7a1c05f950644ae66)
I20260709 13:20:43.048592 25020 raft_consensus.cc:515] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.033542 25021 raft_consensus.cc:493] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:43.050513 25021 raft_consensus.cc:515] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.052599 25021 leader_election.cc:290] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:43.053117 24897 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.038863 19215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:43.057786 24981 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:43.057930 25028 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:43.032128 24803 raft_consensus.cc:515] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.060667 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-1e32daa1d5e3443eaaf7b1e03100b270 received from {username='slave'} at 127.0.0.1:42382
W20260709 13:20:43.068974 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 164891us
I20260709 13:20:43.069650 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:43.070062 19746 raft_consensus.cc:1217] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:20:43.072825 24990 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:43.097150 24803 leader_election.cc:290] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:43.033686 25023 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:43.097457 24990 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.098099 24997 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:43.098680 24997 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:43.099696 24990 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:43.082568 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:43.095373 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-1e32daa1d5e3443eaaf7b1e03100b270 on tablet 1e32daa1d5e3443eaaf7b1e03100b270 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:43.109418 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c284b8edf0ca4032aeac36d9cbcb9925" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.119983 19746 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:43.123725 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:43.124387 24897 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:43.124935 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b84fdcb260415b9e65e72540fe1841" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.132324 24948 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:43.112236 24995 leader_election.cc:290] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:43.112506 25028 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.108595 24981 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.167919 24981 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:43.168118 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.150321 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.171778 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.157218 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b4ebbb026847c7a47a03402902ca2a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.163389 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.172820 25014 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.178556 24989 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:43.193035 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 73093.7us
I20260709 13:20:43.195536 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.196347 24994 leader_election.cc:290] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:43.208066 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cafb40f37ca439fa093060d6ba342f0" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.167922 24997 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:43.216974 24987 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:43.217542 24987 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:43.219604 24987 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:43.220650 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.221482 25030 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:43.222489 19139 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.228454 19141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.241226 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
W20260709 13:20:43.242267 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 115425us
I20260709 13:20:43.242071 19035 leader_election.cc:304] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:43.246944 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07ef65c060943509b105c2f74e22ff5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.248180 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.250016 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.253947 25022 raft_consensus.cc:2749] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:43.256531 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9eca38a1164c2293be5a949d3526b3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:43.271744 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:43.275085 19750 raft_consensus.cc:1217] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.10->[22.11-22.11]   Dedup: 22.11->[]
I20260709 13:20:43.241814 24696 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:43.269913 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736ce293ef884a9d97ae4efb914752f6" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.280740 19146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.253152 24947 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:43.302415 19147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.287695 24696 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.318449 24696 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:43.313239 25020 leader_election.cc:290] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:43.332099 24953 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:43.332743 24953 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.334569 25028 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:43.350317 25020 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:43.358937 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:43.364239 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4e5f111c104ea4adb5e45cd00f1db6" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.367990 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:43.372762 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.380847 18967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60996 (request call id 132) took 1206 ms. Trace:
I20260709 13:20:43.381194 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:43.368731 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13256a1f86494f9f812c2c4162cec4f7" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:43.381312 18967 rpcz_store.cc:276] 0709 13:20:42.150500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.150771 (+   271us) service_pool.cc:224] Handling call
0709 13:20:42.639945 (+489174us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b5400002490. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6100325db1 00007f6100465b71 00007f61004660b2 00007f61093dfa89 00007f6109377da6 00007f6109349088 00007f610944737e 00007f61079082a4 00007f6107908232 00007f6107908161 00007f61079080dc
0709 13:20:43.356598 (+716653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96366,"reported_tablets":2,"spinlock_wait_cycles":61232896}
I20260709 13:20:43.389030 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf1d0079a1c47338b7cf7be4cdcf505" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.391757 24988 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:43.392323 24988 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:43.394608 24988 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:43.396142 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:43.374339 19184 leader_election.cc:304] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:43.398816 24900 raft_consensus.cc:2749] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.361593 24953 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:43.369310 25020 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:43.411082 25020 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:43.411377 24992 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:43.411931 24992 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:43.414158 24992 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:43.415139 19212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:43.415969 19217 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.370376 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
W20260709 13:20:43.418248 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 59451.6us
I20260709 13:20:43.418991 19714 leader_election.cc:304] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:43.417794 18967 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.420639 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.421039 24982 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:43.421237 24991 raft_consensus.cc:2749] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:43.424823 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:43.431711 19184 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.432710 24957 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.433758 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:20:43.436124 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 74313.6us
I20260709 13:20:43.454264 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.455241 24982 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:43.457592 19184 leader_election.cc:304] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.465840 24957 raft_consensus.cc:2749] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:43.472035 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.471544 24971 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.481202 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:20:43.485008 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 49097.1us
I20260709 13:20:43.485873 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.486202 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.487267 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.487551 24987 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:43.488293 24982 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:43.489471 25028 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:43.473242 24988 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.497529 19038 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:43.499199 24903 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:43.474066 19110 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.502718 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.503423 24989 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:43.504051 24989 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:43.505398 19743 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.507404 19184 leader_election.cc:304] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.534989 24957 raft_consensus.cc:2749] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:43.518977 19064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.542122 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.542934 24957 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.549136 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.524430 19214 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.525540 19140 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.561537 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d161ec86f94a4eaf383729c1ddbc87" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:43.573582 25027 raft_consensus.cc:1064] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:43.576046 25027 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 9, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.576474 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.581359 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:43.595021 19714 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:43.596975 25028 raft_consensus.cc:2749] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:43.606400 19714 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:43.607690 25037 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:43.622092 19140 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:43.624284 19750 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:43.624794 19069 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:43.628162 25027 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:43.629377 24957 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:43.631222 24957 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:43.661092 19110 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.663167 24984 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.668843 19110 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:43.671312 24990 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:43.702451 24995 raft_consensus.cc:1064] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:43.705395 24995 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.742081 19069 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:43.749986 19751 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:43.753539 25022 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:43.756613 19140 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:43.762377 24971 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:43.767493 25065 log.cc:927] Time spent T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:20:43.773830 18962 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.783986 24903 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.788839 24987 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Committing config change with OpId 22.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.798892 19751 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.819461 19743 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.843199 19140 raft_consensus.cc:2955] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:43.845898 19139 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:43.850874 25027 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:43.857561 19750 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:43.857843 19064 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:43.879818 24957 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:43.889971 25027 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:44.063478 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 187202us
I20260709 13:20:44.070493 19069 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:44.075255 18965 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.101862 19743 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:44.164507 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 61d460e2151b412d8e1e8208d00679bc with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:20:44.175069 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 46322.1us
I20260709 13:20:44.173761 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:44.194501 19212 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:44.193040 19144 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.210966 19064 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Committing config change with OpId 22.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:44.228195 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 117229us
W20260709 13:20:44.304481 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 63810.3us
I20260709 13:20:44.234899 24971 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:20:44.319072 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 61d460e2151b412d8e1e8208d00679bc with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:35022
I20260709 13:20:44.368963 25020 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:44.371290 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 54390.9us
I20260709 13:20:44.379784 19069 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.387794 18962 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:44.420423 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 124619us
I20260709 13:20:44.429416 19139 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.433758 24948 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:44.479321 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 173276us
I20260709 13:20:44.487332 19139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:44.488161 19139 raft_consensus.cc:606] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:44.489805 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:44.507908 25075 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.502314 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:44.514930 25090 tablet_replica.cc:333] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:20:44.516170 25090 raft_consensus.cc:2243] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.515466 19217 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.519130 25090 raft_consensus.cc:2272] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.522526 25090 ts_tablet_manager.cc:1916] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:44.528221 19214 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:44.529583 18962 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.545526 19746 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.577649 19139 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:44.577823 19750 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:44.561851 19751 raft_consensus.cc:2955] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.579012 24995 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:44.581771 24995 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:44.588678 24995 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.590881 19750 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.598600 19144 raft_consensus.cc:2955] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.609614 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f49755f447d4bfba9fb1a68e2fedfa3 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:44.609261 18962 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 22 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.622540 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e32daa1d5e3443eaaf7b1e03100b270 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:44.627319 18967 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.650785 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e32daa1d5e3443eaaf7b1e03100b270 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:44.696498 25093 tablet_replica.cc:333] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:20:44.740590 25090 ts_tablet_manager.cc:1929] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:20:44.741163 25090 log.cc:1199] T 61d460e2151b412d8e1e8208d00679bc P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/61d460e2151b412d8e1e8208d00679bc
I20260709 13:20:44.750257 25093 raft_consensus.cc:2243] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.751402 25093 raft_consensus.cc:2272] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.755101 25093 ts_tablet_manager.cc:1916] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:44.774930 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f49755f447d4bfba9fb1a68e2fedfa3 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:41872
I20260709 13:20:44.775409 25093 ts_tablet_manager.cc:1929] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.12
I20260709 13:20:44.775880 25093 log.cc:1199] T 1e32daa1d5e3443eaaf7b1e03100b270 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/1e32daa1d5e3443eaaf7b1e03100b270
I20260709 13:20:44.779556 25096 tablet_replica.cc:333] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:20:44.781162 25096 raft_consensus.cc:2243] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.782102 25096 raft_consensus.cc:2272] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.786617 25096 ts_tablet_manager.cc:1916] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:44.804075 25096 ts_tablet_manager.cc:1929] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:20:44.804569 25096 log.cc:1199] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/5f49755f447d4bfba9fb1a68e2fedfa3
I20260709 13:20:44.777979 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 1e32daa1d5e3443eaaf7b1e03100b270 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
W20260709 13:20:44.857934 18954 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 79970.9us
I20260709 13:20:44.858743 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 5f49755f447d4bfba9fb1a68e2fedfa3 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:44.750255 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 61d460e2151b412d8e1e8208d00679bc (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
W20260709 13:20:44.861285 18957 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 111052us
I20260709 13:20:44.868456 19214 consensus_queue.cc:237] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:44.878664 19746 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:44.880934 24987 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:44.884096 19144 raft_consensus.cc:1275] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:44.885957 24987 consensus_queue.cc:1048] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:44.887852 24995 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.894387 19144 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.898531 19746 raft_consensus.cc:2955] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.920740 18967 catalog_manager.cc:5697] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 12 to 13, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:44.942085 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet 3846ceb53ab145bfa0ae536aa51f05d0 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:44.943243 25093 tablet_replica.cc:333] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:20:44.944314 25093 raft_consensus.cc:2243] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.945083 25093 raft_consensus.cc:2272] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.949112 25093 ts_tablet_manager.cc:1916] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:45.010942 25084 raft_consensus.cc:993] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:45.011606 25023 raft_consensus.cc:1081] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:45.015817 19215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:45.016414 19215 raft_consensus.cc:493] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:45.016782 19215 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.045136 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3846ceb53ab145bfa0ae536aa51f05d0 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:45.036293 19215 raft_consensus.cc:515] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:45.090297 19215 leader_election.cc:290] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:45.097157 19069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:45.098678 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941387979c524e4c8b05785609c3d3c4" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:45.106053 19139 raft_consensus.cc:3055] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:45.106420 19139 raft_consensus.cc:740] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:45.107224 19139 consensus_queue.cc:260] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:45.108444 19139 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.097816 19069 raft_consensus.cc:3060] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.182484 25093 ts_tablet_manager.cc:1929] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:20:45.183040 25093 log.cc:1199] T 3846ceb53ab145bfa0ae536aa51f05d0 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/3846ceb53ab145bfa0ae536aa51f05d0
I20260709 13:20:45.190177 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet 3846ceb53ab145bfa0ae536aa51f05d0 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:45.282760 19139 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:20:45.138340 19069 raft_consensus.cc:2468] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
W20260709 13:20:45.287616 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 95165.3us
I20260709 13:20:45.319413 19069 raft_consensus.cc:1240] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Rejecting Update request from peer 0f833abfb3544031bee566e655b7fedc for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:45.444347 19184 leader_election.cc:304] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:45.465466 25082 raft_consensus.cc:2804] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:45.466039 25082 raft_consensus.cc:697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:45.466984 25082 consensus_queue.cc:237] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:45.509490 18967 catalog_manager.cc:5697] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 16 to 17, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.517890 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:46.107863 19138 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:46.109432 25108 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:46.118808 19069 raft_consensus.cc:1275] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:46.126046 25108 consensus_queue.cc:1048] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:46.230619 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080034a4a0 after lost signal to thread 17967
W20260709 13:20:46.231931 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080023dec0 after lost signal to thread 19004
W20260709 13:20:46.233345 19001 debug-util.cc:398] Leaking SignalData structure 0x7b080030b740 after lost signal to thread 19096
W20260709 13:20:46.234764 19001 debug-util.cc:398] Leaking SignalData structure 0x7b08002371e0 after lost signal to thread 19171
W20260709 13:20:46.235947 19001 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0900 after lost signal to thread 19245
W20260709 13:20:46.240978 19001 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2ee0 after lost signal to thread 19775
W20260709 13:20:46.241441 19001 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6340 after lost signal to thread 24989
W20260709 13:20:46.241802 19001 debug-util.cc:398] Leaking SignalData structure 0x7b08003090e0 after lost signal to thread 25014
W20260709 13:20:46.346292 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 171689us
I20260709 13:20:46.595537 19071 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:20:46.621956 19035 consensus_peers.cc:597] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2653a1baca71467dbf9167aede923a9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.624922 19215 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:46.626688 25104 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:46.636183 19138 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:46.637560 25097 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:46.749058 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:46.779310 25114 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:46.817472 19138 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:46.838989 19067 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:46.844543 19220 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:46.844910 18962 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 8, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.900449 19220 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:46.900389 19035 consensus_peers.cc:597] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d0433fa5eeb4f7b83f2fbd60b78b0f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.902002 19138 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:46.902000 25114 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:46.905293 25114 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:46.937561 25114 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:46.942402 19217 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:46.956290 19138 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:20:47.014017 19110 consensus_peers.cc:597] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef2bd04462cb41488ea5d3a18b899972. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:47.018707 19140 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.021553 18966 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.100368 19071 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:47.101892 25102 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:47.111919 19217 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:47.113485 25118 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:47.122125 19220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:20:47.122694 19220 raft_consensus.cc:606] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:47.125422 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:47.127374 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:47.128093 25118 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.128830 19071 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.154066 19220 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:47.161885 18967 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.188697 19217 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:20:47.203457 19772 debug-util.cc:398] Leaking SignalData structure 0x7b080032bec0 after lost signal to thread 17967
W20260709 13:20:47.204584 19772 debug-util.cc:398] Leaking SignalData structure 0x7b080009cfe0 after lost signal to thread 19004
W20260709 13:20:47.205785 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08001ffc80 after lost signal to thread 19096
W20260709 13:20:47.206804 19772 debug-util.cc:398] Leaking SignalData structure 0x7b080023c140 after lost signal to thread 19171
W20260709 13:20:47.207767 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1be0 after lost signal to thread 19245
W20260709 13:20:47.221545 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6a40 after lost signal to thread 19775
I20260709 13:20:47.230906 19138 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:47.234789 19071 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:47.244463 25082 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:47.247294 25082 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:47.248963 25141 ts_tablet_manager.cc:933] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
W20260709 13:20:47.258802 19184 consensus_peers.cc:597] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8433d8c678614c00ad69faf57a9363de. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:47.263799 25141 tablet_copy_client.cc:323] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:47.286480 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 2653a1baca71467dbf9167aede923a9c from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:47.287073 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 2653a1baca71467dbf9167aede923a9c from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-2653a1baca71467dbf9167aede923a9c
I20260709 13:20:47.296507 19082 tablet_copy_source_session.cc:215] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.300758 25141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2653a1baca71467dbf9167aede923a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.299738 25082 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.302706 19138 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.325054 19071 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.342547 25141 tablet_copy_client.cc:806] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:47.345016 18967 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 13, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 20 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:47.343190 25141 tablet_copy_client.cc:670] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:47.362517 25141 tablet_copy_client.cc:538] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:47.374974 25141 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:47.445444 25082 raft_consensus.cc:993] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:47.445964 25082 raft_consensus.cc:1081] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:47.447592 19138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47596
I20260709 13:20:47.448150 19138 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:47.448483 19138 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.459178 25145 ts_tablet_manager.cc:933] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:47.456593 19138 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:47.474557 19138 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 23 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:47.474697 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:47.475273 19220 raft_consensus.cc:3055] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:47.475579 19220 raft_consensus.cc:740] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:47.476722 25145 tablet_copy_client.cc:323] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:47.478423 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:47.478957 19750 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.479218 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:47.479717 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-9d0433fa5eeb4f7b83f2fbd60b78b0f4
I20260709 13:20:47.485536 19750 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 23.
I20260709 13:20:47.487987 19110 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:47.489015 25137 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:47.489531 25137 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 23 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:47.490422 25137 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:47.476363 19220 consensus_queue.cc:260] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:47.507148 19220 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.522903 19082 tablet_copy_source_session.cc:215] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.527048 25145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.536235 19220 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 23.
I20260709 13:20:47.574095 25149 ts_tablet_manager.cc:933] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:47.605723 25149 tablet_copy_client.cc:323] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:20:47.607602 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet ef2bd04462cb41488ea5d3a18b899972 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:20:47.608182 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet ef2bd04462cb41488ea5d3a18b899972 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-ef2bd04462cb41488ea5d3a18b899972
I20260709 13:20:47.618775 18962 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 22 to 23, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 23 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.622680 19156 tablet_copy_source_session.cc:215] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.652933 25149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2bd04462cb41488ea5d3a18b899972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.664963 25145 tablet_copy_client.cc:806] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:47.665551 25145 tablet_copy_client.cc:670] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:47.673720 25145 tablet_copy_client.cc:538] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:47.683565 25145 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:47.709635 25141 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:47.710747 25141 tablet_bootstrap.cc:492] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:47.711493 25141 ts_tablet_manager.cc:1403] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.338s	user 0.030s	sys 0.020s
I20260709 13:20:47.718564 25149 tablet_copy_client.cc:806] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:47.719133 25149 tablet_copy_client.cc:670] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:47.723174 25149 tablet_copy_client.cc:538] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:47.733366 25149 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:47.724574 25141 raft_consensus.cc:359] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:47.737242 25141 raft_consensus.cc:740] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:47.738018 25141 consensus_queue.cc:260] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:47.746871 25141 ts_tablet_manager.cc:1434] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:20:47.749209 19751 raft_consensus.cc:1217] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:20:47.759449 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-2653a1baca71467dbf9167aede923a9c received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:47.759889 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-2653a1baca71467dbf9167aede923a9c on tablet 2653a1baca71467dbf9167aede923a9c with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:47.817131 25141 ts_tablet_manager.cc:933] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:47.835039 25145 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:47.837097 25145 tablet_bootstrap.cc:492] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:47.837868 25145 ts_tablet_manager.cc:1403] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.155s	user 0.045s	sys 0.005s
I20260709 13:20:47.838529 25141 tablet_copy_client.cc:323] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:20:47.840278 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 8433d8c678614c00ad69faf57a9363de from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:20:47.840999 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 8433d8c678614c00ad69faf57a9363de from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-8433d8c678614c00ad69faf57a9363de
I20260709 13:20:47.851063 19230 tablet_copy_source_session.cc:215] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.871503 25141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8433d8c678614c00ad69faf57a9363de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.893074 25145 raft_consensus.cc:359] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:47.894047 25145 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:47.894760 25145 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:47.919600 25145 ts_tablet_manager.cc:1434] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.081s	user 0.000s	sys 0.007s
I20260709 13:20:47.921422 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-9d0433fa5eeb4f7b83f2fbd60b78b0f4 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:47.921862 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-9d0433fa5eeb4f7b83f2fbd60b78b0f4 on tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:47.958710 25149 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:47.959661 25149 tablet_bootstrap.cc:492] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:47.960340 25149 ts_tablet_manager.cc:1403] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.227s	user 0.033s	sys 0.003s
I20260709 13:20:47.974145 25141 tablet_copy_client.cc:806] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:47.973780 25149 raft_consensus.cc:359] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:47.974642 25149 raft_consensus.cc:740] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:47.974869 25141 tablet_copy_client.cc:670] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:47.980319 25141 tablet_copy_client.cc:538] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:47.996534 25149 consensus_queue.cc:260] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:48.007664 25141 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:48.017511 25149 ts_tablet_manager.cc:1434] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.003s
I20260709 13:20:48.023411 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-ef2bd04462cb41488ea5d3a18b899972 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:20:48.023940 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-ef2bd04462cb41488ea5d3a18b899972 on tablet ef2bd04462cb41488ea5d3a18b899972 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:48.045610 19750 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 23 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:48.045816 19751 raft_consensus.cc:1217] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:20:48.059444 19217 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 23 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:48.065812 25118 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.112982 25137 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.128361 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:48.139320 25141 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:48.140364 25141 tablet_bootstrap.cc:492] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:48.141111 25141 ts_tablet_manager.cc:1403] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.135s	user 0.036s	sys 0.011s
I20260709 13:20:48.145370 25141 raft_consensus.cc:359] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:48.146248 25141 raft_consensus.cc:740] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:48.146890 25141 consensus_queue.cc:260] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:48.148680 19751 raft_consensus.cc:1217] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.12->[17.13-17.13]   Dedup: 17.13->[]
I20260709 13:20:48.149444 25141 ts_tablet_manager.cc:1434] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:20:48.151369 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-8433d8c678614c00ad69faf57a9363de received from {username='slave'} at 127.0.0.1:42382
I20260709 13:20:48.151798 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-8433d8c678614c00ad69faf57a9363de on tablet 8433d8c678614c00ad69faf57a9363de with peer 508ee2e0531b43d7a1c05f950644ae66
W20260709 13:20:48.263720 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 74401.6us
I20260709 13:20:48.306427 19744 raft_consensus.cc:1217] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 13:20:48.318437 25135 raft_consensus.cc:1064] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:48.328145 25135 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:48.418860 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 44088.2us
W20260709 13:20:48.468223 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 110973us
W20260709 13:20:48.596312 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 116093us
I20260709 13:20:48.602312 19744 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:48.606807 25133 raft_consensus.cc:1064] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:48.607054 19140 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:48.609364 25133 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:48.625090 19214 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:48.639163 25175 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:48.651883 25170 raft_consensus.cc:1064] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:48.653035 25175 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:48.654438 25170 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 8, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:48.660544 25135 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:48.695080 25176 raft_consensus.cc:1064] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:48.697890 25176 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:48.720681 19744 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:48.721859 19220 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:48.726141 19067 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:48.734853 25182 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.725360 25160 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:20:48.736974 19138 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.743392 25102 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:48.749029 19744 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.745321 25181 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:20:48.790534 19138 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:48.797303 19751 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:48.803717 19751 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:48.805267 25175 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.805464 19138 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:48.802333 25174 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:20:48.808828 25178 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.809041 25165 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:48.783555 18965 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.815061 19217 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:48.832095 25133 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
W20260709 13:20:48.847774 25188 log.cc:927] Time spent T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:20:48.858668 25118 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.863220 19214 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.925858 19070 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:48.905162 25133 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.935773 19220 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.947326 19071 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.949522 18962 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:48.975529 25176 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:49.000509 19140 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.045271 19751 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.074074 25169 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.087360 19214 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.087723 19751 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.090417 19750 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.124809 19138 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.125439 19070 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.199404 18965 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.201753 18965 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 13 to 14, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.238957 19215 consensus_queue.cc:237] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:49.243870 19067 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:49.245589 19751 raft_consensus.cc:1275] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:49.247368 25176 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:49.249480 25169 consensus_queue.cc:1048] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:49.256107 25108 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.260146 19071 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.261560 19070 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:49.264488 19744 raft_consensus.cc:2955] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.275229 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8433d8c678614c00ad69faf57a9363de with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:49.291489 19138 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:49.293773 19751 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:20:49.296938 19140 consensus_queue.cc:237] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:49.295058 18966 catalog_manager.cc:5697] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 14 to 15, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 20 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.300491 25168 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:49.301661 19067 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:49.302433 25168 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:49.311748 25133 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.318557 19750 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:49.320973 19070 raft_consensus.cc:1275] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:49.320185 25181 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:20:49.331547 25166 consensus_queue.cc:1048] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:49.332562 19214 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:49.334411 25202 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:49.338464 19750 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:49.339911 25202 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:49.348758 25182 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.349027 19214 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.332790 19138 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.361480 19750 raft_consensus.cc:2955] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.366219 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 8433d8c678614c00ad69faf57a9363de with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:41872
I20260709 13:20:49.372020 19751 raft_consensus.cc:2955] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.393049 25102 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.397079 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2653a1baca71467dbf9167aede923a9c with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:49.400507 19067 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.405982 19746 raft_consensus.cc:2955] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.409176 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef2bd04462cb41488ea5d3a18b899972 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:49.434672 25206 tablet_replica.cc:333] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:20:49.436008 18962 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 9 to 10, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 11 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:49.440305 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:49.448333 25206 raft_consensus.cc:2243] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.445747 18968 catalog_manager.cc:5697] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 11 to 12, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.447175 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:49.449177 25206 raft_consensus.cc:2272] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.462137 25206 ts_tablet_manager.cc:1916] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:49.470006 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 2653a1baca71467dbf9167aede923a9c with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:41872
I20260709 13:20:49.491783 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet ef2bd04462cb41488ea5d3a18b899972 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:35022
I20260709 13:20:49.492990 18966 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 14 to 15, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.520821 19206 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:35022
I20260709 13:20:49.536510 25207 tablet_replica.cc:333] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:20:49.543468 25207 raft_consensus.cc:2243] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.557585 25207 raft_consensus.cc:2272] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.572576 19138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:49.573170 19138 raft_consensus.cc:606] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Received request to transfer leadership to TS 55991c1f7f474a9888725d00438d8a83
I20260709 13:20:49.574393 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:49.575834 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:49.604000 25207 ts_tablet_manager.cc:1916] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:49.621498 25206 ts_tablet_manager.cc:1929] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 13:20:49.622026 25206 log.cc:1199] T 8433d8c678614c00ad69faf57a9363de P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/8433d8c678614c00ad69faf57a9363de
I20260709 13:20:49.623947 25206 tablet_replica.cc:333] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:20:49.623852 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 8433d8c678614c00ad69faf57a9363de (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:49.642134 25206 raft_consensus.cc:2243] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.643183 25206 raft_consensus.cc:2272] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.647709 25206 ts_tablet_manager.cc:1916] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:49.672479 25207 ts_tablet_manager.cc:1929] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 13:20:49.673219 25207 log.cc:1199] T ef2bd04462cb41488ea5d3a18b899972 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/ef2bd04462cb41488ea5d3a18b899972
I20260709 13:20:49.675480 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet ef2bd04462cb41488ea5d3a18b899972 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:49.675855 25207 tablet_replica.cc:333] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:20:49.680228 25206 ts_tablet_manager.cc:1929] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:20:49.680806 25206 log.cc:1199] T 2653a1baca71467dbf9167aede923a9c P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/2653a1baca71467dbf9167aede923a9c
I20260709 13:20:49.682552 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 2653a1baca71467dbf9167aede923a9c (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:49.692019 25166 raft_consensus.cc:993] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:49.692517 25166 raft_consensus.cc:1081] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Signalling peer 55991c1f7f474a9888725d00438d8a83 to start an election
I20260709 13:20:49.694157 19220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
 from {username='slave'} at 127.0.0.1:40764
I20260709 13:20:49.694739 19220 raft_consensus.cc:493] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:49.695060 19220 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:49.704437 25207 raft_consensus.cc:2243] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.705410 25207 raft_consensus.cc:2272] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.709136 25207 ts_tablet_manager.cc:1916] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:49.707839 19220 raft_consensus.cc:515] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:49.720263 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:49.720901 19067 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:49.720988 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af214f1f7324aef8b59a1b91a41d317" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:49.721671 19138 raft_consensus.cc:3055] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:49.721967 19138 raft_consensus.cc:740] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:49.723160 19138 consensus_queue.cc:260] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:49.724275 19138 raft_consensus.cc:3060] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:49.728161 19067 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:49.731942 19184 leader_election.cc:304] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:49.732784 25176 raft_consensus.cc:2804] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:49.733295 25176 raft_consensus.cc:697] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:49.734149 25176 consensus_queue.cc:237] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:49.738654 19220 leader_election.cc:290] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:49.747313 25207 ts_tablet_manager.cc:1929] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 13:20:49.757599 25207 log.cc:1199] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/9d0433fa5eeb4f7b83f2fbd60b78b0f4
I20260709 13:20:49.759353 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 9d0433fa5eeb4f7b83f2fbd60b78b0f4 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:49.765278 19138 raft_consensus.cc:2468] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:20:49.786530 18968 catalog_manager.cc:5697] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 14 to 15, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 15 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.223258 19067 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:50.227133 25108 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:50.351701 19138 raft_consensus.cc:1275] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:50.374953 25108 consensus_queue.cc:1048] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:50.496999 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 48607us
I20260709 13:20:50.576678 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:51.089036 19140 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:20:51.129222 19110 consensus_peers.cc:597] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66a9130f4c8e4d5a9ad02554fc4c7a28. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.130128 19217 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:51.133315 25218 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:51.139619 19071 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:51.141326 25166 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:51.180681 25217 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.198031 19220 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.201504 19071 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.231182 18968 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 12, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.234266 19217 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:51.262974 19140 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:51.269280 25227 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:51.270741 19184 consensus_peers.cc:597] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a8a26e15ebb4ecfae8b6eff7a8cc22f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.279134 19071 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:51.283239 25176 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:51.328579 25216 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.385483 19067 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.424765 19138 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.443212 19067 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:51.463096 18966 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 16 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:51.479146 19035 consensus_peers.cc:597] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a9f9257bc714987a2bba35964a315cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.480590 19217 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:51.483703 25168 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:51.488186 19140 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:51.493522 25221 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:51.529470 25182 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.554672 19220 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.569280 19140 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.641150 25241 ts_tablet_manager.cc:933] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:51.657143 19071 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:51.650667 18968 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.691715 19220 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:51.693342 25182 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:51.711133 19138 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:51.717128 25168 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:51.719759 19035 consensus_peers.cc:597] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d52b625596354c7f9589dc83d8b49ce5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.730165 25182 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.731997 19214 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.753441 25241 tablet_copy_client.cc:323] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:20:51.756589 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:20:51.757277 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-66a9130f4c8e4d5a9ad02554fc4c7a28
I20260709 13:20:51.772830 19156 tablet_copy_source_session.cc:215] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:51.784382 25241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:51.788329 18962 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 18 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.815048 19140 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:51.899024 25245 ts_tablet_manager.cc:933] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:51.926034 25245 tablet_copy_client.cc:323] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:20:51.919956 25241 tablet_copy_client.cc:806] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:51.933269 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:20:51.933640 25241 tablet_copy_client.cc:670] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:51.933911 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-1a8a26e15ebb4ecfae8b6eff7a8cc22f
I20260709 13:20:51.960686 19230 tablet_copy_source_session.cc:215] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:51.962626 25241 tablet_copy_client.cc:538] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:51.969224 25245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:51.992031 25248 ts_tablet_manager.cc:933] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:52.013222 25245 tablet_copy_client.cc:806] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:52.013947 25245 tablet_copy_client.cc:670] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:52.014086 25248 tablet_copy_client.cc:323] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:52.002537 25241 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:52.016311 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet 6a9f9257bc714987a2bba35964a315cf from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:52.016767 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet 6a9f9257bc714987a2bba35964a315cf from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-6a9f9257bc714987a2bba35964a315cf
I20260709 13:20:52.026295 19082 tablet_copy_source_session.cc:215] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:52.042234 25248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9f9257bc714987a2bba35964a315cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:52.051066 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:52.066308 25245 tablet_copy_client.cc:538] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:52.107091 25245 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:52.124682 25248 tablet_copy_client.cc:806] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:52.125494 25248 tablet_copy_client.cc:670] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:52.130736 25248 tablet_copy_client.cc:538] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:52.167834 25248 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:52.234632 25252 ts_tablet_manager.cc:933] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:52.250867 25241 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:52.253728 25241 tablet_bootstrap.cc:492] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:52.260756 25241 ts_tablet_manager.cc:1403] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.258s	user 0.035s	sys 0.012s
I20260709 13:20:52.259759 25252 tablet_copy_client.cc:323] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:52.262796 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet d52b625596354c7f9589dc83d8b49ce5 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:52.263350 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet d52b625596354c7f9589dc83d8b49ce5 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-d52b625596354c7f9589dc83d8b49ce5
I20260709 13:20:52.277771 19082 tablet_copy_source_session.cc:215] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:52.282644 25252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52b625596354c7f9589dc83d8b49ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:52.298344 19220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a"
dest_uuid: "55991c1f7f474a9888725d00438d8a83"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:60786
I20260709 13:20:52.299468 19220 raft_consensus.cc:606] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:52.313618 25241 raft_consensus.cc:359] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:52.316929 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:52.315339 25241 raft_consensus.cc:740] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:52.325578 25241 consensus_queue.cc:260] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:52.332343 25241 ts_tablet_manager.cc:1434] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 13:20:52.338330 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:52.370573 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-66a9130f4c8e4d5a9ad02554fc4c7a28 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:20:52.371084 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-66a9130f4c8e4d5a9ad02554fc4c7a28 on tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:52.339251 25245 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:52.380964 25245 tablet_bootstrap.cc:492] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:52.382535 25245 ts_tablet_manager.cc:1403] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.276s	user 0.048s	sys 0.010s
I20260709 13:20:52.348552 25252 tablet_copy_client.cc:806] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:52.384150 25252 tablet_copy_client.cc:670] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:52.386448 25245 raft_consensus.cc:359] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:52.387316 25245 raft_consensus.cc:740] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:52.388176 25252 tablet_copy_client.cc:538] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:52.391567 25245 consensus_queue.cc:260] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:52.394251 25245 ts_tablet_manager.cc:1434] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:52.397678 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-1a8a26e15ebb4ecfae8b6eff7a8cc22f received from {username='slave'} at 127.0.0.1:42382
I20260709 13:20:52.398116 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-1a8a26e15ebb4ecfae8b6eff7a8cc22f on tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:52.448282 25252 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:52.458189 25248 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:52.459251 25248 tablet_bootstrap.cc:492] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:52.460003 25248 ts_tablet_manager.cc:1403] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.292s	user 0.046s	sys 0.003s
I20260709 13:20:52.463812 25248 raft_consensus.cc:359] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:52.464656 25248 raft_consensus.cc:740] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:52.465729 25255 raft_consensus.cc:993] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: : Instructing follower 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:20:52.465422 25248 consensus_queue.cc:260] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:52.466265 25176 raft_consensus.cc:1081] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Signalling peer 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:20:52.468617 25248 ts_tablet_manager.cc:1434] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:20:52.470890 19064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:20:52.471480 19064 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:52.471789 19064 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.475950 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-6a9f9257bc714987a2bba35964a315cf received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:52.476418 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-6a9f9257bc714987a2bba35964a315cf on tablet 6a9f9257bc714987a2bba35964a315cf with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:52.482259 19064 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:52.485136 19214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:52.485731 19214 raft_consensus.cc:3055] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:52.486030 19214 raft_consensus.cc:740] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:20:52.486797 19214 consensus_queue.cc:260] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:52.487869 19214 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.491516 19064 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Requested vote from peers 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:52.492902 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:52.493480 19744 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.500409 19744 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:52.502025 19035 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:52.504570 25168 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.505441 19214 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 15.
I20260709 13:20:52.560302 19744 raft_consensus.cc:1217] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:20:52.577334 25168 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:52.676057 19744 raft_consensus.cc:1217] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:20:52.640707 25168 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:52.661203 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 100836us
W20260709 13:20:52.863907 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 72199.1us
W20260709 13:20:52.935494 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 94432.6us
W20260709 13:20:53.013509 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 63158.2us
I20260709 13:20:53.066828 19744 raft_consensus.cc:1217] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
W20260709 13:20:53.078311 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 68706.1us
I20260709 13:20:53.071686 18965 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 14 to 15, leader changed from 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:53.086575 25252 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:53.088459 25252 tablet_bootstrap.cc:492] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:53.090166 25252 ts_tablet_manager.cc:1403] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.672s	user 0.034s	sys 0.023s
I20260709 13:20:53.095713 25252 raft_consensus.cc:359] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:53.107429 25252 raft_consensus.cc:740] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:53.108505 25252 consensus_queue.cc:260] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:53.112174 25252 ts_tablet_manager.cc:1434] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:20:53.115227 19082 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-d52b625596354c7f9589dc83d8b49ce5 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:53.115628 19082 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-d52b625596354c7f9589dc83d8b49ce5 on tablet d52b625596354c7f9589dc83d8b49ce5 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:53.157792 25259 raft_consensus.cc:1064] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:53.160380 25259 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:20:53.189329 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 47279.4us
I20260709 13:20:53.217747 25181 raft_consensus.cc:1064] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:53.226979 25181 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:53.235562 19138 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:53.236361 19220 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:53.237257 25285 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.239360 25285 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.239970 19746 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:53.242476 25221 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.254511 19746 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:53.257809 25285 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.289453 19744 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:53.300688 19220 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:53.303011 25221 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.303470 25258 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.306051 19220 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.328567 25267 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:53.332716 19212 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:53.338726 25279 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:53.360749 19067 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:53.362709 25181 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:53.351013 19744 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.374162 18965 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.392024 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:53.409087 19071 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:53.410223 19143 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.415477 19220 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:53.418370 25285 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:53.550276 25280 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:53.634737 25308 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:20:53.653126 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 109100us
I20260709 13:20:53.696543 19744 raft_consensus.cc:1217] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:20:53.710444 19751 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:53.725967 19214 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:53.741302 25309 log.cc:927] Time spent T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:20:53.788055 25221 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:20:53.762467 25266 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.801600 19746 raft_consensus.cc:2955] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.824666 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a9f9257bc714987a2bba35964a315cf with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:20:53.829972 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 112290us
I20260709 13:20:53.837529 19214 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:53.843297 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 83692.3us
I20260709 13:20:53.851037 18965 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 11 to 12, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 17 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:53.865360 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 146066us
I20260709 13:20:53.892447 19069 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.900123 25325 raft_consensus.cc:1064] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:53.902798 25325 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:53.924770 19750 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.933841 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a9f9257bc714987a2bba35964a315cf with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41872
I20260709 13:20:53.965428 25332 tablet_replica.cc:333] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:20:53.966615 25332 raft_consensus.cc:2243] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:53.967432 25332 raft_consensus.cc:2272] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:53.956043 18965 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 12 to 13, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:53.972571 25332 ts_tablet_manager.cc:1916] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:54.022341 19750 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:54.023669 19138 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:54.024910 19069 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:54.027467 25261 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:54.039851 25261 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:54.041944 19138 consensus_queue.cc:237] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:54.051028 19746 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:54.051578 19069 raft_consensus.cc:1275] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:54.053066 25261 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:54.053066 25181 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:54.054230 25284 consensus_queue.cc:1048] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:54.069167 25267 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.073352 25332 ts_tablet_manager.cc:1929] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:20:54.073834 25332 log.cc:1199] T 6a9f9257bc714987a2bba35964a315cf P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/6a9f9257bc714987a2bba35964a315cf
I20260709 13:20:54.087944 25221 raft_consensus.cc:1064] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:54.090663 25221 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:54.099313 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 6a9f9257bc714987a2bba35964a315cf (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:54.103595 19069 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.148324 19744 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:54.148667 25261 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.150337 25280 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:54.150674 19212 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:54.152392 25313 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:54.161079 19145 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:54.165841 25221 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:54.169157 18968 catalog_manager.cc:5697] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 13 to 14, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.233503 25280 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.236682 19750 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.252748 19750 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.270361 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:35022
I20260709 13:20:54.277081 19746 raft_consensus.cc:2955] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.307210 18968 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:54.367985 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 99293.3us
I20260709 13:20:54.370460 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:20:54.374874 19038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 61401us
W20260709 13:20:54.375643 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 69790.6us
I20260709 13:20:54.397755 19145 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.431075 18966 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.452940 25340 tablet_replica.cc:333] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:20:54.473742 25340 raft_consensus.cc:2243] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:54.474915 25340 raft_consensus.cc:2272] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:54.482107 19145 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.490060 19069 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.505371 19212 consensus_queue.cc:237] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:54.506577 19220 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.517875 19063 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:54.548158 19751 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:54.550279 19069 raft_consensus.cc:1275] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:54.550405 25261 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:54.558211 25261 consensus_queue.cc:1048] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:54.571146 25340 ts_tablet_manager.cc:1916] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:54.576442 19751 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:54.583573 25255 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.584991 19143 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:54.585553 19750 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.589488 19069 raft_consensus.cc:2955] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.592723 25342 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:54.594630 25328 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:54.608764 25328 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.631757 19143 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.641921 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:54.648980 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d52b625596354c7f9589dc83d8b49ce5 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:54.653517 19750 raft_consensus.cc:2955] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.656705 18965 catalog_manager.cc:5697] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 12 to 13, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 16 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:54.677448 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41872
I20260709 13:20:54.703047 18965 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 12 to 13, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 18 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:54.710441 25340 ts_tablet_manager.cc:1929] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:20:54.711757 25340 log.cc:1199] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/66a9130f4c8e4d5a9ad02554fc4c7a28
I20260709 13:20:54.716370 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:54.733033 25345 tablet_replica.cc:333] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:20:54.734135 25345 raft_consensus.cc:2243] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:54.734850 25345 raft_consensus.cc:2272] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:54.757216 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet 66a9130f4c8e4d5a9ad02554fc4c7a28 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:54.759164 25345 ts_tablet_manager.cc:1916] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:54.769819 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet d52b625596354c7f9589dc83d8b49ce5 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35022
I20260709 13:20:54.780992 25340 tablet_replica.cc:333] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:20:54.794543 25340 raft_consensus.cc:2243] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:54.801918 25340 raft_consensus.cc:2272] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:54.816730 19063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:54.817363 19063 raft_consensus.cc:606] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Received request to transfer leadership to TS 0f833abfb3544031bee566e655b7fedc
I20260709 13:20:54.822758 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:54.823902 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:54.836390 25340 ts_tablet_manager.cc:1916] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:54.849181 25345 ts_tablet_manager.cc:1929] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:20:54.859591 25345 log.cc:1199] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/1a8a26e15ebb4ecfae8b6eff7a8cc22f
I20260709 13:20:54.863003 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet 1a8a26e15ebb4ecfae8b6eff7a8cc22f (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:54.868335 25340 ts_tablet_manager.cc:1929] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:20:54.877343 25340 log.cc:1199] T d52b625596354c7f9589dc83d8b49ce5 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/d52b625596354c7f9589dc83d8b49ce5
I20260709 13:20:54.878835 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet d52b625596354c7f9589dc83d8b49ce5 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:55.083390 25328 raft_consensus.cc:993] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:55.084007 25328 raft_consensus.cc:1081] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Signalling peer 0f833abfb3544031bee566e655b7fedc to start an election
I20260709 13:20:55.086995 19143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
 from {username='slave'} at 127.0.0.1:47594
I20260709 13:20:55.087544 19143 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.087857 19143 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.101063 19143 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:55.119787 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:55.120431 19063 raft_consensus.cc:3055] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:55.120659 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:20:55.121243 19750 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.120721 19063 raft_consensus.cc:740] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:55.124244 19063 consensus_queue.cc:260] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:55.125486 19063 raft_consensus.cc:3060] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.144338 19750 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:55.145769 19110 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:20:55.146632 25284 raft_consensus.cc:2804] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:55.147128 25284 raft_consensus.cc:697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:55.147907 25284 consensus_queue.cc:237] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:55.157326 19143 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:55.159040 19063 raft_consensus.cc:2468] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:20:55.194638 18962 catalog_manager.cc:5697] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 17 to 18, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 18 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.584151 19750 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:20:55.587085 25322 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:20:55.688701 19063 raft_consensus.cc:1275] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:20:55.695959 25322 consensus_queue.cc:1048] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:55.824746 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:56.096567 19212 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:56.121917 19143 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:56.124337 19069 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:20:56.158818 19184 consensus_peers.cc:597] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1b4ebbb026847c7a47a03402902ca2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.167318 25347 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:56.201296 25261 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:56.239666 25347 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.251474 19143 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.280164 19063 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.310261 19220 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:56.310262 18962 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.344241 19143 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:56.346125 25347 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:56.348469 19184 consensus_peers.cc:597] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3bb7a633516455782a998ee89832b55. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.349131 19063 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:56.352210 25347 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:56.368749 25261 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.370318 19069 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.393736 19143 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.395153 19069 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:20:56.420379 19035 consensus_peers.cc:597] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7fd9d26dc9f47ba92b818f308617d95. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.421603 19220 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:56.423209 25343 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:56.422349 19143 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:56.437949 25221 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:56.444031 18968 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 10, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 14 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.475111 25221 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.501705 19069 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:56.508016 19215 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.515445 18962 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.523499 19143 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:20:56.539305 19035 consensus_peers.cc:597] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adf40f6b88894de8b62437b0a878c787. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.548629 19145 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:56.550403 25221 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:56.557153 19212 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:56.558542 25221 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:56.611186 25372 ts_tablet_manager.cc:933] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:56.625770 19212 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.623991 25358 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.645820 18965 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.673658 19145 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:20:56.679539 25372 tablet_copy_client.cc:323] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:20:56.683424 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet c1b4ebbb026847c7a47a03402902ca2a from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:20:56.685218 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet c1b4ebbb026847c7a47a03402902ca2a from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-c1b4ebbb026847c7a47a03402902ca2a
I20260709 13:20:56.714687 19230 tablet_copy_source_session.cc:215] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:56.717998 25372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b4ebbb026847c7a47a03402902ca2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:57.076660 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:57.096714 25372 tablet_copy_client.cc:806] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:57.098891 25372 tablet_copy_client.cc:670] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
W20260709 13:20:57.104907 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 369032us
W20260709 13:20:57.136680 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 389981us
I20260709 13:20:57.622785 25372 tablet_copy_client.cc:538] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:57.634866 25372 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:57.651499 25374 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:57.655510 25374 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:20:57.658915 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 73810.6us
I20260709 13:20:57.660346 25384 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:20:57.661942 25384 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:57.674912 25379 ts_tablet_manager.cc:933] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:57.675729 25384 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:57.683806 25377 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:57.684453 25377 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:57.686609 25322 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:57.687148 25322 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:57.688434 25377 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:57.691001 19143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a"
dest_uuid: "0f833abfb3544031bee566e655b7fedc"
mode: GRACEFUL
new_leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:51744
I20260709 13:20:57.691537 19143 raft_consensus.cc:606] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Received request to transfer leadership to TS 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:57.692906 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:57.694756 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:57.717988 25383 raft_consensus.cc:493] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:20:57.718621 25383 raft_consensus.cc:515] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:57.720700 25383 leader_election.cc:290] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:57.741169 25374 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:20:57.767246 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:57.780151 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.792428 25354 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:57.793044 25354 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:57.795217 25354 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:57.796545 19142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:57.798511 25378 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:57.799047 25378 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:57.819430 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.838642 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:57.845891 25378 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:20:57.836591 25327 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:20:57.847529 25327 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:57.849526 25327 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:57.853538 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.862749 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3627cae163084c338404a5153ef0efb9" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.864508 25322 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:57.872308 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:57.874698 25394 ts_tablet_manager.cc:933] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:57.876673 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c9cfe67c8c483e9edc1da47107fd2f" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.880223 19063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.881352 19071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.883817 25393 ts_tablet_manager.cc:933] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919)
I20260709 13:20:57.885903 19067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" is_pre_election: true
I20260709 13:20:57.890040 19213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:57.891662 25381 raft_consensus.cc:993] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: : Instructing follower 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:20:57.892200 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:20:57.892153 25381 raft_consensus.cc:1081] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Signalling peer 7cac62c1d5aa4356b70f6517fe0ba5d6 to start an election
I20260709 13:20:57.895174 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:20:57.893406 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:57.898640 19717 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:57.898412 25327 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:57.903522 19110 leader_election.cc:304] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:57.904286 25381 raft_consensus.cc:2749] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:57.905614 19110 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:57.906454 25381 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:57.911332 19067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
 from {username='slave'} at 127.0.0.1:36478
I20260709 13:20:57.912125 19067 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:57.912644 19067 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:57.932145 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 215541us
I20260709 13:20:57.933151 25379 tablet_copy_client.cc:323] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:20:57.931624 25392 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:57.947130 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:20:57.947388 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet c3bb7a633516455782a998ee89832b55 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:20:57.947932 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet c3bb7a633516455782a998ee89832b55 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-c3bb7a633516455782a998ee89832b55
I20260709 13:20:57.944770 19110 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:57.981048 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:57.983479 25381 raft_consensus.cc:2749] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:57.956092 19067 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:57.995002 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:20:57.989718 25381 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:57.997336 19138 raft_consensus.cc:3055] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:57.997687 19138 raft_consensus.cc:740] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:20:57.998457 19138 consensus_queue.cc:260] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:57.999315 19138 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.002547 19067 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:20:58.003574 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:20:58.004158 19221 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.009769 19138 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:58.011178 19035 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 
I20260709 13:20:58.012212 25387 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:58.012818 25387 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Becoming Leader. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:58.014711 25387 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:20:58.013880 19230 tablet_copy_source_session.cc:215] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:58.021099 25394 tablet_copy_client.cc:323] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:58.027024 25379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bb7a633516455782a998ee89832b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:58.029129 19082 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet e7fd9d26dc9f47ba92b818f308617d95 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:58.029752 19082 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet e7fd9d26dc9f47ba92b818f308617d95 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-e7fd9d26dc9f47ba92b818f308617d95
I20260709 13:20:58.030961 25393 tablet_copy_client.cc:323] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.1:33919
I20260709 13:20:58.033015 19081 tablet_copy_service.cc:140] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Received BeginTabletCopySession request for tablet adf40f6b88894de8b62437b0a878c787 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:59842)
I20260709 13:20:58.033658 19081 tablet_copy_service.cc:161] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Beginning new tablet copy session on tablet adf40f6b88894de8b62437b0a878c787 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:59842: session id = 508ee2e0531b43d7a1c05f950644ae66-adf40f6b88894de8b62437b0a878c787
W20260709 13:20:58.045349 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 53213.4us
I20260709 13:20:58.055968 19082 tablet_copy_source_session.cc:215] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:58.057224 19081 tablet_copy_source_session.cc:215] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:58.064446 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fd9d26dc9f47ba92b818f308617d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:58.056677 19221 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cac62c1d5aa4356b70f6517fe0ba5d6 in term 16.
I20260709 13:20:58.070670 25379 tablet_copy_client.cc:806] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:58.071323 25379 tablet_copy_client.cc:670] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:58.074244 25393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf40f6b88894de8b62437b0a878c787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:58.075832 25379 tablet_copy_client.cc:538] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:58.081540 18965 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: term changed from 15 to 16, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1). New cstate: current_term: 16 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:58.120466 25379 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
W20260709 13:20:58.140283 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 65190.5us
I20260709 13:20:58.145380 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:58.146445 25347 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:58.212800 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 61050us
I20260709 13:20:58.213537 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:20:58.214596 25347 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:58.249924 25372 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.250941 25372 tablet_bootstrap.cc:492] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:58.251694 25372 ts_tablet_manager.cc:1403] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.617s	user 0.044s	sys 0.008s
I20260709 13:20:58.299484 25372 raft_consensus.cc:359] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.300496 25372 raft_consensus.cc:740] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:58.305472 25394 tablet_copy_client.cc:806] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:58.308806 25394 tablet_copy_client.cc:670] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:58.310638 25379 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.311594 25379 tablet_bootstrap.cc:492] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:58.312280 25379 ts_tablet_manager.cc:1403] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.192s	user 0.066s	sys 0.038s
I20260709 13:20:58.313334 25394 tablet_copy_client.cc:538] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:58.316290 25393 tablet_copy_client.cc:806] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:58.301211 25372 consensus_queue.cc:260] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.324205 25393 tablet_copy_client.cc:670] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:58.338328 25393 tablet_copy_client.cc:538] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:58.340680 25394 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:58.337297 25372 ts_tablet_manager.cc:1434] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.002s
I20260709 13:20:58.361469 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c1b4ebbb026847c7a47a03402902ca2a received from {username='slave'} at 127.0.0.1:42382
I20260709 13:20:58.361915 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c1b4ebbb026847c7a47a03402902ca2a on tablet c1b4ebbb026847c7a47a03402902ca2a with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:58.365597 25379 raft_consensus.cc:359] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.366722 25379 raft_consensus.cc:740] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:58.367391 25379 consensus_queue.cc:260] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.363785 25393 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:20:58.370596 25379 ts_tablet_manager.cc:1434] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 13:20:58.373461 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c3bb7a633516455782a998ee89832b55 received from {username='slave'} at 127.0.0.1:42382
I20260709 13:20:58.373908 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-c3bb7a633516455782a998ee89832b55 on tablet c3bb7a633516455782a998ee89832b55 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:58.399081 19139 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:58.400911 25343 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:58.409991 19751 raft_consensus.cc:1217] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:20:58.479799 19219 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:58.482637 25343 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:58.506835 19751 raft_consensus.cc:1217] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:20:58.539213 25394 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.540177 25394 tablet_bootstrap.cc:492] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:58.540910 25394 ts_tablet_manager.cc:1403] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.200s	user 0.037s	sys 0.015s
I20260709 13:20:58.547526 25394 raft_consensus.cc:359] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.548382 25394 raft_consensus.cc:740] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:58.549028 25394 consensus_queue.cc:260] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.551158 25394 ts_tablet_manager.cc:1434] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:20:58.552356 25393 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:58.553301 25393 tablet_bootstrap.cc:492] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:20:58.554032 25393 ts_tablet_manager.cc:1403] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.190s	user 0.039s	sys 0.033s
I20260709 13:20:58.555253 19081 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-e7fd9d26dc9f47ba92b818f308617d95 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:58.555696 19081 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-e7fd9d26dc9f47ba92b818f308617d95 on tablet e7fd9d26dc9f47ba92b818f308617d95 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:58.557126 25393 raft_consensus.cc:359] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.557962 25393 raft_consensus.cc:740] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:20:58.558624 25393 consensus_queue.cc:260] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:20:58.584098 25393 ts_tablet_manager.cc:1434] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
W20260709 13:20:58.588661 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08003554e0 after lost signal to thread 17967
W20260709 13:20:58.589847 19772 debug-util.cc:398] Leaking SignalData structure 0x7b080035d7e0 after lost signal to thread 19004
W20260709 13:20:58.591126 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08002efdc0 after lost signal to thread 19096
W20260709 13:20:58.592285 19772 debug-util.cc:398] Leaking SignalData structure 0x7b0800108360 after lost signal to thread 19171
W20260709 13:20:58.593729 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4ec0 after lost signal to thread 19245
W20260709 13:20:58.607486 19772 debug-util.cc:398] Leaking SignalData structure 0x7b080015cd20 after lost signal to thread 19775
W20260709 13:20:58.607959 19772 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbf60 after lost signal to thread 25261
I20260709 13:20:58.695725 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:58.743966 19081 tablet_copy_service.cc:342] P 7cac62c1d5aa4356b70f6517fe0ba5d6: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-adf40f6b88894de8b62437b0a878c787 received from {username='slave'} at 127.0.0.1:59842
I20260709 13:20:58.744442 19081 tablet_copy_service.cc:434] P 7cac62c1d5aa4356b70f6517fe0ba5d6: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-adf40f6b88894de8b62437b0a878c787 on tablet adf40f6b88894de8b62437b0a878c787 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:58.849462 19751 raft_consensus.cc:1217] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:20:58.895742 25384 raft_consensus.cc:1064] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:58.898802 25384 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:58.925776 19139 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:58.927886 25374 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:58.937734 25398 raft_consensus.cc:1064] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:58.940848 19751 raft_consensus.cc:1217] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:20:58.948324 25398 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.001754 19139 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:59.004210 19071 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:59.004776 19751 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:59.010128 25374 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:59.014530 19071 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:59.012791 25374 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.017081 19751 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:59.024266 25374 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:59.025555 25398 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.099012 25398 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.140213 25374 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.174796 19070 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.182451 18965 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:59.186388 25398 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.194522 19751 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.199762 19139 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.212774 19743 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.239040 19071 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.237799 19138 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.281049 25387 raft_consensus.cc:1064] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:59.284818 25387 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.320238 19743 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:59.321707 19219 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:59.323304 25343 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.324204 25382 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.324903 19139 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:59.326907 25410 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:59.414623 19035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 45611.6us
I20260709 13:20:59.425571 18966 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 10 to 11, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } attrs { replace: true } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.432760 25410 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.429908 19221 consensus_queue.cc:237] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.477146 19751 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.491012 19750 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:59.492534 19138 raft_consensus.cc:1275] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:59.494359 19139 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.492550 25347 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:20:59.502542 25417 consensus_queue.cc:1048] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:59.521649 25420 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.531121 19221 consensus_queue.cc:237] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.533236 19138 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.534183 19750 raft_consensus.cc:2955] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.537611 19743 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:59.538403 19143 raft_consensus.cc:1275] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:59.545503 25347 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:59.547058 25417 consensus_queue.cc:1048] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:59.560187 18962 catalog_manager.cc:5697] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 10 to 11, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 13 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.572342 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b4ebbb026847c7a47a03402902ca2a with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:59.588173 25438 tablet_replica.cc:333] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:20:59.608266 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1b4ebbb026847c7a47a03402902ca2a with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:59.621496 25398 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.626909 18968 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.633131 18957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3bb7a633516455782a998ee89832b55 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:59.658157 19143 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:20:59.669553 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 103523us
I20260709 13:20:59.672362 18968 catalog_manager.cc:5697] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 11 to 12, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New cstate: current_term: 14 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:59.680516 25382 raft_consensus.cc:1064] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:20:59.684554 25382 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.689844 19062 tablet_service.cc:1558] Processing DeleteTablet for tablet c3bb7a633516455782a998ee89832b55 with delete_type TABLET_DATA_TOMBSTONED (TS 7cac62c1d5aa4356b70f6517fe0ba5d6 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51086
I20260709 13:20:59.698813 19751 raft_consensus.cc:2955] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.705210 25438 raft_consensus.cc:2243] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.706063 25438 raft_consensus.cc:2272] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.718017 25438 ts_tablet_manager.cc:1916] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:59.730607 19221 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.749512 19213 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:59.751006 25382 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.756119 25438 ts_tablet_manager.cc:1929] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:20:59.756595 25438 log.cc:1199] T c1b4ebbb026847c7a47a03402902ca2a P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/c1b4ebbb026847c7a47a03402902ca2a
I20260709 13:20:59.757217 19143 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:59.767266 25438 tablet_replica.cc:333] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:20:59.768311 25438 raft_consensus.cc:2243] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.769132 25438 raft_consensus.cc:2272] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.772714 25343 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.773903 19751 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:59.769168 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet c1b4ebbb026847c7a47a03402902ca2a (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:59.776957 25438 ts_tablet_manager.cc:1916] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:59.779080 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:59.791826 25410 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:59.797122 19071 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.807082 19750 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:59.811496 25343 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:59.812944 19138 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:59.818526 25410 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:59.838151 25382 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.847628 19750 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.853998 25343 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.862747 19743 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.865782 25438 ts_tablet_manager.cc:1929] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:20:59.866214 25438 log.cc:1199] T c3bb7a633516455782a998ee89832b55 P 7cac62c1d5aa4356b70f6517fe0ba5d6: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/wals/c3bb7a633516455782a998ee89832b55
I20260709 13:20:59.867923 18954 catalog_manager.cc:5028] TS 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): tablet c3bb7a633516455782a998ee89832b55 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:20:59.867326 19138 raft_consensus.cc:2955] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.867265 19143 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.897581 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet adf40f6b88894de8b62437b0a878c787 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:59.906243 18968 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index 10 to 11, VOTER 55991c1f7f474a9888725d00438d8a83 (127.17.139.3) evicted. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.907774 19213 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.927110 19070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751"
dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
mode: GRACEFUL
new_leader_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:20:59.927681 19070 raft_consensus.cc:606] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Received request to transfer leadership to TS 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:20:59.934156 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:59.935871 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:59.950623 18965 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 9 to 10, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:20:59.957399 25343 raft_consensus.cc:993] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: : Instructing follower 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:20:59.957964 25343 raft_consensus.cc:1081] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Signalling peer 508ee2e0531b43d7a1c05f950644ae66 to start an election
I20260709 13:20:59.959926 19743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751"
dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
 from {username='slave'} at 127.0.0.1:42932
I20260709 13:20:59.960494 19743 raft_consensus.cc:493] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.960848 19743 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:59.968072 19203 tablet_service.cc:1558] Processing DeleteTablet for tablet adf40f6b88894de8b62437b0a878c787 with delete_type TABLET_DATA_TOMBSTONED (TS 55991c1f7f474a9888725d00438d8a83 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:35022
I20260709 13:20:59.979573 19743 raft_consensus.cc:515] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.986866 19070 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:20:59.996999 19221 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:59.997323 19070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6"
I20260709 13:20:59.997946 19070 raft_consensus.cc:3055] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:59.998225 19070 raft_consensus.cc:740] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7cac62c1d5aa4356b70f6517fe0ba5d6, State: Running, Role: LEADER
I20260709 13:20:59.997021 19751 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Refusing update from remote peer 7cac62c1d5aa4356b70f6517fe0ba5d6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:00.000401 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79274c20a7fb4e3dbf6355e5d4a28751" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:21:00.004401 19139 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:00.005318 19070 consensus_queue.cc:260] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:00.006637 19070 raft_consensus.cc:3060] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:00.000486 19743 leader_election.cc:290] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:00.013746 25446 tablet_replica.cc:333] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:00.014796 25446 raft_consensus.cc:2243] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.015069 19139 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:21:00.015652 25446 raft_consensus.cc:2272] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.011699 25382 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:21:00.017253 19714 leader_election.cc:304] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:21:00.019055 25415 raft_consensus.cc:2804] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:21:00.020282 25410 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:00.028672 25343 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:00.030238 19070 raft_consensus.cc:2468] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:21:00.030735 25446 ts_tablet_manager.cc:1916] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:00.035962 19743 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:00.033459 19213 raft_consensus.cc:2955] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
W20260709 13:21:00.097195 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 48688.1us
I20260709 13:21:00.108719 18954 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7fd9d26dc9f47ba92b818f308617d95 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:00.113409 25415 raft_consensus.cc:697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:00.125550 25415 consensus_queue.cc:237] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:00.123908 18965 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 reported cstate change: config changed from index 10 to 11, VOTER 0f833abfb3544031bee566e655b7fedc (127.17.139.2) evicted. New cstate: current_term: 15 leader_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:00.147644 19130 tablet_service.cc:1558] Processing DeleteTablet for tablet e7fd9d26dc9f47ba92b818f308617d95 with delete_type TABLET_DATA_TOMBSTONED (TS 0f833abfb3544031bee566e655b7fedc not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:41872
I20260709 13:21:00.150061 25451 tablet_replica.cc:333] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:00.151201 25451 raft_consensus.cc:2243] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.152135 25451 raft_consensus.cc:2272] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.157486 25451 ts_tablet_manager.cc:1916] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:00.132505 25446 ts_tablet_manager.cc:1929] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:21:00.163698 25446 log.cc:1199] T adf40f6b88894de8b62437b0a878c787 P 55991c1f7f474a9888725d00438d8a83: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/wals/adf40f6b88894de8b62437b0a878c787
I20260709 13:21:00.165377 18957 catalog_manager.cc:5028] TS 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): tablet adf40f6b88894de8b62437b0a878c787 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:21:00.170104 18968 catalog_manager.cc:5697] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 12 to 13, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 13 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:00.244391 25451 ts_tablet_manager.cc:1929] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:21:00.245992 25451 log.cc:1199] T e7fd9d26dc9f47ba92b818f308617d95 P 0f833abfb3544031bee566e655b7fedc: Deleting WAL directory at /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/wals/e7fd9d26dc9f47ba92b818f308617d95
I20260709 13:21:00.247833 18954 catalog_manager.cc:5028] TS 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): tablet e7fd9d26dc9f47ba92b818f308617d95 (table test-workload [id=1512a5acf3aa44cc9b172deb1ca97d10]) successfully deleted
I20260709 13:21:00.765194 19139 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:21:00.785486 25449 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:00.822779 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 43727.5us
I20260709 13:21:00.954152 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:00.962479 19071 raft_consensus.cc:1275] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:21:00.982673 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 55225.1us
I20260709 13:21:01.091405 25447 consensus_queue.cc:1048] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:01.363932 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 89310.2us
I20260709 13:21:01.378487 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
W20260709 13:21:01.417608 19110 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:01.456604 19714 consensus_peers.cc:597] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.474319 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 56747.2us
I20260709 13:21:01.485069 19219 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
W20260709 13:21:01.503918 19110 consensus_peers.cc:597] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.513685 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.513908 19110 consensus_peers.cc:597] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.519405 19145 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:21:01.522324 19110 consensus_peers.cc:597] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.522975 19110 consensus_peers.cc:597] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.523535 19110 consensus_peers.cc:597] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.524080 19110 consensus_peers.cc:597] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.524586 19110 consensus_peers.cc:597] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.525166 25347 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:21:01.529228 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21c9cfe67c8c483e9edc1da47107fd2f. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.530970 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.531665 19110 consensus_peers.cc:597] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.532750 19110 consensus_peers.cc:597] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.533344 19110 consensus_peers.cc:597] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.539438 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.540434 19110 consensus_peers.cc:597] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.560829 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.563525 25347 raft_consensus.cc:2955] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:21:01.570330 19143 raft_consensus.cc:2955] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
W20260709 13:21:01.590811 19184 consensus_peers.cc:597] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.599292 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.614758 18965 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:21:01.618791 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:01.620205 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.621968 17964 tablet_replica.cc:333] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.625128 19143 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:21:01.625771 17964 raft_consensus.cc:2243] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:01.631166 19110 consensus_peers.cc:597] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.631421 17964 raft_consensus.cc:2272] T ef2bd04462cb41488ea5d3a18b899972 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.635468 17964 tablet_replica.cc:333] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
W20260709 13:21:01.641968 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.636642 17964 raft_consensus.cc:2243] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.648741 17964 raft_consensus.cc:2272] T 2653a1baca71467dbf9167aede923a9c P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.652231 17964 tablet_replica.cc:333] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.653724 17964 raft_consensus.cc:2243] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.655315 17964 raft_consensus.cc:2272] T 736ce293ef884a9d97ae4efb914752f6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.655416 19714 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.659301 19714 consensus_peers.cc:597] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.665846 17964 tablet_replica.cc:333] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.667331 17964 raft_consensus.cc:2243] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.668660 17964 raft_consensus.cc:2272] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.678970 17964 tablet_replica.cc:333] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
W20260709 13:21:01.683461 19110 consensus_peers.cc:597] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc -> Peer 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525): Couldn't send request to peer 508ee2e0531b43d7a1c05f950644ae66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e77b4d72a0734e868e23b83a18a0f6a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.683758 17964 raft_consensus.cc:2243] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:21:01.685061 19184 consensus_peers.cc:597] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.685973 17964 raft_consensus.cc:2272] T 41fc665fafb64d08b393d9c8a77d2608 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.686992 19217 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:01.690327 25437 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:01.691495 17964 tablet_replica.cc:333] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
W20260709 13:21:01.694411 19110 consensus_peers.cc:597] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.713683 17964 raft_consensus.cc:2243] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.714938 17964 raft_consensus.cc:2272] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.717361 25462 raft_consensus.cc:2955] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:21:01.718923 19217 raft_consensus.cc:2955] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } } }
I20260709 13:21:01.735546 17964 tablet_replica.cc:333] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.736307 17964 raft_consensus.cc:2243] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.741892 17964 raft_consensus.cc:2272] T d7347527d150466586ce647078eff8bb P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.753099 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.753798 19714 consensus_peers.cc:597] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.756222 17964 tablet_replica.cc:333] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.757236 17964 raft_consensus.cc:2243] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.758781 17964 raft_consensus.cc:2272] T e7fd9d26dc9f47ba92b818f308617d95 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.770430 17964 tablet_replica.cc:333] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.771332 17964 raft_consensus.cc:2243] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.774192 17964 raft_consensus.cc:2272] T 75fa1003f49c4855bf92d61c4fc4e4ed P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.777280 18965 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc reported cstate change: config changed from index -1 to 11, NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) added. New cstate: current_term: 15 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:01.780033 19110 consensus_peers.cc:597] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.780555 17964 tablet_replica.cc:333] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.789753 17964 raft_consensus.cc:2243] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.790966 17964 raft_consensus.cc:2272] T c405ec9a50f54a4fa80ed27adf421c09 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.794050 17964 tablet_replica.cc:333] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.797417 17964 raft_consensus.cc:2243] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.798305 17964 raft_consensus.cc:2272] T 79274c20a7fb4e3dbf6355e5d4a28751 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.819288 17964 tablet_replica.cc:333] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.820125 17964 raft_consensus.cc:2243] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.820740 17964 raft_consensus.cc:2272] T e77b4d72a0734e868e23b83a18a0f6a8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.823551 17964 tablet_replica.cc:333] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
W20260709 13:21:01.824142 19714 consensus_peers.cc:597] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.824474 17964 raft_consensus.cc:2243] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.828028 17964 raft_consensus.cc:2272] T 6a9f9257bc714987a2bba35964a315cf P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.835486 17964 tablet_replica.cc:333] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.836380 17964 raft_consensus.cc:2243] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.837148 17964 raft_consensus.cc:2272] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.843107 17964 tablet_replica.cc:333] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.843963 17964 raft_consensus.cc:2243] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.849107 17964 raft_consensus.cc:2272] T 13256a1f86494f9f812c2c4162cec4f7 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.852507 17964 tablet_replica.cc:333] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.853385 17964 raft_consensus.cc:2243] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.855648 17964 raft_consensus.cc:2272] T c875508da24d49ae8496600c3e674b63 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.858485 17964 tablet_replica.cc:333] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.863117 17964 raft_consensus.cc:2243] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.863819 17964 raft_consensus.cc:2272] T debddc2dd9264017aeda9f1cad516f83 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.874030 17964 tablet_replica.cc:333] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.874909 17964 raft_consensus.cc:2243] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.886776 17964 raft_consensus.cc:2272] T 49d828ebf4a6479ca74fbb76d8536b5a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.889575 17964 tablet_replica.cc:333] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.890470 17964 raft_consensus.cc:2243] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.891858 17964 raft_consensus.cc:2272] T adf40f6b88894de8b62437b0a878c787 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.894826 17964 tablet_replica.cc:333] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.897541 17964 raft_consensus.cc:2243] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.899304 17964 raft_consensus.cc:2272] T 21c9cfe67c8c483e9edc1da47107fd2f P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.914965 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.924569 17964 tablet_replica.cc:333] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.925565 17964 raft_consensus.cc:2243] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.926196 17964 raft_consensus.cc:2272] T 7af214f1f7324aef8b59a1b91a41d317 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.929687 17964 tablet_replica.cc:333] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.935177 17964 raft_consensus.cc:2243] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.936949 17964 raft_consensus.cc:2272] T 701310a5195343c081bea195df509e65 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.939805 17964 tablet_replica.cc:333] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.947650 17964 raft_consensus.cc:2243] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.948222 17964 raft_consensus.cc:2272] T c1b84fdcb260415b9e65e72540fe1841 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.963089 19714 consensus_peers.cc:597] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.968323 17964 tablet_replica.cc:333] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.971540 17964 raft_consensus.cc:2243] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.972208 17964 raft_consensus.cc:2272] T c284b8edf0ca4032aeac36d9cbcb9925 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.986464 17964 tablet_replica.cc:333] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:01.988814 17964 raft_consensus.cc:2243] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.990855 17964 raft_consensus.cc:2272] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.995311 17964 tablet_replica.cc:333] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.007771 17964 raft_consensus.cc:2243] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.028721 25382 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:02.029386 25382 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:02.032912 25382 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:02.032836 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:02.034659 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5c24584b054af68fe8fe327bad2e5b" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:02.038643 19038 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:21:02.040433 25457 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:02.083484 25483 ts_tablet_manager.cc:933] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:02.129598 25484 ts_tablet_manager.cc:933] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: Initiating tablet copy from peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:02.131608 25483 tablet_copy_client.cc:323] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.3:39345
I20260709 13:21:02.136940 19230 tablet_copy_service.cc:140] P 55991c1f7f474a9888725d00438d8a83: Received BeginTabletCopySession request for tablet 21c9cfe67c8c483e9edc1da47107fd2f from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:42382)
I20260709 13:21:02.137665 19230 tablet_copy_service.cc:161] P 55991c1f7f474a9888725d00438d8a83: Beginning new tablet copy session on tablet 21c9cfe67c8c483e9edc1da47107fd2f from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:42382: session id = 508ee2e0531b43d7a1c05f950644ae66-21c9cfe67c8c483e9edc1da47107fd2f
I20260709 13:21:02.150111 19230 tablet_copy_source_session.cc:215] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:02.153721 25484 tablet_copy_client.cc:323] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Beginning tablet copy session from remote peer at address 127.17.139.2:40307
I20260709 13:21:02.155021 25483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c9cfe67c8c483e9edc1da47107fd2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.155915 19156 tablet_copy_service.cc:140] P 0f833abfb3544031bee566e655b7fedc: Received BeginTabletCopySession request for tablet e77b4d72a0734e868e23b83a18a0f6a8 from peer 508ee2e0531b43d7a1c05f950644ae66 ({username='slave'} at 127.0.0.1:33244)
I20260709 13:21:02.156280 25457 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:02.156489 19156 tablet_copy_service.cc:161] P 0f833abfb3544031bee566e655b7fedc: Beginning new tablet copy session on tablet e77b4d72a0734e868e23b83a18a0f6a8 from peer 508ee2e0531b43d7a1c05f950644ae66 at {username='slave'} at 127.0.0.1:33244: session id = 508ee2e0531b43d7a1c05f950644ae66-e77b4d72a0734e868e23b83a18a0f6a8
I20260709 13:21:02.156899 25457 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:02.157745 17964 raft_consensus.cc:2272] T ddcb71ca04ee449ba3db37be4900a2cd P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.159590 25457 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:02.160631 17964 tablet_replica.cc:333] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.161638 17964 raft_consensus.cc:2243] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.162227 17964 raft_consensus.cc:2272] T 33ef0d891f7b462bafaf9441fbf19e37 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.164172 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:02.164780 17964 tablet_replica.cc:333] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.165401 19156 tablet_copy_source_session.cc:215] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:02.165639 17964 raft_consensus.cc:2243] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:02.168227 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66a9130f4c8e4d5a9ad02554fc4c7a28" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:02.168941 25484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77b4d72a0734e868e23b83a18a0f6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.175666 17964 raft_consensus.cc:2272] T 61d460e2151b412d8e1e8208d00679bc P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.178812 17964 tablet_replica.cc:333] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.179668 17964 raft_consensus.cc:2243] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:02.180835 17964 raft_consensus.cc:2272] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.192044 17964 tablet_replica.cc:333] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.194466 17964 raft_consensus.cc:2243] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:02.200374 19035 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:21:02.211628 25457 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:02.212942 25484 tablet_copy_client.cc:806] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:02.213593 25484 tablet_copy_client.cc:670] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:02.221176 17964 raft_consensus.cc:2272] T 228b0a2048a3451cbfd947fa97eb2d8e P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.226249 25483 tablet_copy_client.cc:806] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:02.230690 25484 tablet_copy_client.cc:538] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:02.230908 17964 tablet_replica.cc:333] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.242270 25483 tablet_copy_client.cc:670] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:02.242865 17964 raft_consensus.cc:2243] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.243883 17964 raft_consensus.cc:2272] T 409c2d9a573f4e408b732ebafda96921 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.245244 25382 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:02.245719 25382 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:02.247714 25483 tablet_copy_client.cc:538] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:02.247839 25382 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:02.249388 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:02.254029 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d0433fa5eeb4f7b83f2fbd60b78b0f4" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:02.256347 19035 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:21:02.257402 25382 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:02.258989 17964 tablet_replica.cc:333] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.273957 17964 raft_consensus.cc:2243] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.275552 17964 raft_consensus.cc:2272] T 8433d8c678614c00ad69faf57a9363de P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.278796 17964 tablet_replica.cc:333] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.279440 25483 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:21:02.279644 17964 raft_consensus.cc:2243] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:02.300725 17964 raft_consensus.cc:2272] T 5f6c3fb3159248429932b08d8bc9f222 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.303679 17964 tablet_replica.cc:333] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.304438 17964 raft_consensus.cc:2243] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.305109 17964 raft_consensus.cc:2272] T 941387979c524e4c8b05785609c3d3c4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.308185 17964 tablet_replica.cc:333] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.309042 17964 raft_consensus.cc:2243] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.317462 17964 raft_consensus.cc:2272] T d57ee419ffa74c87b2c5eb26b930d9ef P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.264981 25484 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap starting.
I20260709 13:21:02.327587 17964 tablet_replica.cc:333] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.339066 25382 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:02.339742 25382 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:02.341192 17964 raft_consensus.cc:2243] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.341743 25382 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:02.341977 17964 raft_consensus.cc:2272] T 14973b885f3f4ff1833ff0e215658aa9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.344187 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:02.344736 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716382b8056843a8ac2701a2242b5834" candidate_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:02.347052 19035 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7cac62c1d5aa4356b70f6517fe0ba5d6; no voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:21:02.350562 25382 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:21:02.344753 17964 tablet_replica.cc:333] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.352847 17964 raft_consensus.cc:2243] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.355300 17964 raft_consensus.cc:2272] T 716382b8056843a8ac2701a2242b5834 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.358457 17964 tablet_replica.cc:333] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.367136 17964 raft_consensus.cc:2243] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:02.376396 17964 raft_consensus.cc:2272] T d52b625596354c7f9589dc83d8b49ce5 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.379549 17964 tablet_replica.cc:333] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.380427 17964 raft_consensus.cc:2243] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.386256 17964 raft_consensus.cc:2272] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.389328 17964 tablet_replica.cc:333] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.394193 17964 raft_consensus.cc:2243] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.395045 17964 raft_consensus.cc:2272] T 28952387f86d4e5892a88c9c3e0173c8 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.398043 17964 tablet_replica.cc:333] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.409509 17964 raft_consensus.cc:2243] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:02.410735 17964 raft_consensus.cc:2272] T 66ce6ec243d4436da3c96c55bba7244a P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.413856 17964 tablet_replica.cc:333] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.414597 17964 raft_consensus.cc:2243] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.415202 17964 raft_consensus.cc:2272] T 3627cae163084c338404a5153ef0efb9 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.421196 25484 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:02.422434 25484 tablet_bootstrap.cc:492] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:21:02.418272 17964 tablet_replica.cc:333] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.423353 17964 raft_consensus.cc:2243] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.424492 17964 raft_consensus.cc:2272] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.437572 25484 ts_tablet_manager.cc:1403] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.173s	user 0.031s	sys 0.016s
I20260709 13:21:02.442301 25484 raft_consensus.cc:359] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:21:02.438732 17964 tablet_replica.cc:333] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.450098 17964 raft_consensus.cc:2243] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:02.450827 17964 raft_consensus.cc:2272] T 4a5c24584b054af68fe8fe327bad2e5b P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.454141 17964 tablet_replica.cc:333] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6: stopping tablet replica
I20260709 13:21:02.458647 17964 raft_consensus.cc:2243] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:02.459769 17964 raft_consensus.cc:2272] T 2d1b18b0ec57435da3325e677d1b8741 P 7cac62c1d5aa4356b70f6517fe0ba5d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:02.457803 25484 raft_consensus.cc:740] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:21:02.462670 25484 consensus_queue.cc:260] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:21:02.465987 25484 ts_tablet_manager.cc:1434] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:21:02.467731 19156 tablet_copy_service.cc:342] P 0f833abfb3544031bee566e655b7fedc: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-e77b4d72a0734e868e23b83a18a0f6a8 received from {username='slave'} at 127.0.0.1:33244
I20260709 13:21:02.468199 19156 tablet_copy_service.cc:434] P 0f833abfb3544031bee566e655b7fedc: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-e77b4d72a0734e868e23b83a18a0f6a8 on tablet e77b4d72a0734e868e23b83a18a0f6a8 with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:21:02.477967 25483 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:02.480363 25483 tablet_bootstrap.cc:492] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: Bootstrap complete.
I20260709 13:21:02.484678 25483 ts_tablet_manager.cc:1403] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: Time spent bootstrapping tablet: real 0.205s	user 0.039s	sys 0.013s
I20260709 13:21:02.492785 25483 raft_consensus.cc:359] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:21:02.497531 25483 raft_consensus.cc:740] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Initialized, Role: LEARNER
I20260709 13:21:02.498312 25483 consensus_queue.cc:260] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: NON_VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: true } }
I20260709 13:21:02.514950 25483 ts_tablet_manager.cc:1434] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:21:02.521426 19230 tablet_copy_service.cc:342] P 55991c1f7f474a9888725d00438d8a83: Request end of tablet copy session 508ee2e0531b43d7a1c05f950644ae66-21c9cfe67c8c483e9edc1da47107fd2f received from {username='slave'} at 127.0.0.1:42382
I20260709 13:21:02.521934 19230 tablet_copy_service.cc:434] P 55991c1f7f474a9888725d00438d8a83: ending tablet copy session 508ee2e0531b43d7a1c05f950644ae66-21c9cfe67c8c483e9edc1da47107fd2f on tablet 21c9cfe67c8c483e9edc1da47107fd2f with peer 508ee2e0531b43d7a1c05f950644ae66
I20260709 13:21:02.617606 19750 raft_consensus.cc:1217] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:21:02.634217 19750 raft_consensus.cc:1217] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
W20260709 13:21:02.683280 19184 connection.cc:769] client connection to 127.17.139.1:33919 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:21:02.776760 25455 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:02.777398 25455 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:02.788280 19714 leader_election.cc:336] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:02.790251 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:02.792692 19717 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:02.795236 25447 raft_consensus.cc:2749] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:21:02.797324 25462 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:02.797899 25462 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:02.806072 25462 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:02.808406 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:02.809572 25417 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:02.810160 25417 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:02.812280 25417 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:02.817919 25449 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:02.818583 25449 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:02.821873 25449 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:02.823554 19184 leader_election.cc:336] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:02.836035 19714 leader_election.cc:336] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:02.816154 25455 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:02.838802 19110 leader_election.cc:336] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:02.840076 19110 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:02.843139 25462 raft_consensus.cc:2749] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:02.855464 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 62868.6us
I20260709 13:21:02.859375 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:02.873302 25449 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:02.874027 25449 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:02.876955 25449 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:02.880549 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:21:02.882055 19714 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:02.883756 19714 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:02.884835 25449 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:02.890298 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:02.893458 19184 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:02.894608 25417 raft_consensus.cc:2749] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:21:02.896170 19717 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:02.897300 25494 raft_consensus.cc:2749] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:02.997021 25417 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:02.997612 25417 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.000447 25417 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.007133 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.007855 19750 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 11.
W20260709 13:21:03.010926 19184 leader_election.cc:336] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.012089 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.013497 25421 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:21:03.013868 25421 raft_consensus.cc:493] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.014227 25421 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:21:03.018749 25494 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.019325 25494 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.021528 25494 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.028559 25462 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:21:03.029034 19714 leader_election.cc:336] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.029193 25462 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.035094 25462 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.036475 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.039791 25463 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.040300 25463 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.042683 25463 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:03.043102 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.043731 19221 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 11.
I20260709 13:21:03.051357 25421 raft_consensus.cc:515] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.052961 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:03.051048 19717 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.064640 19143 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
W20260709 13:21:03.055899 19110 leader_election.cc:336] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.065800 25494 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:21:03.066250 25494 raft_consensus.cc:493] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.066655 25494 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:21:03.055929 25463 raft_consensus.cc:1064] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:21:03.065812 19110 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.093937 25462 raft_consensus.cc:2749] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:03.090916 25463 consensus_queue.cc:237] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.108697 25347 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.109279 25347 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.111145 25347 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.128479 25462 raft_consensus.cc:1064] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: attempting to promote NON_VOTER 508ee2e0531b43d7a1c05f950644ae66 to VOTER
I20260709 13:21:03.132064 25462 consensus_queue.cc:237] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.140552 25421 leader_election.cc:290] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.143113 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.143996 25347 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:03.144381 25347 raft_consensus.cc:493] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.144718 25347 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.152858 25347 raft_consensus.cc:515] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.157730 25347 leader_election.cc:290] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:03.157946 25417 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.158732 25417 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.162266 25417 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:21:03.167788 19184 leader_election.cc:336] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.186024 25494 raft_consensus.cc:515] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.193477 19219 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:03.197438 25499 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:03.198727 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.199393 19750 raft_consensus.cc:1275] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEARNER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:21:03.200258 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f49755f447d4bfba9fb1a68e2fedfa3" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:21:03.200809 19743 raft_consensus.cc:3060] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:21:03.205557 19110 consensus_peers.cc:597] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:03.209431 25486 consensus_queue.cc:1048] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:03.213696 19743 raft_consensus.cc:2468] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 12.
I20260709 13:21:03.222494 25494 leader_election.cc:290] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.226725 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fc665fafb64d08b393d9c8a77d2608" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:21:03.229143 19143 raft_consensus.cc:3060] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.227689 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2653a1baca71467dbf9167aede923a9c" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:21:03.231812 19219 raft_consensus.cc:3060] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:21:03.242871 19139 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:21:03.244740 19143 raft_consensus.cc:2468] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 19.
I20260709 13:21:03.246570 19219 raft_consensus.cc:2468] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 12.
I20260709 13:21:03.260162 25503 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.260295 19717 leader_election.cc:304] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.260740 25503 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.262449 25495 raft_consensus.cc:2804] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:21:03.262970 25495 raft_consensus.cc:697] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:03.263024 25503 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.263979 25495 consensus_queue.cc:237] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.279906 25501 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.282305 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.284224 25498 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.284945 25501 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.285109 19744 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:21:03.285148 25498 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.315493 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.316105 19217 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
I20260709 13:21:03.316309 25498 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.287631 25463 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.310366 25486 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.319733 25486 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.321928 25486 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.321313 25462 raft_consensus.cc:2955] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:03.309036 18965 catalog_manager.cc:5697] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 11 to 12, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 12 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.323508 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.324123 19217 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:21:03.313280 19750 raft_consensus.cc:1275] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEARNER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:21:03.325501 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.326510 25467 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:21:03.326895 25467 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.327373 25467 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:21:03.318419 19714 leader_election.cc:336] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.338505 25463 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:21:03.344410 19110 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.344226 25498 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:03.347107 19184 leader_election.cc:304] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.349602 25486 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.350163 25486 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.352300 25486 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.353077 25463 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:03.353854 25501 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.348812 25467 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.360273 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d6b40b78ed348b0ad0b2c0f3d648061" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:21:03.360802 19217 raft_consensus.cc:3060] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:03.367260 19217 raft_consensus.cc:2468] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:21:03.366782 19750 raft_consensus.cc:2955] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:03.368359 19113 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.369204 25486 raft_consensus.cc:2804] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:21:03.369931 25486 raft_consensus.cc:697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:21:03.371141 25486 consensus_queue.cc:237] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:21:03.376703 19714 leader_election.cc:336] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.381168 25498 raft_consensus.cc:2804] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:03.381812 25498 raft_consensus.cc:697] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 19 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:21:03.382854 25498 consensus_queue.cc:237] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.390349 19744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.393159 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.393826 19221 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 19.
I20260709 13:21:03.391045 19744 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 15.
I20260709 13:21:03.388357 25467 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.403674 19219 raft_consensus.cc:2955] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:03.405285 19751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.405896 19751 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 19.
I20260709 13:21:03.409919 19184 leader_election.cc:304] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.410063 19717 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.411849 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.417529 25503 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:03.417971 25503 raft_consensus.cc:493] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.418318 25503 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.425534 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:03.426215 19139 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
W20260709 13:21:03.413053 19110 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.413990 19714 leader_election.cc:336] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.440763 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.449884 25467 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:03.450407 25467 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.444037 25463 raft_consensus.cc:2804] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:21:03.444202 25494 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:03.461160 25463 raft_consensus.cc:697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:21:03.462117 25463 consensus_queue.cc:237] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.458288 25494 raft_consensus.cc:493] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.476308 25494 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:03.457679 25467 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:03.482098 19110 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.496608 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 55470.7us
W20260709 13:21:03.494618 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 57492us
I20260709 13:21:03.512338 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.515758 25509 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.518066 25509 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.520766 25509 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.523272 25509 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.523810 25509 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.525636 25509 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.537626 25421 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:21:03.550696 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 98151.8us
I20260709 13:21:03.561998 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.562613 19750 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 18.
I20260709 13:21:03.563766 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.552206 25421 raft_consensus.cc:493] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.568657 25421 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.573083 25512 consensus_queue.cc:1048] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:21:03.579622 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 
I20260709 13:21:03.581020 25516 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:03.581415 25516 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.581746 25516 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.582751 25421 raft_consensus.cc:515] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.584784 25421 leader_election.cc:290] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.592720 25509 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.593287 25509 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.595558 25509 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.597777 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.598425 19217 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 12.
I20260709 13:21:03.599593 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.601269 25517 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:21:03.601696 25517 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.602032 25517 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:21:03.605072 25518 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.605607 25518 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:03.607115 19110 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.607685 25518 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:03.607851 19110 leader_election.cc:336] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.608289 19110 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.609853 25508 raft_consensus.cc:2749] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:03.610965 25467 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.614148 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
W20260709 13:21:03.615293 19714 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.620971 25503 raft_consensus.cc:515] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.623152 25503 leader_election.cc:290] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.624236 25494 raft_consensus.cc:515] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.625420 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9f9257bc714987a2bba35964a315cf" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:21:03.625965 19217 raft_consensus.cc:3060] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.626370 25494 leader_election.cc:290] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.628279 18968 catalog_manager.cc:5697] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 12 to 13, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 13 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:03.630416 19714 leader_election.cc:336] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.633173 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 94239.6us
W20260709 13:21:03.634441 19110 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.635041 19110 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.638093 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c405ec9a50f54a4fa80ed27adf421c09" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:21:03.638670 19219 raft_consensus.cc:3060] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:03.634855 19184 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.634456 19217 raft_consensus.cc:2468] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 18.
W20260709 13:21:03.634485 19714 leader_election.cc:336] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.644076 19717 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.645069 19219 raft_consensus.cc:2468] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 20.
I20260709 13:21:03.647112 19717 leader_election.cc:304] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.645860 25463 raft_consensus.cc:2764] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:21:03.656670 25517 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.646829 25501 raft_consensus.cc:2804] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:03.658161 25501 raft_consensus.cc:697] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:03.659122 25501 consensus_queue.cc:237] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.649837 25467 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.658329 18965 catalog_manager.cc:5697] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:03.662869 25494 raft_consensus.cc:2804] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:21:03.650997 19184 leader_election.cc:336] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.663571 19184 leader_election.cc:304] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.663699 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf40f6b88894de8b62437b0a878c787" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:21:03.664397 19750 raft_consensus.cc:3060] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.653134 25516 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.665839 25494 raft_consensus.cc:697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:03.667870 19138 raft_consensus.cc:2393] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508ee2e0531b43d7a1c05f950644ae66 in current term 19: Already voted for candidate 0f833abfb3544031bee566e655b7fedc in this term.
I20260709 13:21:03.666031 25463 raft_consensus.cc:2749] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:03.668988 25517 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.670082 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228b0a2048a3451cbfd947fa97eb2d8e" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:21:03.670609 19219 raft_consensus.cc:3060] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:21:03.667116 19184 leader_election.cc:336] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.672152 19184 leader_election.cc:336] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.672979 19184 leader_election.cc:336] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.673511 25518 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.674024 25518 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:03.655514 19110 consensus_peers.cc:597] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.668223 25516 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:21:03.677541 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:03.679509 19219 raft_consensus.cc:2468] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 13.
I20260709 13:21:03.680702 19113 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.682356 25518 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:03.685175 25516 raft_consensus.cc:2804] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:21:03.685767 25516 raft_consensus.cc:697] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:21:03.686618 25516 consensus_queue.cc:237] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.694433 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b625596354c7f9589dc83d8b49ce5" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:21:03.695022 19743 raft_consensus.cc:3060] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.698076 19746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fd9d26dc9f47ba92b818f308617d95" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:21:03.698657 19746 raft_consensus.cc:3060] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.703433 18967 catalog_manager.cc:5697] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 18 to 19, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 19 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.706017 19743 raft_consensus.cc:2468] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 19.
I20260709 13:21:03.706861 19746 raft_consensus.cc:2468] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 16.
I20260709 13:21:03.685076 25494 consensus_queue.cc:237] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.722728 25498 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
W20260709 13:21:03.720582 19110 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.717962 25518 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.718254 25513 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.716836 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.718796 19714 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.723313 25498 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.721117 25517 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.725119 19750 raft_consensus.cc:2468] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f833abfb3544031bee566e655b7fedc in term 16.
W20260709 13:21:03.727103 19110 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.728297 25508 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.728767 25508 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.730715 25508 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.732939 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:03.733497 19110 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.734858 25508 raft_consensus.cc:2804] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:21:03.735289 19110 consensus_peers.cc:597] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.735723 25508 raft_consensus.cc:697] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 19 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:21:03.736722 25508 consensus_queue.cc:237] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.737679 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.724217 25518 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.743655 25513 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.726300 25455 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:03.745361 25421 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:03.754383 25421 raft_consensus.cc:493] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.754789 25421 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:03.735743 19110 consensus_peers.cc:597] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.737699 18968 catalog_manager.cc:5697] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 11 to 12, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 12 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.763685 25513 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.765304 25518 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:03.766865 19714 leader_election.cc:336] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.767545 25421 raft_consensus.cc:515] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.769307 25421 leader_election.cc:290] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:03.769712 25498 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:03.780822 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:03.781497 19219 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:21:03.782923 25498 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.752671 25517 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.789762 19110 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.785306 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.783414 18965 catalog_manager.cc:5697] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 12 to 13, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 13 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.797585 19143 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 13.
I20260709 13:21:03.783480 25498 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:03.802641 25498 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:03.804234 19714 leader_election.cc:336] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.805009 19714 leader_election.cc:336] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.795456 25513 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:03.813221 25513 raft_consensus.cc:493] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.813645 25513 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.796535 25462 raft_consensus.cc:2804] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:03.818678 25462 raft_consensus.cc:697] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Becoming Leader. State: Replica: 0f833abfb3544031bee566e655b7fedc, State: Running, Role: LEADER
I20260709 13:21:03.819577 25462 consensus_queue.cc:237] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:03.828421 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 74679.8us
I20260709 13:21:03.830158 25517 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:21:03.836102 19184 leader_election.cc:336] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.836798 19184 leader_election.cc:336] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.841745 25513 raft_consensus.cc:515] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.844169 19217 raft_consensus.cc:1275] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:21:03.845747 25503 consensus_queue.cc:1048] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:21:03.850404 19714 leader_election.cc:336] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.852095 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.855026 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:03.855648 19143 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:21:03.856897 25503 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:21:03.857345 25503 raft_consensus.cc:493] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.857723 25503 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:21:03.865276 19110 leader_election.cc:336] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.866099 19110 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.878742 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d828ebf4a6479ca74fbb76d8536b5a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:21:03.879410 19145 raft_consensus.cc:3060] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:03.886464 19110 consensus_peers.cc:597] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.882534 18968 catalog_manager.cc:5697] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 17 to 18, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 18 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.891211 19750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "0f833abfb3544031bee566e655b7fedc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.892189 19138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc" is_pre_election: true
I20260709 13:21:03.891775 18968 catalog_manager.cc:5697] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 19 to 20, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 20 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:03.894773 19749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:03.895607 19749 raft_consensus.cc:2393] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 55991c1f7f474a9888725d00438d8a83 in current term 16: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:21:03.895738 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce6ec243d4436da3c96c55bba7244a" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:21:03.886351 25467 raft_consensus.cc:2749] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:03.896291 19219 raft_consensus.cc:3060] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.901053 19138 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 18.
I20260709 13:21:03.900490 18965 catalog_manager.cc:5697] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 18 to 19, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 19 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.905697 19145 raft_consensus.cc:2468] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 17.
I20260709 13:21:03.909930 19219 raft_consensus.cc:2468] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 16.
I20260709 13:21:03.906214 18965 catalog_manager.cc:5697] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc reported cstate change: term changed from 15 to 16, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 0f833abfb3544031bee566e655b7fedc (127.17.139.2). New cstate: current_term: 16 leader_uuid: "0f833abfb3544031bee566e655b7fedc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.921404 19717 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:03.894418 25513 leader_election.cc:290] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:03.920037 19184 leader_election.cc:304] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:03.932592 25498 raft_consensus.cc:2955] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:03.934623 25525 raft_consensus.cc:2804] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:03.935173 25525 raft_consensus.cc:697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:21:03.936246 25525 consensus_queue.cc:237] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:03.945528 19714 consensus_peers.cc:597] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:03.948982 19714 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:21:03.951735 19110 consensus_peers.cc:597] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:03.952502 19110 consensus_peers.cc:597] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.947863 25513 raft_consensus.cc:2804] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:03.953972 25494 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:03.954383 25513 raft_consensus.cc:697] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:03.955358 25513 consensus_queue.cc:237] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.954419 25494 raft_consensus.cc:493] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:03.958353 25494 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:03.931062 25503 raft_consensus.cc:515] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:03.959267 19750 raft_consensus.cc:2393] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f833abfb3544031bee566e655b7fedc in current term 14: Already voted for candidate 508ee2e0531b43d7a1c05f950644ae66 in this term.
I20260709 13:21:03.961730 25503 leader_election.cc:290] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:03.972695 19138 raft_consensus.cc:1275] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:21:03.974399 19714 leader_election.cc:336] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:03.975299 19750 raft_consensus.cc:2955] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:03.979127 19217 raft_consensus.cc:1275] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:21:03.980618 25467 consensus_queue.cc:1048] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:03.989442 19143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1b18b0ec57435da3325e677d1b8741" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:21:03.990016 19143 raft_consensus.cc:3060] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:21:03.991456 19110 leader_election.cc:336] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:03.995906 19110 consensus_peers.cc:597] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:03.996317 19110 consensus_peers.cc:597] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:03.988209 19139 raft_consensus.cc:2955] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } } }
I20260709 13:21:03.997747 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:04.002043 19110 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:04.003189 25347 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:04.003556 25347 raft_consensus.cc:493] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7cac62c1d5aa4356b70f6517fe0ba5d6)
I20260709 13:21:04.004006 25347 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:04.003407 19184 leader_election.cc:304] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:04.008179 25421 raft_consensus.cc:2804] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:04.008642 25421 raft_consensus.cc:697] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:21:04.009536 25512 consensus_queue.cc:1048] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:04.009451 25421 consensus_queue.cc:237] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:21:04.014386 19184 leader_election.cc:336] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:04.015080 19184 leader_election.cc:336] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:04.015499 19184 leader_election.cc:304] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 508ee2e0531b43d7a1c05f950644ae66, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:04.017773 25525 raft_consensus.cc:2749] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:04.018504 19184 leader_election.cc:336] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:04.020040 19184 leader_election.cc:336] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:04.059970 19143 raft_consensus.cc:2468] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 14.
I20260709 13:21:04.056972 18968 catalog_manager.cc:5697] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 15 to 16, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 16 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:04.061367 25509 raft_consensus.cc:2749] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:04.062103 18968 catalog_manager.cc:5697] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 reported cstate change: config changed from index 11 to 12, 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:04.149040 25347 raft_consensus.cc:515] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:21:04.153527 19110 consensus_peers.cc:597] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.154083 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 57939.6us
W20260709 13:21:04.154822 19110 consensus_peers.cc:597] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.155328 19110 consensus_peers.cc:597] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:04.166357 25347 leader_election.cc:290] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:04.167689 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 107792us
I20260709 13:21:04.173841 19750 raft_consensus.cc:1275] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:21:04.191210 25421 consensus_queue.cc:1048] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:21:04.219116 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 56883.6us
I20260709 13:21:04.302112 19139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c3fb3159248429932b08d8bc9f222" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:21:04.302763 19139 raft_consensus.cc:3060] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:04.304646 18967 catalog_manager.cc:5697] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 15 to 16, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 16 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:04.311043 19139 raft_consensus.cc:2468] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 19.
I20260709 13:21:04.343698 19221 raft_consensus.cc:1275] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:21:04.349362 19184 leader_election.cc:304] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:04.363569 25525 raft_consensus.cc:2804] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:04.364152 25525 raft_consensus.cc:697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 19 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:21:04.365108 25525 consensus_queue.cc:237] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:04.374294 25494 raft_consensus.cc:515] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:04.351651 25507 log.cc:927] Time spent T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:21:04.390784 25494 leader_election.cc:290] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Requested vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:04.440392 18965 catalog_manager.cc:5697] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 16 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 17 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:04.465138 19184 consensus_peers.cc:597] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.465761 19184 leader_election.cc:336] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:04.466331 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 123504us
I20260709 13:21:04.471942 19714 leader_election.cc:304] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:21:04.466943 19184 consensus_peers.cc:597] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.474682 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.489817 19221 raft_consensus.cc:1275] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:21:04.495102 25539 raft_consensus.cc:2804] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:21:04.508137 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.509102 19714 consensus_peers.cc:597] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.509599 19714 consensus_peers.cc:597] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.510051 19714 consensus_peers.cc:597] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.513063 25539 raft_consensus.cc:697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:04.514356 25539 consensus_queue.cc:237] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:04.520323 19184 consensus_peers.cc:597] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.520788 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.538637 25545 consensus_queue.cc:1048] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:21:04.567438 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.567528 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61d460e2151b412d8e1e8208d00679bc" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f833abfb3544031bee566e655b7fedc"
I20260709 13:21:04.571496 19145 raft_consensus.cc:3060] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:04.575850 19143 raft_consensus.cc:1275] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:04.607877 25520 consensus_queue.cc:1048] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:21:04.611730 19184 consensus_peers.cc:597] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.621985 19714 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.622745 19714 leader_election.cc:336] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:04.623255 19714 consensus_peers.cc:597] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.623675 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.624259 19145 raft_consensus.cc:2468] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 17.
W20260709 13:21:04.638747 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.655503 19749 raft_consensus.cc:1275] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:04.658452 25552 consensus_queue.cc:1048] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:04.660116 19217 raft_consensus.cc:1275] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:21:04.669286 19714 consensus_peers.cc:597] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.669798 19714 consensus_peers.cc:597] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.671114 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 73321.2us
W20260709 13:21:04.694012 19184 consensus_peers.cc:597] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.694547 19184 consensus_peers.cc:597] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:04.703066 19217 raft_consensus.cc:1275] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:21:04.707763 19714 consensus_peers.cc:597] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.707074 18967 catalog_manager.cc:5697] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 13 to 14, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 14 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:04.715473 19110 consensus_peers.cc:597] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.725219 19110 consensus_peers.cc:597] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:04.730225 18965 catalog_manager.cc:5697] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 18 to 19, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 19 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:04.736868 19110 consensus_peers.cc:597] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.737612 19110 consensus_peers.cc:597] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:04.757428 19110 consensus_peers.cc:597] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.763973 19714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:40307, user_credentials={real_user=slave}} blocked reactor thread for 44983us
I20260709 13:21:04.770028 19750 raft_consensus.cc:1275] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:04.769268 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
I20260709 13:21:04.782688 19750 raft_consensus.cc:1275] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Refusing update from remote peer 0f833abfb3544031bee566e655b7fedc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:04.794102 25525 consensus_queue.cc:1048] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:04.797156 19714 leader_election.cc:304] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f833abfb3544031bee566e655b7fedc, 508ee2e0531b43d7a1c05f950644ae66; no voters: 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:04.807639 25539 raft_consensus.cc:2804] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:04.808307 25539 raft_consensus.cc:697] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:04.809248 25539 consensus_queue.cc:237] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:04.827641 19714 consensus_peers.cc:597] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:04.828390 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:04.830212 25517 consensus_queue.cc:1048] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:04.831712 25544 consensus_queue.cc:1048] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:04.838320 25557 consensus_queue.cc:1048] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:04.864722 18967 catalog_manager.cc:5697] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 16 to 17, leader changed from 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 17 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:04.870334 25539 consensus_queue.cc:1048] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:04.944372 19145 raft_consensus.cc:1275] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:21:04.953923 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:05.009056 19145 raft_consensus.cc:1275] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:21:04.979687 25543 consensus_queue.cc:1048] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:21:05.053459 25552 consensus_queue.cc:1048] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:21:05.072644 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.096837 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 75290us
W20260709 13:21:05.148270 19184 consensus_peers.cc:597] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.285296 25573 log.cc:927] Time spent T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:21:05.305160 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.351562 19145 raft_consensus.cc:1275] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:21:05.381659 25557 consensus_queue.cc:1048] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:21:05.562124 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
W20260709 13:21:05.569293 19714 consensus_peers.cc:597] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.574014 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.591645 19184 consensus_peers.cc:597] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.593519 19184 consensus_peers.cc:597] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.594252 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.594775 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.626453 19714 consensus_peers.cc:597] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.684149 19184 consensus_peers.cc:597] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.739986 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.769711 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:05.771211 17964 tablet_replica.cc:333] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.772143 17964 raft_consensus.cc:2243] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:05.772830 17964 raft_consensus.cc:2272] T 3cafb40f37ca439fa093060d6ba342f0 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.774519 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.775517 19714 consensus_peers.cc:597] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.779793 19184 consensus_peers.cc:597] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.775758 17964 tablet_replica.cc:333] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.793934 17964 raft_consensus.cc:2243] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:05.794970 17964 raft_consensus.cc:2272] T 61d161ec86f94a4eaf383729c1ddbc87 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.799016 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.801255 17964 tablet_replica.cc:333] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.802281 17964 raft_consensus.cc:2243] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:05.803344 17964 raft_consensus.cc:2272] T ef2bd04462cb41488ea5d3a18b899972 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:05.806190 17964 tablet_replica.cc:333] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.807044 17964 raft_consensus.cc:2243] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:05.808125 17964 raft_consensus.cc:2272] T 75fa1003f49c4855bf92d61c4fc4e4ed P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.808947 19714 consensus_peers.cc:597] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.819084 17964 tablet_replica.cc:333] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.820168 17964 raft_consensus.cc:2243] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:05.820808 17964 raft_consensus.cc:2272] T 79274c20a7fb4e3dbf6355e5d4a28751 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:05.823773 17964 tablet_replica.cc:333] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.825397 17964 raft_consensus.cc:2243] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:05.829816 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.832012 17964 raft_consensus.cc:2272] T 41fc665fafb64d08b393d9c8a77d2608 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.840086 19110 consensus_peers.cc:597] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:05.850842 17964 tablet_replica.cc:333] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.851936 17964 raft_consensus.cc:2243] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:05.854913 17964 raft_consensus.cc:2272] T e77b4d72a0734e868e23b83a18a0f6a8 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.867971 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.878314 19184 consensus_peers.cc:597] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:05.885358 19113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 43552.2us
I20260709 13:21:05.888525 17964 tablet_replica.cc:333] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.890020 17964 raft_consensus.cc:2243] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:05.895092 19714 consensus_peers.cc:597] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.898504 17964 raft_consensus.cc:2272] T 14973b885f3f4ff1833ff0e215658aa9 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:05.909710 17964 tablet_replica.cc:333] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.910735 17964 raft_consensus.cc:2243] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:05.913154 17964 raft_consensus.cc:2272] T c1b84fdcb260415b9e65e72540fe1841 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.913620 19184 consensus_peers.cc:597] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.917351 17964 tablet_replica.cc:333] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.918773 17964 raft_consensus.cc:2243] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:05.919934 17964 raft_consensus.cc:2272] T c284b8edf0ca4032aeac36d9cbcb9925 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.926977 19184 consensus_peers.cc:597] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.927598 17964 tablet_replica.cc:333] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:05.928576 17964 raft_consensus.cc:2243] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:05.929474 17964 raft_consensus.cc:2272] T c3bb7a633516455782a998ee89832b55 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:05.962831 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.982633 17964 tablet_replica.cc:333] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
W20260709 13:21:05.992401 19714 consensus_peers.cc:597] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:05.992718 17964 raft_consensus.cc:2243] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:05.995891 17964 raft_consensus.cc:2272] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:05.998736 17964 tablet_replica.cc:333] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.005009 17964 raft_consensus.cc:2243] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.006173 17964 raft_consensus.cc:2272] T debddc2dd9264017aeda9f1cad516f83 P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.016219 17964 tablet_replica.cc:333] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.017140 17964 raft_consensus.cc:2243] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.023955 17964 raft_consensus.cc:2272] T 263ce615af6646ada8e5f6d61d990dee P 0f833abfb3544031bee566e655b7fedc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.029718 17964 tablet_replica.cc:333] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
W20260709 13:21:06.039963 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.046157 19184 consensus_peers.cc:597] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:06.046814 19184 consensus_peers.cc:597] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:06.047861 17964 raft_consensus.cc:2243] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.049029 17964 raft_consensus.cc:2272] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.054149 17964 tablet_replica.cc:333] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.054989 17964 raft_consensus.cc:2243] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.056059 17964 raft_consensus.cc:2272] T c875508da24d49ae8496600c3e674b63 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.063385 17964 tablet_replica.cc:333] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.064229 17964 raft_consensus.cc:2243] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.065066 17964 raft_consensus.cc:2272] T c1b4ebbb026847c7a47a03402902ca2a P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:06.073648 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:06.093420 17964 tablet_replica.cc:333] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.094376 17964 raft_consensus.cc:2243] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.095491 17964 raft_consensus.cc:2272] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.098136 17964 tablet_replica.cc:333] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.107260 17964 raft_consensus.cc:2243] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.108346 17964 raft_consensus.cc:2272] T 1e32daa1d5e3443eaaf7b1e03100b270 P 0f833abfb3544031bee566e655b7fedc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.111079 17964 tablet_replica.cc:333] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.111898 17964 raft_consensus.cc:2243] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.119243 17964 raft_consensus.cc:2272] T 7af214f1f7324aef8b59a1b91a41d317 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.121996 17964 tablet_replica.cc:333] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.126825 17964 raft_consensus.cc:2243] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.127610 17964 raft_consensus.cc:2272] T 701310a5195343c081bea195df509e65 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:06.134032 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:06.134084 17964 tablet_replica.cc:333] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.135465 17964 raft_consensus.cc:2243] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.136180 17964 raft_consensus.cc:2272] T 7e7ecd70203b43ca9b21a47be75683e4 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.138970 17964 tablet_replica.cc:333] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.142483 17964 raft_consensus.cc:2243] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.143414 17964 raft_consensus.cc:2272] T af41c4af8a294a729613e88856c064ac P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.147763 17964 tablet_replica.cc:333] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.148589 17964 raft_consensus.cc:2243] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.149183 17964 raft_consensus.cc:2272] T 49d828ebf4a6479ca74fbb76d8536b5a P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.151870 17964 tablet_replica.cc:333] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.152684 17964 raft_consensus.cc:2243] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.153813 17964 raft_consensus.cc:2272] T adf40f6b88894de8b62437b0a878c787 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.180320 17964 tablet_replica.cc:333] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.181324 17964 raft_consensus.cc:2243] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.182156 17964 raft_consensus.cc:2272] T 21c9cfe67c8c483e9edc1da47107fd2f P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.188701 17964 tablet_replica.cc:333] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.201077 17964 raft_consensus.cc:2243] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.218963 17964 raft_consensus.cc:2272] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.224021 17964 tablet_replica.cc:333] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.231146 17964 raft_consensus.cc:2243] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.241355 17964 raft_consensus.cc:2272] T 3846ceb53ab145bfa0ae536aa51f05d0 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.244663 17964 tablet_replica.cc:333] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.246397 17964 raft_consensus.cc:2243] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.247047 17964 raft_consensus.cc:2272] T 3627cae163084c338404a5153ef0efb9 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.259341 17964 tablet_replica.cc:333] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.260139 17964 raft_consensus.cc:2243] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.262074 17964 raft_consensus.cc:2272] T 228b0a2048a3451cbfd947fa97eb2d8e P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.264565 17964 tablet_replica.cc:333] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.265388 17964 raft_consensus.cc:2243] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.265969 17964 raft_consensus.cc:2272] T 6e9eca38a1164c2293be5a949d3526b3 P 0f833abfb3544031bee566e655b7fedc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.268411 17964 tablet_replica.cc:333] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.277444 17964 raft_consensus.cc:2243] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.278481 17964 raft_consensus.cc:2272] T 90cdd87d3b9846a1a1863432e72d2d75 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.281217 17964 tablet_replica.cc:333] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.281982 17964 raft_consensus.cc:2243] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.282603 17964 raft_consensus.cc:2272] T ddcb71ca04ee449ba3db37be4900a2cd P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.289304 17964 tablet_replica.cc:333] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.290107 17964 raft_consensus.cc:2243] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.291909 17964 raft_consensus.cc:2272] T 61d460e2151b412d8e1e8208d00679bc P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.303576 17964 tablet_replica.cc:333] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.306321 17964 raft_consensus.cc:2243] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.307442 17964 raft_consensus.cc:2272] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 0f833abfb3544031bee566e655b7fedc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.310227 17964 tablet_replica.cc:333] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.313079 17964 raft_consensus.cc:2243] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.321727 17964 raft_consensus.cc:2272] T d7347527d150466586ce647078eff8bb P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.347244 17964 tablet_replica.cc:333] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.347990 17964 raft_consensus.cc:2243] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.358392 17964 raft_consensus.cc:2272] T b07ef65c060943509b105c2f74e22ff5 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.365516 17964 tablet_replica.cc:333] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.371519 17964 raft_consensus.cc:2243] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.372542 17964 raft_consensus.cc:2272] T 716382b8056843a8ac2701a2242b5834 P 0f833abfb3544031bee566e655b7fedc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.381794 17964 tablet_replica.cc:333] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.382599 17964 raft_consensus.cc:2243] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.384038 17964 raft_consensus.cc:2272] T d52b625596354c7f9589dc83d8b49ce5 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.387251 17964 tablet_replica.cc:333] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.387799 17964 raft_consensus.cc:2243] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.388645 17964 raft_consensus.cc:2272] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 0f833abfb3544031bee566e655b7fedc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.391086 17964 tablet_replica.cc:333] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.405418 17964 raft_consensus.cc:2243] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.406105 17964 raft_consensus.cc:2272] T ec63bca0af2942e1b88ac12d090c139c P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.408478 17964 tablet_replica.cc:333] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.409188 17964 raft_consensus.cc:2243] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:06.410265 17964 raft_consensus.cc:2272] T 4a5c24584b054af68fe8fe327bad2e5b P 0f833abfb3544031bee566e655b7fedc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.412571 17964 tablet_replica.cc:333] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.413268 17964 raft_consensus.cc:2243] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.413870 17964 raft_consensus.cc:2272] T 5f6c3fb3159248429932b08d8bc9f222 P 0f833abfb3544031bee566e655b7fedc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.416484 17964 tablet_replica.cc:333] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.417253 17964 raft_consensus.cc:2243] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.417852 17964 raft_consensus.cc:2272] T 941387979c524e4c8b05785609c3d3c4 P 0f833abfb3544031bee566e655b7fedc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:06.422080 17964 tablet_replica.cc:333] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc: stopping tablet replica
I20260709 13:21:06.422729 17964 raft_consensus.cc:2243] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:06.423400 17964 raft_consensus.cc:2272] T 2d1b18b0ec57435da3325e677d1b8741 P 0f833abfb3544031bee566e655b7fedc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:06.456982 19184 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111) [suppressed 431 similar messages]
W20260709 13:21:06.499500 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.521721 19112 connection.cc:466] server connection from 127.0.0.1:47596 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47596 (request call id 3468) could send its response
W20260709 13:21:06.527105 19184 connection.cc:769] client connection to 127.17.139.2:40307 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:21:06.562732 19184 consensus_peers.cc:597] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.597656 19714 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.618700 19714 consensus_peers.cc:597] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.706144 19184 consensus_peers.cc:597] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.765048 19184 consensus_peers.cc:597] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.822083 19714 consensus_peers.cc:597] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.855546 19184 consensus_peers.cc:597] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.860213 19714 consensus_peers.cc:597] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.899585 19714 consensus_peers.cc:597] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:06.912563 25513 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:06.913232 25513 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:06.915442 25513 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:06.928366 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.929462 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:06.932761 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:06.933281 19714 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:06.935045 25513 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:06.937438 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:06.939640 25513 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:06.940310 25513 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:06.945981 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:06.952306 25513 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:06.972453 19714 consensus_peers.cc:597] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:06.987180 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.989399 19714 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:06.991444 19714 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 55991c1f7f474a9888725d00438d8a83, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:06.994743 25513 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:06.995707 19714 consensus_peers.cc:597] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:06.996464 19714 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:07.011742 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:07.039721 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:07.044682 19714 consensus_peers.cc:597] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:07.121980 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:07.122670 25513 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.126881 25513 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.129355 25513 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:07.144690 19714 consensus_peers.cc:597] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:07.159009 25557 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.159607 25557 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.161726 25557 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:07.163285 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
W20260709 13:21:07.177384 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:07.185369 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:07.189613 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.192780 25557 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:07.202509 25520 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.203075 25520 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:07.205179 25520 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:07.222708 19714 leader_election.cc:336] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.223312 19714 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:21:07.227849 25557 raft_consensus.cc:2749] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:07.233081 19184 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.234648 19184 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.235047 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.236464 25520 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:07.237865 25455 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.238396 25455 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.241027 25578 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.241515 25578 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.240650 25455 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.249351 25578 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:21:07.249966 19714 leader_election.cc:336] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:07.250967 19714 leader_election.cc:336] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:07.251386 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.252115 25455 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:07.255713 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:07.256337 19743 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 23.
I20260709 13:21:07.262538 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:07.263401 25588 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:07.264302 25578 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.264955 25578 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:07.266957 25578 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.269203 25588 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.269701 25588 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:07.279273 25557 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.279848 25557 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.281960 25557 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:07.287606 19714 leader_election.cc:336] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.288194 19714 leader_election.cc:336] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.288550 19714 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.291205 25455 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:07.298614 19184 consensus_peers.cc:597] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:07.307814 19184 leader_election.cc:336] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.308475 25588 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.311949 25455 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.312503 25455 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.314695 25455 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:07.319669 19184 consensus_peers.cc:597] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.320737 25588 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 24 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
W20260709 13:21:07.319761 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.326185 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:07.326884 19184 leader_election.cc:336] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.326578 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.329056 25455 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:07.331277 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e32daa1d5e3443eaaf7b1e03100b270" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66"
I20260709 13:21:07.331645 25588 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.331857 19743 raft_consensus.cc:3060] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:07.332201 25588 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.334762 25588 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4:42525)
I20260709 13:21:07.336234 25455 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.336743 25455 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.338690 25455 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.339118 19743 raft_consensus.cc:2468] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 24.
W20260709 13:21:07.347079 19714 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.349404 19714 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.349802 19714 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:21:07.351872 19184 leader_election.cc:336] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:07.352326 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.353157 25588 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:07.356065 25557 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:07.356760 19743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "55991c1f7f474a9888725d00438d8a83" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "508ee2e0531b43d7a1c05f950644ae66" is_pre_election: true
I20260709 13:21:07.357384 19743 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55991c1f7f474a9888725d00438d8a83 in term 15.
I20260709 13:21:07.357290 25588 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.359071 25588 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:07.362403 25588 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.363305 19184 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 
I20260709 13:21:07.368652 25578 raft_consensus.cc:2804] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:07.369292 25578 raft_consensus.cc:697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 24 LEADER]: Becoming Leader. State: Replica: 55991c1f7f474a9888725d00438d8a83, State: Running, Role: LEADER
I20260709 13:21:07.370283 25578 consensus_queue.cc:237] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.461633 25513 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.462333 25513 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.464427 25513 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:07.672657 25513 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.673586 25513 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.682690 25513 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.709659 25589 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.710485 25589 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:21:07.720861 19714 leader_election.cc:336] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:07.762900 19714 consensus_peers.cc:597] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:07.763895 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.765543 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.766070 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.770951 25513 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:07.770524 25591 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.775574 25591 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
W20260709 13:21:07.773669 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:07.777877 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.777909 25591 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:07.781363 17964 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19168)
I20260709 13:21:07.794795 25455 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.795600 25455 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.798322 25455 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.817675 25455 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.818220 25455 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:07.819410 19714 leader_election.cc:336] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.820024 19714 leader_election.cc:336] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.820187 25455 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.820340 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.821098 25455 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:21:07.824075 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 460809us
W20260709 13:21:07.825238 19184 leader_election.cc:336] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:07.825408 19714 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.827173 19714 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.827484 19714 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.828025 25455 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.829174 25589 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:07.836043 25455 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.836686 25455 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:07.842850 19714 leader_election.cc:336] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:07.849602 25455 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:07.851560 19714 leader_election.cc:336] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.852229 19714 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.853229 25513 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:07.863194 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:07.864017 19218 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 20.
I20260709 13:21:07.869633 25589 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.871145 25589 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:07.873780 25589 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:07.894295 19184 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:07.907359 19184 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:07.909467 19184 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:07.910406 18967 catalog_manager.cc:5697] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 reported cstate change: term changed from 23 to 24, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 55991c1f7f474a9888725d00438d8a83 (127.17.139.3). New cstate: current_term: 24 leader_uuid: "55991c1f7f474a9888725d00438d8a83" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:07.927946 25594 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:07.934536 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:21:07.937179 25455 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:07.937583 25455 raft_consensus.cc:493] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:07.937999 25455 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:07.950027 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:07.959508 25455 raft_consensus.cc:515] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:07.969614 25455 leader_election.cc:290] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 election: Requested vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:07.972252 19714 leader_election.cc:336] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:08.000250 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "263ce615af6646ada8e5f6d61d990dee" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83"
I20260709 13:21:08.000852 19218 raft_consensus.cc:3060] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:08.005501 19184 leader_election.cc:336] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:08.006280 19184 leader_election.cc:336] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:08.006861 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:08.007470 19184 consensus_peers.cc:597] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:08.007565 19218 raft_consensus.cc:2468] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 21.
W20260709 13:21:08.007936 19184 leader_election.cc:336] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:08.021095 19184 leader_election.cc:336] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:08.021620 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:08.022454 25593 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:08.024405 19184 leader_election.cc:336] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:08.024850 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:08.025596 25593 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:08.029465 19184 leader_election.cc:336] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:08.030467 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:08.031188 25593 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:08.032037 19717 leader_election.cc:304] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc
I20260709 13:21:08.032917 25599 raft_consensus.cc:2804] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:08.033710 25599 raft_consensus.cc:697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 21 LEADER]: Becoming Leader. State: Replica: 508ee2e0531b43d7a1c05f950644ae66, State: Running, Role: LEADER
I20260709 13:21:08.034619 25599 consensus_queue.cc:237] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:08.058617 19184 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:08.059846 19184 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:08.060297 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:08.061116 25593 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:08.061077 18967 catalog_manager.cc:5697] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 reported cstate change: term changed from 20 to 21, leader changed from 0f833abfb3544031bee566e655b7fedc (127.17.139.2) to 508ee2e0531b43d7a1c05f950644ae66 (127.17.139.4). New cstate: current_term: 21 leader_uuid: "508ee2e0531b43d7a1c05f950644ae66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:08.132561 19184 consensus_peers.cc:597] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.161550 19746 raft_consensus.cc:1275] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 24 FOLLOWER]: Refusing update from remote peer 55991c1f7f474a9888725d00438d8a83: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:21:08.162858 25593 consensus_queue.cc:1048] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:08.230537 19714 consensus_peers.cc:597] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.231228 19714 consensus_peers.cc:597] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.308586 19714 consensus_peers.cc:597] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.354143 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.363042 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.371835 19184 consensus_peers.cc:597] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.372464 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.372958 19184 consensus_peers.cc:597] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.373407 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.404186 19184 consensus_peers.cc:597] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.430738 19714 consensus_peers.cc:597] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.443315 19184 consensus_peers.cc:597] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.470744 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.490890 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.511464 19184 consensus_peers.cc:597] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:08.521906 19218 raft_consensus.cc:1275] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Refusing update from remote peer 508ee2e0531b43d7a1c05f950644ae66: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:08.523283 25597 consensus_queue.cc:1048] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:21:08.576478 19714 consensus_peers.cc:597] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:08.577090 19714 consensus_peers.cc:597] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.583931 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.610868 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:08.706815 19714 consensus_peers.cc:597] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.721849 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.761325 19184 consensus_peers.cc:597] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.782150 17964 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19168)
I20260709 13:21:08.854576 25597 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:08.855273 25597 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:08.857592 25597 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:08.873540 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.887540 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6ac0 after lost signal to thread 17967
W20260709 13:21:08.888921 19242 debug-util.cc:398] Leaking SignalData structure 0x7b0800344540 after lost signal to thread 19004
W20260709 13:21:08.889191 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:08.889338 19184 consensus_peers.cc:597] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.889801 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:08.890236 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08000823c0 after lost signal to thread 19245
I20260709 13:21:08.890303 19714 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:08.891163 25597 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:08.891765 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1ea0 after lost signal to thread 19775
W20260709 13:21:08.902922 19184 consensus_peers.cc:597] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.913594 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:08.918635 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:08.922889 25599 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:08.923422 25599 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:08.925531 25599 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:08.941601 25599 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:08.942183 25599 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:08.944242 25599 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:08.946105 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:08.947307 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:08.947784 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:08.948599 25599 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:08.965054 19184 consensus_peers.cc:597] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:08.982931 25599 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:08.983525 25599 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:08.985622 25599 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:08.988513 19714 leader_election.cc:336] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:08.993623 19714 leader_election.cc:336] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:08.994308 19714 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:08.995115 25599 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:09.020548 19714 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.028112 19714 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:09.032532 19184 consensus_peers.cc:597] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.044191 19714 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.045842 25599 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:09.080017 19714 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.080633 19714 consensus_peers.cc:597] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.114466 25593 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.115029 25593 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:09.117193 25593 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:09.129060 19184 leader_election.cc:336] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.130199 19184 leader_election.cc:336] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.130678 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.131476 25593 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:09.169598 19714 consensus_peers.cc:597] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:09.278661 25593 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.279222 25593 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:09.281436 25593 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:09.301709 19184 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:09.307531 25597 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.308135 25597 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:09.310381 25597 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:09.321668 25597 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.325176 25597 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:09.322266 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.327114 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.327597 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.330132 25599 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:09.333997 25599 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.334506 25599 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:09.336690 25599 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:09.329267 25597 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:09.345993 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.349773 19184 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.352990 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.358963 25589 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:21:09.362803 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.363387 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.367833 25597 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:09.369041 19714 leader_election.cc:336] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:09.367105 19184 consensus_peers.cc:597] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:09.374352 19714 leader_election.cc:336] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:09.374883 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.379648 25597 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:21:09.404197 19184 consensus_peers.cc:597] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.418258 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:09.436174 25599 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.436729 25599 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:09.438740 25599 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:09.444449 25597 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.445142 25597 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:09.449502 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:09.450150 19218 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:21:09.452646 25597 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:09.514957 19717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:39345, user_credentials={real_user=slave}} blocked reactor thread for 47838.1us
W20260709 13:21:09.532806 19714 leader_election.cc:336] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.551138 19714 leader_election.cc:336] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.555047 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.559572 25599 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:09.560554 19714 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:09.568914 19714 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:09.569308 19714 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.569979 25599 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:09.573442 19714 consensus_peers.cc:597] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:09.578006 25599 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.578567 25599 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:09.580636 25599 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:09.590492 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.593292 19714 leader_election.cc:336] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.594157 19714 leader_election.cc:336] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.594624 19714 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.596108 25599 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:09.598992 25589 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.599539 25589 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:09.601781 25589 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:09.613369 19714 consensus_peers.cc:597] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.616523 19184 leader_election.cc:336] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.624382 25599 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.629189 25599 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:09.631290 25599 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:09.633678 19714 consensus_peers.cc:597] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:09.632256 19184 leader_election.cc:336] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:09.635912 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.636713 25589 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:09.649533 19714 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.650422 19714 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.650876 19714 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.651731 25599 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:09.672612 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.683326 19714 consensus_peers.cc:597] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.695242 19184 consensus_peers.cc:597] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.714040 19714 consensus_peers.cc:597] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.733422 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.747072 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.751020 19714 consensus_peers.cc:597] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:09.782634 17964 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 19168)
W20260709 13:21:09.789152 19184 consensus_peers.cc:597] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:09.894440 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:09.898990 25589 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:09.899570 25589 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:09.901669 25589 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:09.935895 19714 consensus_peers.cc:597] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:09.959760 19184 leader_election.cc:336] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:09.960562 19184 leader_election.cc:336] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:09.961043 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:09.961845 25589 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:10.008810 19184 consensus_peers.cc:597] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.122663 19184 consensus_peers.cc:597] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.152727 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:10.202211 25589 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:10.202769 25589 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:10.205394 25589 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:10.254930 19184 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:10.264267 19184 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:10.264830 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:10.266950 25589 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:10.270239 25593 raft_consensus.cc:493] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:10.271202 25593 raft_consensus.cc:515] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:10.277413 25593 leader_election.cc:290] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:10.296113 19184 leader_election.cc:336] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:10.296792 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:10.301680 19184 leader_election.cc:336] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:10.303483 19184 leader_election.cc:304] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:10.304322 25611 raft_consensus.cc:2749] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:10.405066 19184 consensus_peers.cc:597] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:10.451498 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:10.533443 25599 raft_consensus.cc:493] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:10.535319 25599 raft_consensus.cc:515] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:10.539525 25599 leader_election.cc:290] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:10.542879 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.583050 19714 leader_election.cc:336] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:10.585423 19714 leader_election.cc:336] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:10.588577 19714 leader_election.cc:304] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:10.589399 25599 raft_consensus.cc:2749] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:10.588116 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.695963 19714 consensus_peers.cc:597] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.752825 19714 consensus_peers.cc:597] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.755880 19714 consensus_peers.cc:597] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.783138 17964 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 19168)
W20260709 13:21:10.841473 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.848434 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:10.854496 19714 consensus_peers.cc:597] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:11.025437 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:42525, user_credentials={real_user=slave}} blocked reactor thread for 163599us
W20260709 13:21:11.062279 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:11.065194 25599 raft_consensus.cc:493] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.065779 25599 raft_consensus.cc:515] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:11.067792 25599 leader_election.cc:290] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.090996 19184 consensus_peers.cc:597] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.091639 19184 consensus_peers.cc:597] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.095849 19184 consensus_peers.cc:597] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.096285 19184 consensus_peers.cc:597] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.104151 19714 consensus_peers.cc:597] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.104768 19714 consensus_peers.cc:597] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.105257 19714 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:11.106412 25612 raft_consensus.cc:493] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.106892 25612 raft_consensus.cc:515] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:11.238700 25620 raft_consensus.cc:493] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.240839 25620 raft_consensus.cc:515] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
W20260709 13:21:11.248963 19184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:33919, user_credentials={real_user=slave}} blocked reactor thread for 95849.8us
W20260709 13:21:11.250743 19184 consensus_peers.cc:597] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.251770 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.261348 19714 leader_election.cc:336] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.262032 19714 leader_election.cc:304] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.263228 25613 raft_consensus.cc:2749] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:11.268716 25612 leader_election.cc:290] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:11.286049 25612 raft_consensus.cc:493] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.289181 25612 raft_consensus.cc:515] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } attrs { replace: true } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:11.291992 25620 leader_election.cc:290] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:11.292902 25612 leader_election.cc:290] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:11.320604 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.326982 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.327669 19184 consensus_peers.cc:597] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:11.330029 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77b4d72a0734e868e23b83a18a0f6a8" candidate_uuid: "508ee2e0531b43d7a1c05f950644ae66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "55991c1f7f474a9888725d00438d8a83" is_pre_election: true
I20260709 13:21:11.331063 19219 raft_consensus.cc:2468] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508ee2e0531b43d7a1c05f950644ae66 in term 15.
I20260709 13:21:11.332448 25618 raft_consensus.cc:493] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.333277 25618 raft_consensus.cc:515] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:11.335879 25618 leader_election.cc:290] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.338105 19714 leader_election.cc:336] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:11.347817 25599 raft_consensus.cc:493] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.348744 25599 raft_consensus.cc:515] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:11.351469 25599 leader_election.cc:290] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.362634 19714 leader_election.cc:336] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.363197 19714 leader_election.cc:304] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.365136 25610 raft_consensus.cc:2749] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:11.378650 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.401196 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:11.401806 19714 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:11.407244 19184 leader_election.cc:336] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:11.408603 19184 leader_election.cc:336] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.408999 19184 leader_election.cc:304] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
W20260709 13:21:11.409941 19714 consensus_peers.cc:597] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.410956 19714 leader_election.cc:336] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.411358 19714 leader_election.cc:304] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.411899 25599 raft_consensus.cc:2749] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:11.412061 19714 leader_election.cc:336] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.412498 19714 leader_election.cc:304] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66, 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.413252 25615 raft_consensus.cc:2749] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:11.415468 25599 raft_consensus.cc:2749] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:11.425074 19184 consensus_peers.cc:597] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:11.426129 19714 leader_election.cc:336] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:11.428074 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.428468 19714 leader_election.cc:336] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:11.428828 19714 leader_election.cc:304] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.429484 25599 raft_consensus.cc:2749] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:21:11.458988 19714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111) [suppressed 626 similar messages]
W20260709 13:21:11.462783 19714 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.466331 19184 consensus_peers.cc:597] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:11.493405 19184 consensus_peers.cc:597] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:11.505540 25610 raft_consensus.cc:493] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.506342 25610 raft_consensus.cc:515] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:11.508774 25610 leader_election.cc:290] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.543064 19184 consensus_peers.cc:597] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.552201 19714 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:11.553165 19714 leader_election.cc:336] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.553552 19714 leader_election.cc:304] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.558233 25610 raft_consensus.cc:2749] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:11.568642 19184 consensus_peers.cc:597] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.583606 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:11.599100 19714 consensus_peers.cc:597] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:11.602039 25610 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.602856 25610 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:11.606468 25610 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.611776 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.614318 25615 raft_consensus.cc:493] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.615008 25615 raft_consensus.cc:515] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:11.617214 25615 leader_election.cc:290] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.620348 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:11.621016 19714 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.621815 25612 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:11.645697 19184 leader_election.cc:336] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:11.649354 19184 leader_election.cc:336] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.649809 19184 leader_election.cc:304] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.650592 25615 raft_consensus.cc:2749] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:11.682771 25615 raft_consensus.cc:493] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.683408 25615 raft_consensus.cc:515] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:11.685467 25615 leader_election.cc:290] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.695997 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.740453 19184 leader_election.cc:336] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:11.741086 19184 consensus_peers.cc:597] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.742678 19184 leader_election.cc:336] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:11.743191 19184 leader_election.cc:304] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.747987 25615 raft_consensus.cc:2749] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:11.755828 19184 consensus_peers.cc:597] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:11.774247 19714 consensus_peers.cc:597] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:11.783823 17964 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 19168)
I20260709 13:21:11.851147 25615 raft_consensus.cc:493] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.851944 25615 raft_consensus.cc:515] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:11.854429 25615 leader_election.cc:290] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.862502 19184 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:11.863338 19184 leader_election.cc:336] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:11.863787 19184 leader_election.cc:304] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.872664 25618 raft_consensus.cc:2749] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:11.880437 25610 raft_consensus.cc:493] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:11.881286 25610 raft_consensus.cc:515] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:11.883448 25610 leader_election.cc:290] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:11.895586 19714 leader_election.cc:336] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:11.899392 19714 leader_election.cc:336] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:11.899865 19714 leader_election.cc:304] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:11.900835 25599 raft_consensus.cc:2749] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:11.914867 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.981355 19714 consensus_peers.cc:597] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:11.987730 19184 consensus_peers.cc:597] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:12.018036 25610 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:12.018841 25610 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:12.021181 25610 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:12.027611 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:12.028581 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:12.029165 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:12.029893 25610 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:12.041805 19184 consensus_peers.cc:597] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.110006 19242 debug-util.cc:398] Leaking SignalData structure 0x7b080014fc60 after lost signal to thread 17967
W20260709 13:21:12.111451 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3300 after lost signal to thread 19004
W20260709 13:21:12.112794 19242 debug-util.cc:398] Leaking SignalData structure 0x7b0800366fc0 after lost signal to thread 19245
W20260709 13:21:12.114145 19242 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6a40 after lost signal to thread 19775
I20260709 13:21:12.114778 25599 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:12.115432 25599 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:12.117408 25599 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:12.123685 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:12.124398 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:12.124905 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:12.125679 25599 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:12.233023 19714 consensus_peers.cc:597] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.234936 19184 consensus_peers.cc:597] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.241367 19714 consensus_peers.cc:597] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.330057 19714 consensus_peers.cc:597] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.345302 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.383136 19714 consensus_peers.cc:597] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.413316 19184 consensus_peers.cc:597] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.443281 19714 consensus_peers.cc:597] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.448974 19184 consensus_peers.cc:597] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.511956 19714 consensus_peers.cc:597] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.558892 19184 consensus_peers.cc:597] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.559669 19184 consensus_peers.cc:597] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.567121 19184 consensus_peers.cc:597] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:12.611792 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
W20260709 13:21:12.693322 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:12.795092 19184 consensus_peers.cc:597] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:12.821301 19184 consensus_peers.cc:597] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:12.824828 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
W20260709 13:21:12.836237 19717 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.841728 19717 consensus_peers.cc:597] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.855911 19717 consensus_peers.cc:597] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:12.896478 19717 consensus_peers.cc:597] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.928682 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:12.932013 17964 tablet_replica.cc:333] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.934023 17964 raft_consensus.cc:2243] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.935707 17964 raft_consensus.cc:2272] T 61d161ec86f94a4eaf383729c1ddbc87 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.939610 25618 raft_consensus.cc:493] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:12.940150 25618 raft_consensus.cc:515] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } }
I20260709 13:21:12.941346 17964 tablet_replica.cc:333] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.942270 25618 leader_election.cc:290] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
I20260709 13:21:12.942529 17964 raft_consensus.cc:2243] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.944008 17964 raft_consensus.cc:2272] T 3cafb40f37ca439fa093060d6ba342f0 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.948145 17964 tablet_replica.cc:333] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.950034 17964 raft_consensus.cc:2243] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.951102 17964 raft_consensus.cc:2272] T 2653a1baca71467dbf9167aede923a9c P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:12.951934 19184 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:12.955900 17964 tablet_replica.cc:333] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.958130 17964 raft_consensus.cc:2243] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:21:12.958817 19717 consensus_peers.cc:597] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.958995 17964 raft_consensus.cc:2272] T ddcb71ca04ee449ba3db37be4900a2cd P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.962236 17964 tablet_replica.cc:333] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.966131 17964 raft_consensus.cc:2243] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.967316 17964 raft_consensus.cc:2272] T 33ef0d891f7b462bafaf9441fbf19e37 P 55991c1f7f474a9888725d00438d8a83 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:12.968935 19714 consensus_peers.cc:597] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:12.970413 17964 tablet_replica.cc:333] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
W20260709 13:21:12.964730 19184 leader_election.cc:336] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:12.970918 19184 leader_election.cc:304] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55991c1f7f474a9888725d00438d8a83; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:12.971791 25615 raft_consensus.cc:2749] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:12.975049 17964 raft_consensus.cc:2243] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.976330 17964 raft_consensus.cc:2272] T 736ce293ef884a9d97ae4efb914752f6 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:12.978027 19717 consensus_peers.cc:597] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:12.980360 17964 tablet_replica.cc:333] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.981701 17964 raft_consensus.cc:2243] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.983011 17964 raft_consensus.cc:2272] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.985908 17964 tablet_replica.cc:333] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.986873 17964 raft_consensus.cc:2243] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.987742 17964 raft_consensus.cc:2272] T c405ec9a50f54a4fa80ed27adf421c09 P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.991602 17964 tablet_replica.cc:333] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.992524 17964 raft_consensus.cc:2243] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:12.993249 17964 raft_consensus.cc:2272] T d7347527d150466586ce647078eff8bb P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:12.996245 17964 tablet_replica.cc:333] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:12.997184 17964 raft_consensus.cc:2243] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:12.998642 17964 raft_consensus.cc:2272] T e7fd9d26dc9f47ba92b818f308617d95 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.001515 17964 tablet_replica.cc:333] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.002435 17964 raft_consensus.cc:2243] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.003803 17964 raft_consensus.cc:2272] T 41fc665fafb64d08b393d9c8a77d2608 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.006561 17964 tablet_replica.cc:333] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.007476 17964 raft_consensus.cc:2243] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.009300 17964 raft_consensus.cc:2272] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 55991c1f7f474a9888725d00438d8a83 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.012235 17964 tablet_replica.cc:333] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.013239 17964 raft_consensus.cc:2243] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.014963 17964 raft_consensus.cc:2272] T e77b4d72a0734e868e23b83a18a0f6a8 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.018043 17964 tablet_replica.cc:333] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.019003 17964 raft_consensus.cc:2243] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.019723 17964 raft_consensus.cc:2272] T 6a9f9257bc714987a2bba35964a315cf P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.022874 17964 tablet_replica.cc:333] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.023666 17964 raft_consensus.cc:2243] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.024551 17964 raft_consensus.cc:2272] T 263ce615af6646ada8e5f6d61d990dee P 55991c1f7f474a9888725d00438d8a83 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.027400 17964 tablet_replica.cc:333] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.028257 17964 raft_consensus.cc:2243] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.029044 17964 raft_consensus.cc:2272] T 13256a1f86494f9f812c2c4162cec4f7 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.031852 17964 tablet_replica.cc:333] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.032738 17964 raft_consensus.cc:2243] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.033699 17964 raft_consensus.cc:2272] T c875508da24d49ae8496600c3e674b63 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.036413 17964 tablet_replica.cc:333] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.037477 17964 raft_consensus.cc:2243] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.038897 17964 raft_consensus.cc:2272] T c3bb7a633516455782a998ee89832b55 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.041592 17964 tablet_replica.cc:333] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.042470 17964 raft_consensus.cc:2243] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.044118 17964 raft_consensus.cc:2272] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:13.045727 19717 consensus_peers.cc:597] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:13.047079 17964 tablet_replica.cc:333] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.048008 17964 raft_consensus.cc:2243] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.048806 17964 raft_consensus.cc:2272] T c284b8edf0ca4032aeac36d9cbcb9925 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.051692 17964 tablet_replica.cc:333] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.052572 17964 raft_consensus.cc:2243] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.053735 17964 raft_consensus.cc:2272] T 7af214f1f7324aef8b59a1b91a41d317 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.056653 17964 tablet_replica.cc:333] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.057489 17964 raft_consensus.cc:2243] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.058792 17964 raft_consensus.cc:2272] T 701310a5195343c081bea195df509e65 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:13.060796 19717 consensus_peers.cc:597] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:13.061642 17964 tablet_replica.cc:333] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.062552 17964 raft_consensus.cc:2243] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.063760 17964 raft_consensus.cc:2272] T 1e32daa1d5e3443eaaf7b1e03100b270 P 55991c1f7f474a9888725d00438d8a83 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.066633 17964 tablet_replica.cc:333] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.067314 17964 raft_consensus.cc:2243] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.067854 17964 raft_consensus.cc:2272] T 7e7ecd70203b43ca9b21a47be75683e4 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.070264 17964 tablet_replica.cc:333] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.071067 17964 raft_consensus.cc:2243] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.072379 17964 raft_consensus.cc:2272] T af41c4af8a294a729613e88856c064ac P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.074860 17964 tablet_replica.cc:333] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.075591 17964 raft_consensus.cc:2243] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.076749 17964 raft_consensus.cc:2272] T 49d828ebf4a6479ca74fbb76d8536b5a P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.079324 17964 tablet_replica.cc:333] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.080053 17964 raft_consensus.cc:2243] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.081911 17964 raft_consensus.cc:2272] T 21c9cfe67c8c483e9edc1da47107fd2f P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.084803 17964 tablet_replica.cc:333] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
W20260709 13:21:13.085479 19717 consensus_peers.cc:597] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:13.085618 17964 raft_consensus.cc:2243] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.086267 17964 raft_consensus.cc:2272] T 228b0a2048a3451cbfd947fa97eb2d8e P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.089013 17964 tablet_replica.cc:333] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.089543 17964 raft_consensus.cc:2243] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.090117 17964 raft_consensus.cc:2272] T 409c2d9a573f4e408b732ebafda96921 P 55991c1f7f474a9888725d00438d8a83 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.092213 17964 tablet_replica.cc:333] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.092856 17964 raft_consensus.cc:2243] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.093824 17964 raft_consensus.cc:2272] T 6e9eca38a1164c2293be5a949d3526b3 P 55991c1f7f474a9888725d00438d8a83 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.095824 17964 tablet_replica.cc:333] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.096336 17964 raft_consensus.cc:2243] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.097046 17964 raft_consensus.cc:2272] T 90cdd87d3b9846a1a1863432e72d2d75 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.099036 17964 tablet_replica.cc:333] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.099736 17964 raft_consensus.cc:2243] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.100940 17964 raft_consensus.cc:2272] T 8433d8c678614c00ad69faf57a9363de P 55991c1f7f474a9888725d00438d8a83 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.103571 17964 tablet_replica.cc:333] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.104321 17964 raft_consensus.cc:2243] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.104965 17964 raft_consensus.cc:2272] T 0d6b40b78ed348b0ad0b2c0f3d648061 P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.106953 17964 tablet_replica.cc:333] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.107585 17964 raft_consensus.cc:2243] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.109131 17964 raft_consensus.cc:2272] T ec63bca0af2942e1b88ac12d090c139c P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.111812 17964 tablet_replica.cc:333] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.112701 17964 raft_consensus.cc:2243] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.113735 17964 raft_consensus.cc:2272] T 4a5c24584b054af68fe8fe327bad2e5b P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.116410 17964 tablet_replica.cc:333] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.117132 17964 raft_consensus.cc:2243] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.118492 17964 raft_consensus.cc:2272] T 5f6c3fb3159248429932b08d8bc9f222 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:13.118412 19184 consensus_peers.cc:597] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.120589 19714 consensus_peers.cc:597] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:13.121601 17964 tablet_replica.cc:333] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.122282 17964 raft_consensus.cc:2243] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.123431 17964 raft_consensus.cc:2272] T 941387979c524e4c8b05785609c3d3c4 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.126307 17964 tablet_replica.cc:333] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.126879 17964 raft_consensus.cc:2243] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.127655 17964 raft_consensus.cc:2272] T d57ee419ffa74c87b2c5eb26b930d9ef P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.130149 17964 tablet_replica.cc:333] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.130699 17964 raft_consensus.cc:2243] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.131584 17964 raft_consensus.cc:2272] T c1b4ebbb026847c7a47a03402902ca2a P 55991c1f7f474a9888725d00438d8a83 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.133514 17964 tablet_replica.cc:333] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.134016 17964 raft_consensus.cc:2243] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.135046 17964 raft_consensus.cc:2272] T 28952387f86d4e5892a88c9c3e0173c8 P 55991c1f7f474a9888725d00438d8a83 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.137601 17964 tablet_replica.cc:333] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.138311 17964 raft_consensus.cc:2243] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:13.139048 17964 raft_consensus.cc:2272] T 66ce6ec243d4436da3c96c55bba7244a P 55991c1f7f474a9888725d00438d8a83 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.141347 17964 tablet_replica.cc:333] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.141835 17964 raft_consensus.cc:2243] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.142890 17964 raft_consensus.cc:2272] T 3846ceb53ab145bfa0ae536aa51f05d0 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.144968 17964 tablet_replica.cc:333] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.145484 17964 raft_consensus.cc:2243] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.146409 17964 raft_consensus.cc:2272] T 3627cae163084c338404a5153ef0efb9 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.148248 17964 tablet_replica.cc:333] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.148758 17964 raft_consensus.cc:2243] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.149706 17964 raft_consensus.cc:2272] T 14973b885f3f4ff1833ff0e215658aa9 P 55991c1f7f474a9888725d00438d8a83 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:13.151495 17964 tablet_replica.cc:333] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83: stopping tablet replica
I20260709 13:21:13.151937 17964 raft_consensus.cc:2243] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:13.152849 17964 raft_consensus.cc:2272] T b07ef65c060943509b105c2f74e22ff5 P 55991c1f7f474a9888725d00438d8a83 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:13.163774 19717 consensus_peers.cc:597] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.178099 19717 consensus_peers.cc:597] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.178918 19714 consensus_peers.cc:597] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.181676 19714 consensus_peers.cc:597] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.195806 19717 consensus_peers.cc:597] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.198489 19717 consensus_peers.cc:597] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.205763 19714 consensus_peers.cc:597] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:13.210327 25610 raft_consensus.cc:493] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:13.211370 25610 raft_consensus.cc:515] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:13.215605 25610 leader_election.cc:290] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:13.227886 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:13.228632 19714 leader_election.cc:336] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:13.229112 19714 leader_election.cc:304] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:13.229803 25610 raft_consensus.cc:2749] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:13.241074 19717 consensus_peers.cc:597] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.287757 19717 consensus_peers.cc:597] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.291126 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.303045 19717 consensus_peers.cc:597] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.330775 19717 consensus_peers.cc:597] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Couldn't send request to peer 55991c1f7f474a9888725d00438d8a83. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:13.373538 19714 consensus_peers.cc:597] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:13.429953 19714 consensus_peers.cc:597] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.469954 19714 consensus_peers.cc:597] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:13.551708 25628 raft_consensus.cc:493] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:13.552421 25628 raft_consensus.cc:515] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:13.554548 25628 leader_election.cc:290] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:13.558750 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:13.560485 19714 leader_election.cc:336] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:13.560822 19714 leader_election.cc:304] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:13.561453 25628 raft_consensus.cc:2749] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:13.642488 19714 consensus_peers.cc:597] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.752669 19714 consensus_peers.cc:597] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:13.827584 19714 consensus_peers.cc:597] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Couldn't send request to peer 0f833abfb3544031bee566e655b7fedc. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:13.888921 25628 raft_consensus.cc:493] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f833abfb3544031bee566e655b7fedc)
I20260709 13:21:13.889572 25628 raft_consensus.cc:515] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:13.891731 25628 leader_election.cc:290] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307)
W20260709 13:21:13.899361 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
W20260709 13:21:13.901015 19714 leader_election.cc:336] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:13.901446 19714 leader_election.cc:304] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:13.902155 25628 raft_consensus.cc:2749] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:13.906013 25628 raft_consensus.cc:493] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:21:13.906499 25628 raft_consensus.cc:515] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:13.909320 25628 leader_election.cc:290] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:13.913057 19717 leader_election.cc:336] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111)
I20260709 13:21:13.914201 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
W20260709 13:21:13.915323 19714 leader_election.cc:336] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:13.915827 19714 leader_election.cc:304] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:21:13.917601 25628 raft_consensus.cc:2749] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:13.950219 19714 consensus_peers.cc:597] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 -> Peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Couldn't send request to peer 7cac62c1d5aa4356b70f6517fe0ba5d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:14.033717 17964 tablet_server.cc:179] TabletServer@127.17.139.4:0 shutting down...
I20260709 13:21:14.043403 25627 raft_consensus.cc:493] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:21:14.044036 25627 raft_consensus.cc:515] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:14.046069 25627 leader_election.cc:290] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
W20260709 13:21:14.050794 19717 leader_election.cc:336] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111)
W20260709 13:21:14.053028 19714 leader_election.cc:336] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:14.056123 19714 leader_election.cc:304] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:21:14.057058 25627 raft_consensus.cc:2749] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:14.088934 25627 raft_consensus.cc:493] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:21:14.089753 25627 raft_consensus.cc:515] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7cac62c1d5aa4356b70f6517fe0ba5d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 33919 } } peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } attrs { replace: true } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:14.091950 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:14.093055 17964 tablet_replica.cc:333] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.094287 17964 raft_consensus.cc:2243] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.095157 17964 raft_consensus.cc:2272] T e77b4d72a0734e868e23b83a18a0f6a8 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.095203 25627 leader_election.cc:290] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919), 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:14.098763 17964 tablet_replica.cc:333] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.099838 17964 raft_consensus.cc:2243] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.100754 17964 raft_consensus.cc:2272] T d52b625596354c7f9589dc83d8b49ce5 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.104187 17964 tablet_replica.cc:333] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.105175 17964 raft_consensus.cc:2243] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.106673 17964 raft_consensus.cc:2272] T 6a9f9257bc714987a2bba35964a315cf P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.110201 17964 tablet_replica.cc:333] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
W20260709 13:21:14.110702 19714 leader_election.cc:336] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7cac62c1d5aa4356b70f6517fe0ba5d6 (127.17.139.1:33919): Network error: Client connection negotiation failed: client connection to 127.17.139.1:33919: connect: Connection refused (error 111)
I20260709 13:21:14.111296 17964 raft_consensus.cc:2243] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:14.111915 19714 leader_election.cc:336] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:14.112278 17964 raft_consensus.cc:2272] T 1a8a26e15ebb4ecfae8b6eff7a8cc22f P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.112392 19714 leader_election.cc:304] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 7cac62c1d5aa4356b70f6517fe0ba5d6
I20260709 13:21:14.113444 25627 raft_consensus.cc:2749] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:14.115921 17964 tablet_replica.cc:333] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.116962 17964 raft_consensus.cc:2243] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.117957 17964 raft_consensus.cc:2272] T e7fd9d26dc9f47ba92b818f308617d95 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:14.118373 19717 leader_election.cc:336] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111)
I20260709 13:21:14.121109 17964 tablet_replica.cc:333] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.122159 17964 raft_consensus.cc:2243] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.123390 17964 raft_consensus.cc:2272] T 2653a1baca71467dbf9167aede923a9c P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.126502 17964 tablet_replica.cc:333] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.127353 17964 raft_consensus.cc:2243] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.128227 17964 raft_consensus.cc:2272] T 3846ceb53ab145bfa0ae536aa51f05d0 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.131354 17964 tablet_replica.cc:333] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.132200 17964 raft_consensus.cc:2243] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.132784 17964 raft_consensus.cc:2272] T 716382b8056843a8ac2701a2242b5834 P 508ee2e0531b43d7a1c05f950644ae66 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.135555 17964 tablet_replica.cc:333] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.136250 17964 raft_consensus.cc:2243] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.137225 17964 raft_consensus.cc:2272] T b07ef65c060943509b105c2f74e22ff5 P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.139797 17964 tablet_replica.cc:333] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.140267 25628 raft_consensus.cc:493] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:21:14.141037 25628 raft_consensus.cc:515] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:14.142995 17964 raft_consensus.cc:2243] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.144125 25628 leader_election.cc:290] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:14.145589 17964 raft_consensus.cc:2272] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.148861 17964 tablet_replica.cc:333] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
W20260709 13:21:14.149469 19717 leader_election.cc:336] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111)
I20260709 13:21:14.149696 17964 raft_consensus.cc:2243] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:21:14.150063 19714 leader_election.cc:336] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:14.150426 19714 leader_election.cc:304] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:21:14.150787 17964 raft_consensus.cc:2272] T 7e7ecd70203b43ca9b21a47be75683e4 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:14.150879 19714 raft_consensus.cc:2686] T 1e32daa1d5e3443eaaf7b1e03100b270 P 508ee2e0531b43d7a1c05f950644ae66: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:14.153681 17964 tablet_replica.cc:333] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.154582 17964 raft_consensus.cc:2243] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.155390 17964 raft_consensus.cc:2272] T 5f49755f447d4bfba9fb1a68e2fedfa3 P 508ee2e0531b43d7a1c05f950644ae66 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.158525 17964 tablet_replica.cc:333] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.159289 17964 raft_consensus.cc:2243] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.160173 17964 raft_consensus.cc:2272] T 736ce293ef884a9d97ae4efb914752f6 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.162823 17964 tablet_replica.cc:333] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.163703 17964 raft_consensus.cc:2243] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.164398 17964 raft_consensus.cc:2272] T ef2bd04462cb41488ea5d3a18b899972 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.165210 25628 raft_consensus.cc:493] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:21:14.165720 25628 raft_consensus.cc:515] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:14.167541 25628 leader_election.cc:290] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:14.167553 17964 tablet_replica.cc:333] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.169479 17964 raft_consensus.cc:2243] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.171156 17964 raft_consensus.cc:2272] T c1b84fdcb260415b9e65e72540fe1841 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:14.171197 19717 leader_election.cc:336] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111)
W20260709 13:21:14.171810 19714 leader_election.cc:336] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
I20260709 13:21:14.172219 19714 leader_election.cc:304] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:21:14.172904 25628 raft_consensus.cc:2749] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:14.174049 17964 tablet_replica.cc:333] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.174744 17964 raft_consensus.cc:2243] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.175372 17964 raft_consensus.cc:2272] T c3bb7a633516455782a998ee89832b55 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.177706 17964 tablet_replica.cc:333] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.178237 17964 raft_consensus.cc:2243] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.179052 17964 raft_consensus.cc:2272] T 6f8c498b148c4d5db7c4a7d0e2b24360 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.181145 17964 tablet_replica.cc:333] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.181663 17964 raft_consensus.cc:2243] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.182109 17964 raft_consensus.cc:2272] T debddc2dd9264017aeda9f1cad516f83 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.184000 17964 tablet_replica.cc:333] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.184561 17964 raft_consensus.cc:2243] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.185415 17964 raft_consensus.cc:2272] T 28952387f86d4e5892a88c9c3e0173c8 P 508ee2e0531b43d7a1c05f950644ae66 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.187218 17964 tablet_replica.cc:333] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.187880 17964 raft_consensus.cc:2243] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.188628 17964 raft_consensus.cc:2272] T 66ce6ec243d4436da3c96c55bba7244a P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.191238 17964 tablet_replica.cc:333] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.192444 17964 raft_consensus.cc:2243] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.193135 17964 raft_consensus.cc:2272] T 4bf1d0079a1c47338b7cf7be4cdcf505 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.195801 17964 tablet_replica.cc:333] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.196369 17964 raft_consensus.cc:2243] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.197198 17964 raft_consensus.cc:2272] T 90cdd87d3b9846a1a1863432e72d2d75 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.199134 17964 tablet_replica.cc:333] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.199676 17964 raft_consensus.cc:2243] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.200419 17964 raft_consensus.cc:2272] T 13256a1f86494f9f812c2c4162cec4f7 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.202399 17964 tablet_replica.cc:333] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.202931 17964 raft_consensus.cc:2243] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.203416 17964 raft_consensus.cc:2272] T 0e4e5f111c104ea4adb5e45cd00f1db6 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.205420 17964 tablet_replica.cc:333] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.205916 17964 raft_consensus.cc:2243] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.206445 17964 raft_consensus.cc:2272] T 21c9cfe67c8c483e9edc1da47107fd2f P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.208786 17964 tablet_replica.cc:333] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.209434 17964 raft_consensus.cc:2243] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.210119 17964 raft_consensus.cc:2272] T adf40f6b88894de8b62437b0a878c787 P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.212245 17964 tablet_replica.cc:333] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.212795 17964 raft_consensus.cc:2243] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.213335 17964 raft_consensus.cc:2272] T 3cafb40f37ca439fa093060d6ba342f0 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.215416 17964 tablet_replica.cc:333] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.215988 17964 raft_consensus.cc:2243] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.216830 17964 raft_consensus.cc:2272] T 263ce615af6646ada8e5f6d61d990dee P 508ee2e0531b43d7a1c05f950644ae66 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.218786 17964 tablet_replica.cc:333] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.219327 17964 raft_consensus.cc:2243] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.219971 17964 raft_consensus.cc:2272] T 66a9130f4c8e4d5a9ad02554fc4c7a28 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.222434 17964 tablet_replica.cc:333] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.223171 17964 raft_consensus.cc:2243] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.224201 17964 raft_consensus.cc:2272] T ec63bca0af2942e1b88ac12d090c139c P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.226565 17964 tablet_replica.cc:333] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.227229 17964 raft_consensus.cc:2243] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.228209 17964 raft_consensus.cc:2272] T af41c4af8a294a729613e88856c064ac P 508ee2e0531b43d7a1c05f950644ae66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.230858 17964 tablet_replica.cc:333] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.231590 17964 raft_consensus.cc:2243] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.232388 17964 raft_consensus.cc:2272] T 9d0433fa5eeb4f7b83f2fbd60b78b0f4 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.235306 17964 tablet_replica.cc:333] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.235898 17964 raft_consensus.cc:2243] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.236713 17964 raft_consensus.cc:2272] T d57ee419ffa74c87b2c5eb26b930d9ef P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.238598 17964 tablet_replica.cc:333] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.239115 17964 raft_consensus.cc:2243] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.239866 17964 raft_consensus.cc:2272] T 33ef0d891f7b462bafaf9441fbf19e37 P 508ee2e0531b43d7a1c05f950644ae66 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.242039 17964 tablet_replica.cc:333] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.242290 25628 raft_consensus.cc:493] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 55991c1f7f474a9888725d00438d8a83)
I20260709 13:21:14.242765 17964 raft_consensus.cc:2243] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.242839 25628 raft_consensus.cc:515] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0f833abfb3544031bee566e655b7fedc" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 40307 } } peers { permanent_uuid: "55991c1f7f474a9888725d00438d8a83" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 39345 } } peers { permanent_uuid: "508ee2e0531b43d7a1c05f950644ae66" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 42525 } attrs { promote: false } }
I20260709 13:21:14.243470 17964 raft_consensus.cc:2272] T 61d161ec86f94a4eaf383729c1ddbc87 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.245232 25628 leader_election.cc:290] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307), 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345)
I20260709 13:21:14.246464 17964 tablet_replica.cc:333] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.247247 17964 raft_consensus.cc:2243] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.248346 17964 raft_consensus.cc:2272] T 409c2d9a573f4e408b732ebafda96921 P 508ee2e0531b43d7a1c05f950644ae66 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:14.250147 19714 leader_election.cc:336] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0f833abfb3544031bee566e655b7fedc (127.17.139.2:40307): Network error: Client connection negotiation failed: client connection to 127.17.139.2:40307: connect: Connection refused (error 111)
W20260709 13:21:14.250797 19717 leader_election.cc:336] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 55991c1f7f474a9888725d00438d8a83 (127.17.139.3:39345): Network error: Client connection negotiation failed: client connection to 127.17.139.3:39345: connect: Connection refused (error 111)
I20260709 13:21:14.250977 17964 tablet_replica.cc:333] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.251204 19717 leader_election.cc:304] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508ee2e0531b43d7a1c05f950644ae66; no voters: 0f833abfb3544031bee566e655b7fedc, 55991c1f7f474a9888725d00438d8a83
I20260709 13:21:14.251757 17964 raft_consensus.cc:2243] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.251857 25628 raft_consensus.cc:2749] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:14.252991 17964 raft_consensus.cc:2272] T 2d1b18b0ec57435da3325e677d1b8741 P 508ee2e0531b43d7a1c05f950644ae66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.255062 17964 tablet_replica.cc:333] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.255549 17964 raft_consensus.cc:2243] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.256268 17964 raft_consensus.cc:2272] T 75fa1003f49c4855bf92d61c4fc4e4ed P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.258208 17964 tablet_replica.cc:333] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.258688 17964 raft_consensus.cc:2243] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.259606 17964 raft_consensus.cc:2272] T 61d460e2151b412d8e1e8208d00679bc P 508ee2e0531b43d7a1c05f950644ae66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.261749 17964 tablet_replica.cc:333] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.262223 17964 raft_consensus.cc:2243] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.263068 17964 raft_consensus.cc:2272] T 79274c20a7fb4e3dbf6355e5d4a28751 P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.264781 17964 tablet_replica.cc:333] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.265348 17964 raft_consensus.cc:2243] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.265995 17964 raft_consensus.cc:2272] T c1b4ebbb026847c7a47a03402902ca2a P 508ee2e0531b43d7a1c05f950644ae66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.268545 17964 tablet_replica.cc:333] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.269304 17964 raft_consensus.cc:2243] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.270490 17964 raft_consensus.cc:2272] T c405ec9a50f54a4fa80ed27adf421c09 P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.273308 17964 tablet_replica.cc:333] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.273960 17964 raft_consensus.cc:2243] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:14.274852 17964 raft_consensus.cc:2272] T 8433d8c678614c00ad69faf57a9363de P 508ee2e0531b43d7a1c05f950644ae66 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.278136 17964 tablet_replica.cc:333] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66: stopping tablet replica
I20260709 13:21:14.278612 17964 raft_consensus.cc:2243] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.279388 17964 raft_consensus.cc:2272] T 6e9eca38a1164c2293be5a949d3526b3 P 508ee2e0531b43d7a1c05f950644ae66 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.547580 17964 tablet_server.cc:196] TabletServer@127.17.139.4:0 shutdown complete.
I20260709 13:21:14.623291 17964 master.cc:562] Master@127.17.139.62:35345 shutting down...
W20260709 13:21:14.662230 19018 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:21:14.662531 19018 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:14.662756 19018 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:21:14.666376 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:14.667058 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:14.667394 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1b2c4f6d390c49c387cc446ceb8d00e4: stopping tablet replica
I20260709 13:21:14.801469 17964 master.cc:584] Master@127.17.139.62:35345 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (198137 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:21:14.901605 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:35925
I20260709 13:21:14.902680 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:14.908403 25631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:14.908397 25632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:14.908941 25634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:14.910329 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:14.913362 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:14.913563 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:14.913726 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603274913694 us; error 0 us; skew 500 ppm
I20260709 13:21:14.914266 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:14.916584 17964 webserver.cc:533] Webserver started at http://127.17.139.62:44395/ using document root <none> and password file <none>
I20260709 13:21:14.917340 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:14.917526 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:14.917816 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:14.919030 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "dcfa0ff2e13d4806bb2562e5b52590a5"
format_stamp: "Formatted at 2026-07-09 13:21:14 on dist-test-slave-z675"
I20260709 13:21:14.923477 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:14.926950 25639 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:14.927740 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:14.928038 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "dcfa0ff2e13d4806bb2562e5b52590a5"
format_stamp: "Formatted at 2026-07-09 13:21:14 on dist-test-slave-z675"
I20260709 13:21:14.928331 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:14.950722 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:14.951927 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:14.989290 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:35925
I20260709 13:21:14.989413 25690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:35925 every 8 connection(s)
I20260709 13:21:14.993342 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.003439 25691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5: Bootstrap starting.
I20260709 13:21:15.008090 25691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.012288 25691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5: No bootstrap required, opened a new log
I20260709 13:21:15.014489 25691 raft_consensus.cc:359] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" member_type: VOTER }
I20260709 13:21:15.014990 25691 raft_consensus.cc:385] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.015237 25691 raft_consensus.cc:740] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcfa0ff2e13d4806bb2562e5b52590a5, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.015807 25691 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" member_type: VOTER }
I20260709 13:21:15.016259 25691 raft_consensus.cc:399] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:15.016472 25691 raft_consensus.cc:493] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:15.016732 25691 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.021075 25691 raft_consensus.cc:515] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" member_type: VOTER }
I20260709 13:21:15.021623 25691 leader_election.cc:304] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcfa0ff2e13d4806bb2562e5b52590a5; no voters: 
I20260709 13:21:15.022729 25691 leader_election.cc:290] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:15.023216 25694 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.024679 25694 raft_consensus.cc:697] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 1 LEADER]: Becoming Leader. State: Replica: dcfa0ff2e13d4806bb2562e5b52590a5, State: Running, Role: LEADER
I20260709 13:21:15.025483 25694 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" member_type: VOTER }
I20260709 13:21:15.025797 25691 sys_catalog.cc:565] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:15.029997 25695 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" member_type: VOTER } }
I20260709 13:21:15.030820 25695 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:15.030551 25696 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcfa0ff2e13d4806bb2562e5b52590a5. Latest consensus state: current_term: 1 leader_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcfa0ff2e13d4806bb2562e5b52590a5" member_type: VOTER } }
I20260709 13:21:15.031634 25696 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:15.036909 25701 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:15.044564 25701 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:15.045533 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:15.053539 25701 catalog_manager.cc:1383] Generated new cluster ID: c86836c5f8234c08a032dca0c9580218
I20260709 13:21:15.053843 25701 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:15.091975 25701 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:15.093272 25701 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:15.107237 25701 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5: Generated new TSK 0
I20260709 13:21:15.107793 25701 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:15.112421 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:15.118599 25712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:15.119704 25713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:15.121163 25715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:15.121961 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:15.123971 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:15.124157 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:15.124297 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603275124274 us; error 0 us; skew 500 ppm
I20260709 13:21:15.124805 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:15.127310 17964 webserver.cc:533] Webserver started at http://127.17.139.1:44497/ using document root <none> and password file <none>
I20260709 13:21:15.127797 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:15.127967 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:15.128181 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:15.129348 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.134418 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:15.137893 25720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.138653 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:15.138978 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.139226 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:15.154954 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:15.156898 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:15.159413 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:15.163300 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:15.163547 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.163848 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:15.164065 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.218133 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:43003
I20260709 13:21:15.218250 25782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:43003 every 8 connection(s)
I20260709 13:21:15.223773 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:15.231101 25788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:15.232223 25787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:15.236756 25790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:15.237670 25783 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35925
I20260709 13:21:15.238054 25783 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:15.238237 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:15.238934 25783 heartbeater.cc:507] Master 127.17.139.62:35925 requested a full tablet report, sending...
I20260709 13:21:15.240561 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:15.240896 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:15.241101 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603275241080 us; error 0 us; skew 500 ppm
I20260709 13:21:15.241468 25656 ts_manager.cc:194] Registered new tserver with Master: ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:15.241926 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:15.243903 25656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57598
I20260709 13:21:15.245766 17964 webserver.cc:533] Webserver started at http://127.17.139.2:36919/ using document root <none> and password file <none>
I20260709 13:21:15.246272 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:15.246451 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:15.246729 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:15.247798 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "07f41f48d6b44bbb8d23868f1366476c"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.251998 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:21:15.255319 25795 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.256081 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:15.256381 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "07f41f48d6b44bbb8d23868f1366476c"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.256676 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:15.268276 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:15.269431 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:15.270771 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:15.272972 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:15.273172 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.273408 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:15.273571 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.313313 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:45007
I20260709 13:21:15.313427 25857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:45007 every 8 connection(s)
I20260709 13:21:15.318625 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:15.325806 25861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:15.326601 25862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:15.332454 25864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:15.333120 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:15.333995 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:15.334234 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:15.334244 25858 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35925
I20260709 13:21:15.334482 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603275334460 us; error 0 us; skew 500 ppm
I20260709 13:21:15.334764 25858 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:15.335213 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:15.335557 25858 heartbeater.cc:507] Master 127.17.139.62:35925 requested a full tablet report, sending...
I20260709 13:21:15.337942 25656 ts_manager.cc:194] Registered new tserver with Master: 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:15.338094 17964 webserver.cc:533] Webserver started at http://127.17.139.3:46727/ using document root <none> and password file <none>
I20260709 13:21:15.338665 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:15.338866 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:15.339130 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:15.339574 25656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57606
I20260709 13:21:15.340314 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.344751 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:21:15.348022 25869 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.348742 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:21:15.349089 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.349357 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:15.363209 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:15.364360 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:15.365864 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:15.367996 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:15.368224 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.368458 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:15.368630 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.408077 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:37623
I20260709 13:21:15.408181 25931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:37623 every 8 connection(s)
I20260709 13:21:15.412838 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:15.419560 25935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:15.419775 25936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:15.425431 25932 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35925
I20260709 13:21:15.425916 25932 heartbeater.cc:461] Registering TS with master...
W20260709 13:21:15.426146 25938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:15.426867 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:15.428164 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:21:15.428190 25932 heartbeater.cc:507] Master 127.17.139.62:35925 requested a full tablet report, sending...
W20260709 13:21:15.428576 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:15.428987 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603275428954 us; error 0 us; skew 500 ppm
I20260709 13:21:15.429844 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:15.431274 25656 ts_manager.cc:194] Registered new tserver with Master: e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:15.432579 17964 webserver.cc:533] Webserver started at http://127.17.139.4:39781/ using document root <none> and password file <none>
I20260709 13:21:15.433298 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:15.433163 25656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57608
I20260709 13:21:15.433681 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:15.434043 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:15.435436 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-3-root/instance:
uuid: "33e3240923e54438a22da49413055ab3"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.439822 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:15.443094 25943 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.443845 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:15.444109 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-3-root
uuid: "33e3240923e54438a22da49413055ab3"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:15.444334 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:15.452497 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:15.453640 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:15.454926 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:15.457199 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:15.457365 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.457645 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:15.457803 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:15.497586 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.4:38321
I20260709 13:21:15.498049 26005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.4:38321 every 8 connection(s)
I20260709 13:21:15.511758 26006 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35925
I20260709 13:21:15.512204 26006 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:15.512939 26006 heartbeater.cc:507] Master 127.17.139.62:35925 requested a full tablet report, sending...
I20260709 13:21:15.514789 25656 ts_manager.cc:194] Registered new tserver with Master: 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:15.515843 17964 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015133247s
I20260709 13:21:15.516278 25656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57622
I20260709 13:21:15.542376 25656 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57628:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:21:15.783878 25823 tablet_service.cc:1511] Processing CreateTablet for tablet d01f627682fd449e9ee01ba8a323ab4b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:15.786371 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 90f919e905134e49be8c590c4ee5e3b2 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:15.788383 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f919e905134e49be8c590c4ee5e3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.792089 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 97f6007c3cb04bd59b7caf8214c65927 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:15.794943 25819 tablet_service.cc:1511] Processing CreateTablet for tablet 771eedb34a9845bb876bb0217d55cb4f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:15.799208 25820 tablet_service.cc:1511] Processing CreateTablet for tablet 98535bc4fa014421a709e3c207ea43f0 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:15.801426 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01f627682fd449e9ee01ba8a323ab4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.806504 25818 tablet_service.cc:1511] Processing CreateTablet for tablet 9cdf5467ff214d0290c6ef81639ed01a (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:15.808262 25818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cdf5467ff214d0290c6ef81639ed01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.809288 25817 tablet_service.cc:1511] Processing CreateTablet for tablet 298853b845e64b97bccea766389bcc3f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:15.810740 25817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298853b845e64b97bccea766389bcc3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.817863 25816 tablet_service.cc:1511] Processing CreateTablet for tablet fb7de3cff2ff4888914ce16cee616fe3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:15.821776 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98535bc4fa014421a709e3c207ea43f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.822780 25816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7de3cff2ff4888914ce16cee616fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.823423 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f6007c3cb04bd59b7caf8214c65927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.827196 25815 tablet_service.cc:1511] Processing CreateTablet for tablet f7b7a29df0a84d00b36c4968d6162f09 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:15.828657 25815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b7a29df0a84d00b36c4968d6162f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.833910 25814 tablet_service.cc:1511] Processing CreateTablet for tablet 22d400a9f48b4625b8af26e86e19461d (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:15.845165 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771eedb34a9845bb876bb0217d55cb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.846568 25814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d400a9f48b4625b8af26e86e19461d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.846714 25748 tablet_service.cc:1511] Processing CreateTablet for tablet d01f627682fd449e9ee01ba8a323ab4b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:15.849323 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0689353df4c828d77cdd393901a86 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:15.849334 25744 tablet_service.cc:1511] Processing CreateTablet for tablet 771eedb34a9845bb876bb0217d55cb4f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:15.849677 25742 tablet_service.cc:1511] Processing CreateTablet for tablet 298853b845e64b97bccea766389bcc3f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:15.850626 25745 tablet_service.cc:1511] Processing CreateTablet for tablet 98535bc4fa014421a709e3c207ea43f0 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:15.851105 25744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771eedb34a9845bb876bb0217d55cb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.851873 25742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298853b845e64b97bccea766389bcc3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.852905 25746 tablet_service.cc:1511] Processing CreateTablet for tablet d83abde02ee5491eba5ed2e17bed1602 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:15.854308 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83abde02ee5491eba5ed2e17bed1602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.858150 25741 tablet_service.cc:1511] Processing CreateTablet for tablet fb7de3cff2ff4888914ce16cee616fe3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:15.859582 25741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7de3cff2ff4888914ce16cee616fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.859395 25896 tablet_service.cc:1511] Processing CreateTablet for tablet d83abde02ee5491eba5ed2e17bed1602 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:15.858161 25897 tablet_service.cc:1511] Processing CreateTablet for tablet d01f627682fd449e9ee01ba8a323ab4b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:15.861615 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01f627682fd449e9ee01ba8a323ab4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.862102 25895 tablet_service.cc:1511] Processing CreateTablet for tablet 97f6007c3cb04bd59b7caf8214c65927 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:15.864477 25894 tablet_service.cc:1511] Processing CreateTablet for tablet 98535bc4fa014421a709e3c207ea43f0 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:15.865254 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98535bc4fa014421a709e3c207ea43f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.866622 25740 tablet_service.cc:1511] Processing CreateTablet for tablet 7950a85af94b4e019cbd26c1d87687eb (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:15.868028 25740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7950a85af94b4e019cbd26c1d87687eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.868502 25893 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0689353df4c828d77cdd393901a86 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:15.870988 25892 tablet_service.cc:1511] Processing CreateTablet for tablet 9cdf5467ff214d0290c6ef81639ed01a (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:15.871434 25739 tablet_service.cc:1511] Processing CreateTablet for tablet 22d400a9f48b4625b8af26e86e19461d (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:15.872835 25739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d400a9f48b4625b8af26e86e19461d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.849398 25747 tablet_service.cc:1511] Processing CreateTablet for tablet 90f919e905134e49be8c590c4ee5e3b2 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:15.874239 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f919e905134e49be8c590c4ee5e3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.874066 25890 tablet_service.cc:1511] Processing CreateTablet for tablet 7950a85af94b4e019cbd26c1d87687eb (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:15.878093 25889 tablet_service.cc:1511] Processing CreateTablet for tablet f7b7a29df0a84d00b36c4968d6162f09 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:15.880767 25888 tablet_service.cc:1511] Processing CreateTablet for tablet 22d400a9f48b4625b8af26e86e19461d (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:15.876461 25891 tablet_service.cc:1511] Processing CreateTablet for tablet 298853b845e64b97bccea766389bcc3f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:15.860821 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83abde02ee5491eba5ed2e17bed1602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.886423 25888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d400a9f48b4625b8af26e86e19461d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.887066 25891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298853b845e64b97bccea766389bcc3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.893307 25895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f6007c3cb04bd59b7caf8214c65927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.897320 25890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7950a85af94b4e019cbd26c1d87687eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.901304 25889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b7a29df0a84d00b36c4968d6162f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.905294 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98535bc4fa014421a709e3c207ea43f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.909283 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0689353df4c828d77cdd393901a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.913293 25892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cdf5467ff214d0290c6ef81639ed01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.917527 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01f627682fd449e9ee01ba8a323ab4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.933130 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0689353df4c828d77cdd393901a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.952244 25817 tablet_service.cc:1511] Processing CreateTablet for tablet 6de5011c14844d60875c562efc487b1f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:15.954980 25817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de5011c14844d60875c562efc487b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.963914 25815 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5799d4780d40e9904c5edb4a579b03 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:15.984206 25815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5799d4780d40e9904c5edb4a579b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.988956 25747 tablet_service.cc:1511] Processing CreateTablet for tablet 6de5011c14844d60875c562efc487b1f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:15.990302 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de5011c14844d60875c562efc487b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.990469 25823 tablet_service.cc:1511] Processing CreateTablet for tablet ebefea1f5b064445b792836db4d27b94 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:15.990764 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 113a9ca6eaed4ac3881ea23e2261267b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:15.991693 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebefea1f5b064445b792836db4d27b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.994923 25739 tablet_service.cc:1511] Processing CreateTablet for tablet 926bedb86c194b7787f058066b3abbb7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:15.996306 25739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926bedb86c194b7787f058066b3abbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.997534 25819 tablet_service.cc:1511] Processing CreateTablet for tablet dc96524b1d7040a8b84b00484dc7aef9 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:15.998812 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc96524b1d7040a8b84b00484dc7aef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:15.998751 25748 tablet_service.cc:1511] Processing CreateTablet for tablet ebefea1f5b064445b792836db4d27b94 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:16.000109 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebefea1f5b064445b792836db4d27b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.001891 25746 tablet_service.cc:1511] Processing CreateTablet for tablet 113a9ca6eaed4ac3881ea23e2261267b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:16.002074 25816 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6ccd3ac7a54d1bb09a0561e78a565c (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:16.003206 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113a9ca6eaed4ac3881ea23e2261267b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.003999 25816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6ccd3ac7a54d1bb09a0561e78a565c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.007618 25820 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4fed752c59430787a6456b056a9791 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:16.010769 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4fed752c59430787a6456b056a9791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.028228 25744 tablet_service.cc:1511] Processing CreateTablet for tablet 440b1e80c1624e4c90ca0a9d1470da28 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:16.029700 25744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440b1e80c1624e4c90ca0a9d1470da28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.009999 25889 tablet_service.cc:1511] Processing CreateTablet for tablet 926bedb86c194b7787f058066b3abbb7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:16.049710 26023 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
W20260709 13:21:16.049935 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:16.050778 25814 tablet_service.cc:1511] Processing CreateTablet for tablet d7def423740049449c29a407ce4a2855 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:16.056222 25741 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4fed752c59430787a6456b056a9791 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:16.059085 25971 tablet_service.cc:1511] Processing CreateTablet for tablet 90f919e905134e49be8c590c4ee5e3b2 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:16.059355 25817 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca0442774474ae1b1ff15ebe55623e6 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:16.060487 25971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f919e905134e49be8c590c4ee5e3b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.061647 25964 tablet_service.cc:1511] Processing CreateTablet for tablet 7950a85af94b4e019cbd26c1d87687eb (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:16.062088 25970 tablet_service.cc:1511] Processing CreateTablet for tablet d83abde02ee5491eba5ed2e17bed1602 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:16.063052 25964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7950a85af94b4e019cbd26c1d87687eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.062923 25748 tablet_service.cc:1511] Processing CreateTablet for tablet fefde71331ca4e0a87cdf6dc7639b9b0 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:16.064384 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefde71331ca4e0a87cdf6dc7639b9b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.065464 25889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926bedb86c194b7787f058066b3abbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.066090 25968 tablet_service.cc:1511] Processing CreateTablet for tablet 771eedb34a9845bb876bb0217d55cb4f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:16.066960 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113a9ca6eaed4ac3881ea23e2261267b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.066699 25963 tablet_service.cc:1511] Processing CreateTablet for tablet f7b7a29df0a84d00b36c4968d6162f09 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:16.067404 25968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771eedb34a9845bb876bb0217d55cb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.068511 25963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b7a29df0a84d00b36c4968d6162f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.069412 25967 tablet_service.cc:1511] Processing CreateTablet for tablet 82e0689353df4c828d77cdd393901a86 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:16.070120 25745 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca0442774474ae1b1ff15ebe55623e6 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:16.070787 25967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e0689353df4c828d77cdd393901a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.071386 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca0442774474ae1b1ff15ebe55623e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.072706 25966 tablet_service.cc:1511] Processing CreateTablet for tablet 9cdf5467ff214d0290c6ef81639ed01a (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:16.074165 25814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7def423740049449c29a407ce4a2855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.075567 25962 tablet_service.cc:1511] Processing CreateTablet for tablet 6de5011c14844d60875c562efc487b1f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:16.064548 25969 tablet_service.cc:1511] Processing CreateTablet for tablet 97f6007c3cb04bd59b7caf8214c65927 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:16.077610 25970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83abde02ee5491eba5ed2e17bed1602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.081084 25962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de5011c14844d60875c562efc487b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.075949 25893 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5799d4780d40e9904c5edb4a579b03 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:16.085223 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f6007c3cb04bd59b7caf8214c65927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.086201 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5799d4780d40e9904c5edb4a579b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.089253 25966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cdf5467ff214d0290c6ef81639ed01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.088920 25892 tablet_service.cc:1511] Processing CreateTablet for tablet ebefea1f5b064445b792836db4d27b94 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:16.090293 25892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebefea1f5b064445b792836db4d27b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.076076 25965 tablet_service.cc:1511] Processing CreateTablet for tablet fb7de3cff2ff4888914ce16cee616fe3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:16.094218 25965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7de3cff2ff4888914ce16cee616fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.093981 25888 tablet_service.cc:1511] Processing CreateTablet for tablet dc96524b1d7040a8b84b00484dc7aef9 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:16.094825 25741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4fed752c59430787a6456b056a9791. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:16.103085 25641 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 47857.1us
I20260709 13:21:16.095813 25894 tablet_service.cc:1511] Processing CreateTablet for tablet 440b1e80c1624e4c90ca0a9d1470da28 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:16.095305 25888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc96524b1d7040a8b84b00484dc7aef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.112152 26025 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:16.111408 25817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca0442774474ae1b1ff15ebe55623e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.117331 26024 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:16.122661 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 40c147093b5240b8b481ac54e516aeab (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:16.057570 25740 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6ccd3ac7a54d1bb09a0561e78a565c (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:16.139778 25740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6ccd3ac7a54d1bb09a0561e78a565c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.146437 25742 tablet_service.cc:1511] Processing CreateTablet for tablet 40c147093b5240b8b481ac54e516aeab (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:16.147799 25742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c147093b5240b8b481ac54e516aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.147953 26023 tablet_bootstrap.cc:654] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.147660 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 668c03bad1284f0c81f6a7a445fce935 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:16.164979 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668c03bad1284f0c81f6a7a445fce935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.167577 25739 tablet_service.cc:1511] Processing CreateTablet for tablet b8eea0b353e94457bf93ed589f60eaa2 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:16.173652 25739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8eea0b353e94457bf93ed589f60eaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.181558 26025 tablet_bootstrap.cc:654] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.181413 25816 tablet_service.cc:1511] Processing CreateTablet for tablet 481ec3c460694b6d83ec94f2b784a4d3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:16.182641 26024 tablet_bootstrap.cc:654] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.193060 25818 tablet_service.cc:1511] Processing CreateTablet for tablet b8eea0b353e94457bf93ed589f60eaa2 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:16.194916 25970 tablet_service.cc:1511] Processing CreateTablet for tablet 926bedb86c194b7787f058066b3abbb7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:16.197543 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c147093b5240b8b481ac54e516aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.226030 25895 tablet_service.cc:1511] Processing CreateTablet for tablet fefde71331ca4e0a87cdf6dc7639b9b0 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:16.227336 25895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefde71331ca4e0a87cdf6dc7639b9b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.230963 25892 tablet_service.cc:1511] Processing CreateTablet for tablet d7def423740049449c29a407ce4a2855 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:16.205708 25962 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5799d4780d40e9904c5edb4a579b03 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:16.179397 25896 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6ccd3ac7a54d1bb09a0561e78a565c (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:16.233206 25816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481ec3c460694b6d83ec94f2b784a4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.201347 25814 tablet_service.cc:1511] Processing CreateTablet for tablet 13463f4cd4314c158c50a0151f456a8b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:16.234154 25970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926bedb86c194b7787f058066b3abbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.204568 25745 tablet_service.cc:1511] Processing CreateTablet for tablet 13463f4cd4314c158c50a0151f456a8b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:16.242506 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13463f4cd4314c158c50a0151f456a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.262565 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 88a3dd40d38541089c7e684f78dc69b3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:16.262998 25971 tablet_service.cc:1511] Processing CreateTablet for tablet dc96524b1d7040a8b84b00484dc7aef9 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:16.264014 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a3dd40d38541089c7e684f78dc69b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.264169 25971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc96524b1d7040a8b84b00484dc7aef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.254500 25783 heartbeater.cc:499] Master 127.17.139.62:35925 was elected leader, sending a full tablet report...
I20260709 13:21:16.264637 25820 tablet_service.cc:1511] Processing CreateTablet for tablet 5d86df3820ac4e96b1c6bcbe7c9c9593 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:16.274037 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440b1e80c1624e4c90ca0a9d1470da28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.278523 25818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8eea0b353e94457bf93ed589f60eaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.281327 25962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5799d4780d40e9904c5edb4a579b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.285142 25963 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4fed752c59430787a6456b056a9791 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:16.285699 25893 tablet_service.cc:1511] Processing CreateTablet for tablet 481ec3c460694b6d83ec94f2b784a4d3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:16.295429 25815 tablet_service.cc:1511] Processing CreateTablet for tablet f8364a08fda04ddca37f7a62c780bf6b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:16.299544 25969 tablet_service.cc:1511] Processing CreateTablet for tablet fefde71331ca4e0a87cdf6dc7639b9b0 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:16.301317 25889 tablet_service.cc:1511] Processing CreateTablet for tablet b8eea0b353e94457bf93ed589f60eaa2 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:16.302693 25966 tablet_service.cc:1511] Processing CreateTablet for tablet d7def423740049449c29a407ce4a2855 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:16.296355 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 7f981b3562f647568da5155558fdb832 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:16.314831 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6ccd3ac7a54d1bb09a0561e78a565c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.314544 25819 tablet_service.cc:1511] Processing CreateTablet for tablet fdeb29833f3c4de88695f421ea891ece (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:16.315976 25823 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4a10888f634b928b16da286c94e1c3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:16.304917 25890 tablet_service.cc:1511] Processing CreateTablet for tablet 668c03bad1284f0c81f6a7a445fce935 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:16.309661 26026 tablet_bootstrap.cc:492] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:16.329347 25888 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca0442774474ae1b1ff15ebe55623e6 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:16.330842 25968 tablet_service.cc:1511] Processing CreateTablet for tablet 113a9ca6eaed4ac3881ea23e2261267b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:16.320721 25967 tablet_service.cc:1511] Processing CreateTablet for tablet 440b1e80c1624e4c90ca0a9d1470da28 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:16.333927 25897 tablet_service.cc:1511] Processing CreateTablet for tablet 88a3dd40d38541089c7e684f78dc69b3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:16.324803 25747 tablet_service.cc:1511] Processing CreateTablet for tablet 75c3a77378814f77b6d0614228a63ee7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:16.335767 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c3a77378814f77b6d0614228a63ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.322225 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d86df3820ac4e96b1c6bcbe7c9c9593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.326351 25746 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4a10888f634b928b16da286c94e1c3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:16.328779 25817 tablet_service.cc:1511] Processing CreateTablet for tablet c8a2398487364fe5b17151c707da3d38 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:16.328747 25964 tablet_service.cc:1511] Processing CreateTablet for tablet 40c147093b5240b8b481ac54e516aeab (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:16.341660 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4a10888f634b928b16da286c94e1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.343987 25858 heartbeater.cc:499] Master 127.17.139.62:35925 was elected leader, sending a full tablet report...
I20260709 13:21:16.345268 25815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8364a08fda04ddca37f7a62c780bf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.352840 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481ec3c460694b6d83ec94f2b784a4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.353492 26026 tablet_bootstrap.cc:654] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.353823 25892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7def423740049449c29a407ce4a2855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.354938 25888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca0442774474ae1b1ff15ebe55623e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.355654 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a3dd40d38541089c7e684f78dc69b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.348722 26023 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:16.357285 26023 ts_tablet_manager.cc:1403] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.308s	user 0.011s	sys 0.014s
I20260709 13:21:16.363382 26023 raft_consensus.cc:359] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:16.364110 26023 raft_consensus.cc:385] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.364404 26023 raft_consensus.cc:740] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.370064 25966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7def423740049449c29a407ce4a2855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.371956 25964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c147093b5240b8b481ac54e516aeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.373278 25965 tablet_service.cc:1511] Processing CreateTablet for tablet 668c03bad1284f0c81f6a7a445fce935 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:16.377452 25967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440b1e80c1624e4c90ca0a9d1470da28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.372066 25742 tablet_service.cc:1511] Processing CreateTablet for tablet c8a2398487364fe5b17151c707da3d38 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:16.380640 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4a10888f634b928b16da286c94e1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.385217 25968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113a9ca6eaed4ac3881ea23e2261267b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.391346 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdeb29833f3c4de88695f421ea891ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.392247 25742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a2398487364fe5b17151c707da3d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.392982 26025 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:16.393512 26025 ts_tablet_manager.cc:1403] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.282s	user 0.014s	sys 0.023s
I20260709 13:21:16.397521 26025 raft_consensus.cc:359] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:16.409042 26025 raft_consensus.cc:385] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.402668 25740 tablet_service.cc:1511] Processing CreateTablet for tablet 6b11e0680366494cbe324cb81aa88f6c (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:16.403834 25741 tablet_service.cc:1511] Processing CreateTablet for tablet f8364a08fda04ddca37f7a62c780bf6b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:16.404716 25814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13463f4cd4314c158c50a0151f456a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.410383 25896 tablet_service.cc:1511] Processing CreateTablet for tablet 5d86df3820ac4e96b1c6bcbe7c9c9593 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:16.401098 25743 tablet_service.cc:1511] Processing CreateTablet for tablet fdeb29833f3c4de88695f421ea891ece (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:16.414593 25963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4fed752c59430787a6456b056a9791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.422534 25891 tablet_service.cc:1511] Processing CreateTablet for tablet fdeb29833f3c4de88695f421ea891ece (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:16.424747 26024 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:16.425215 25965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668c03bad1284f0c81f6a7a445fce935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.425274 26024 ts_tablet_manager.cc:1403] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.308s	user 0.025s	sys 0.015s
I20260709 13:21:16.431419 25817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a2398487364fe5b17151c707da3d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.432092 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdeb29833f3c4de88695f421ea891ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.434548 25888 tablet_service.cc:1511] Processing CreateTablet for tablet 75c3a77378814f77b6d0614228a63ee7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:16.436262 25932 heartbeater.cc:499] Master 127.17.139.62:35925 was elected leader, sending a full tablet report...
I20260709 13:21:16.437493 25889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8eea0b353e94457bf93ed589f60eaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.438311 25890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668c03bad1284f0c81f6a7a445fce935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.412968 26025 raft_consensus.cc:740] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.442408 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d86df3820ac4e96b1c6bcbe7c9c9593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.441953 26025 consensus_queue.cc:260] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:16.459144 25744 tablet_service.cc:1511] Processing CreateTablet for tablet 254b15472c834bf5bed1d6c0e209037f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:16.461315 25744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b15472c834bf5bed1d6c0e209037f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.498667 25740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b11e0680366494cbe324cb81aa88f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.501989 26025 ts_tablet_manager.cc:1434] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.000s
I20260709 13:21:16.502635 25741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8364a08fda04ddca37f7a62c780bf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.503649 26025 tablet_bootstrap.cc:492] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:16.501487 26024 raft_consensus.cc:359] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:16.507527 26024 raft_consensus.cc:385] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.507834 26024 raft_consensus.cc:740] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.508499 26024 consensus_queue.cc:260] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:16.495136 25888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c3a77378814f77b6d0614228a63ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.525509 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f981b3562f647568da5155558fdb832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.531194 26031 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.531605 25891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdeb29833f3c4de88695f421ea891ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.531924 26031 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:16.533059 26006 heartbeater.cc:499] Master 127.17.139.62:35925 was elected leader, sending a full tablet report...
I20260709 13:21:16.535323 26031 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:16.418773 26023 consensus_queue.cc:260] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:16.570211 26024 ts_tablet_manager.cc:1434] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.144s	user 0.012s	sys 0.028s
I20260709 13:21:16.569556 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 219a9df4cc90493a8b2d7ec008f83019 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:16.575373 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219a9df4cc90493a8b2d7ec008f83019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.575569 25965 tablet_service.cc:1511] Processing CreateTablet for tablet 481ec3c460694b6d83ec94f2b784a4d3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:16.577976 26024 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:16.582903 25746 tablet_service.cc:1511] Processing CreateTablet for tablet 081438f330e54faf854a05dda77dc8a3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:16.584223 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081438f330e54faf854a05dda77dc8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.599769 25816 tablet_service.cc:1511] Processing CreateTablet for tablet 254b15472c834bf5bed1d6c0e209037f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:16.602052 25745 tablet_service.cc:1511] Processing CreateTablet for tablet d6a5b70f7ceb4599ae0da4cec23f7963 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:16.603404 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a5b70f7ceb4599ae0da4cec23f7963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.604038 25816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b15472c834bf5bed1d6c0e209037f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.606305 26026 tablet_bootstrap.cc:492] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:16.606914 26026 ts_tablet_manager.cc:1403] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.320s	user 0.024s	sys 0.005s
I20260709 13:21:16.586041 25967 tablet_service.cc:1511] Processing CreateTablet for tablet 13463f4cd4314c158c50a0151f456a8b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:16.586244 25739 tablet_service.cc:1511] Processing CreateTablet for tablet c9adacf3baa64bbc9f77334887ac19bd (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:16.609269 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefde71331ca4e0a87cdf6dc7639b9b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.629809 25892 tablet_service.cc:1511] Processing CreateTablet for tablet 7f981b3562f647568da5155558fdb832 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:16.631093 25892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f981b3562f647568da5155558fdb832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.630890 25891 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4a10888f634b928b16da286c94e1c3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:16.632162 25891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4a10888f634b928b16da286c94e1c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.633311 25739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9adacf3baa64bbc9f77334887ac19bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.625525 26024 tablet_bootstrap.cc:654] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.637099 25747 tablet_service.cc:1511] Processing CreateTablet for tablet ed9bb5fa0d5842dfb3508b23e0a4a3a7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:16.643241 25965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481ec3c460694b6d83ec94f2b784a4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.645957 25895 tablet_service.cc:1511] Processing CreateTablet for tablet 6b11e0680366494cbe324cb81aa88f6c (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:16.647254 25895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b11e0680366494cbe324cb81aa88f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.651844 25962 tablet_service.cc:1511] Processing CreateTablet for tablet 88a3dd40d38541089c7e684f78dc69b3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:16.653180 25962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a3dd40d38541089c7e684f78dc69b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.654289 25820 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7e69d55ce14023b50cedeb5feae2cf (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:16.655577 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7e69d55ce14023b50cedeb5feae2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.651276 25742 tablet_service.cc:1511] Processing CreateTablet for tablet e86e384892614e74903bbfff46ab5bab (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:16.665386 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 670569c4b0454f0e9605999e38e23e7f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:21:16.666766 25933 tablet.cc:2406] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:16.671758 25819 tablet_service.cc:1511] Processing CreateTablet for tablet c9adacf3baa64bbc9f77334887ac19bd (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:16.678504 25894 tablet_service.cc:1511] Processing CreateTablet for tablet 254b15472c834bf5bed1d6c0e209037f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:16.680512 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b15472c834bf5bed1d6c0e209037f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.686911 25967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13463f4cd4314c158c50a0151f456a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.692082 25815 tablet_service.cc:1511] Processing CreateTablet for tablet 670569c4b0454f0e9605999e38e23e7f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:16.694574 25964 tablet_service.cc:1511] Processing CreateTablet for tablet 5d86df3820ac4e96b1c6bcbe7c9c9593 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:16.678476 26023 ts_tablet_manager.cc:1434] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.321s	user 0.007s	sys 0.011s
I20260709 13:21:16.697382 26023 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:16.695960 25964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d86df3820ac4e96b1c6bcbe7c9c9593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.699170 25966 tablet_service.cc:1511] Processing CreateTablet for tablet f8364a08fda04ddca37f7a62c780bf6b (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:16.700469 25966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8364a08fda04ddca37f7a62c780bf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.711086 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670569c4b0454f0e9605999e38e23e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.713752 25742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86e384892614e74903bbfff46ab5bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.714888 25897 tablet_service.cc:1511] Processing CreateTablet for tablet 219a9df4cc90493a8b2d7ec008f83019 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:16.721753 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:16.733003 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9adacf3baa64bbc9f77334887ac19bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.733186 25970 tablet_service.cc:1511] Processing CreateTablet for tablet 7f981b3562f647568da5155558fdb832 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:16.734531 25970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f981b3562f647568da5155558fdb832. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:16.734454 25873 leader_election.cc:343] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.721903 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9bb5fa0d5842dfb3508b23e0a4a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.737349 25893 tablet_service.cc:1511] Processing CreateTablet for tablet 081438f330e54faf854a05dda77dc8a3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:16.732369 26025 tablet_bootstrap.cc:654] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.752628 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081438f330e54faf854a05dda77dc8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.721396 26026 raft_consensus.cc:359] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:16.754840 26026 raft_consensus.cc:385] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.755151 26026 raft_consensus.cc:740] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.756039 26026 consensus_queue.cc:260] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:16.760322 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 75b847d9971e4cc59c55d60bca9bd6fa (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:16.650398 25818 tablet_service.cc:1511] Processing CreateTablet for tablet e86e384892614e74903bbfff46ab5bab (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:16.765288 26037 raft_consensus.cc:493] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.765837 26037 raft_consensus.cc:515] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:16.770881 26037 leader_election.cc:290] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:16.770422 25965 tablet_service.cc:1511] Processing CreateTablet for tablet 6b11e0680366494cbe324cb81aa88f6c (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:16.766407 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219a9df4cc90493a8b2d7ec008f83019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.785189 25744 tablet_service.cc:1511] Processing CreateTablet for tablet 75b847d9971e4cc59c55d60bca9bd6fa (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:16.774722 25815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670569c4b0454f0e9605999e38e23e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.794878 25965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b11e0680366494cbe324cb81aa88f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.819353 25971 tablet_service.cc:1511] Processing CreateTablet for tablet 219a9df4cc90493a8b2d7ec008f83019 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:16.820709 25971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219a9df4cc90493a8b2d7ec008f83019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.825435 25963 tablet_service.cc:1511] Processing CreateTablet for tablet c8a2398487364fe5b17151c707da3d38 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:16.840660 25739 tablet_service.cc:1511] Processing CreateTablet for tablet 049578b5413b48c796dc1da162f42a17 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:16.841248 25814 tablet_service.cc:1511] Processing CreateTablet for tablet 586bf3736da64db09924ed1a59a2d4ba (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:16.843833 25818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86e384892614e74903bbfff46ab5bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.847149 25745 tablet_service.cc:1511] Processing CreateTablet for tablet 4816921c4c524ae7a5976325662d4c03 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:16.853052 25748 tablet_service.cc:1511] Processing CreateTablet for tablet bb0405f6455d423cbefdabe29f4ea09a (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:16.842455 25743 tablet_service.cc:1511] Processing CreateTablet for tablet c4a6930862024730845f5f504c1e0116 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:16.857486 25963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a2398487364fe5b17151c707da3d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.858589 25746 tablet_service.cc:1511] Processing CreateTablet for tablet a8a0733adf424224946e6d7af7c0857f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:16.862689 25744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b847d9971e4cc59c55d60bca9bd6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.779675 25968 tablet_service.cc:1511] Processing CreateTablet for tablet 75c3a77378814f77b6d0614228a63ee7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:16.865911 25968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c3a77378814f77b6d0614228a63ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.869568 25896 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7e69d55ce14023b50cedeb5feae2cf (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:16.879262 25817 tablet_service.cc:1511] Processing CreateTablet for tablet 611842cf4d6647579e69a91305193c72 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:16.880698 25817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611842cf4d6647579e69a91305193c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.900439 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816921c4c524ae7a5976325662d4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.911918 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b847d9971e4cc59c55d60bca9bd6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.913830 25814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 586bf3736da64db09924ed1a59a2d4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.915848 25891 tablet_service.cc:1511] Processing CreateTablet for tablet 586bf3736da64db09924ed1a59a2d4ba (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:16.917256 25891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 586bf3736da64db09924ed1a59a2d4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.918195 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:16.913874 25889 tablet_service.cc:1511] Processing CreateTablet for tablet c9adacf3baa64bbc9f77334887ac19bd (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:21:16.920400 25872 leader_election.cc:343] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.920888 25872 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:16.921350 26024 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:16.921890 26024 ts_tablet_manager.cc:1403] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.344s	user 0.035s	sys 0.018s
I20260709 13:21:16.922011 26031 raft_consensus.cc:2749] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.923957 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a6930862024730845f5f504c1e0116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.930091 25895 tablet_service.cc:1511] Processing CreateTablet for tablet ed9bb5fa0d5842dfb3508b23e0a4a3a7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:16.933224 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a0733adf424224946e6d7af7c0857f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.933714 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:16.934403 25758 raft_consensus.cc:2468] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:16.935763 25799 leader_election.cc:304] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:16.936558 26037 raft_consensus.cc:2804] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.920629 25889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9adacf3baa64bbc9f77334887ac19bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.936966 26037 raft_consensus.cc:493] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.937379 26037 raft_consensus.cc:3060] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.944167 26037 raft_consensus.cc:515] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:16.945236 25895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9bb5fa0d5842dfb3508b23e0a4a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.946228 26037 leader_election.cc:290] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:16.948184 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:16.948768 25758 raft_consensus.cc:3060] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.950296 25890 tablet_service.cc:1511] Processing CreateTablet for tablet d6a5b70f7ceb4599ae0da4cec23f7963 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:16.951795 25890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a5b70f7ceb4599ae0da4cec23f7963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.952605 25739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049578b5413b48c796dc1da162f42a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.953794 25892 tablet_service.cc:1511] Processing CreateTablet for tablet 049578b5413b48c796dc1da162f42a17 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:16.955057 25892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049578b5413b48c796dc1da162f42a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.956431 25758 raft_consensus.cc:2468] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:16.982481 26025 tablet_bootstrap.cc:492] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:16.982286 25741 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd8f222eaf04b4c8ab0dfc37a470592 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:16.978628 26039 raft_consensus.cc:493] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.983472 25799 leader_election.cc:304] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:16.988739 26026 ts_tablet_manager.cc:1434] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.381s	user 0.013s	sys 0.018s
I20260709 13:21:16.966734 25896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7e69d55ce14023b50cedeb5feae2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.993932 25818 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf81e1b5def481d86abc1ca4750ff7e (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:16.975196 25816 tablet_service.cc:1511] Processing CreateTablet for tablet 4816921c4c524ae7a5976325662d4c03 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:16.958803 26023 tablet_bootstrap.cc:654] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.948577 25821 tablet_service.cc:1511] Processing CreateTablet for tablet c4a6930862024730845f5f504c1e0116 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:16.920629 25823 tablet_service.cc:1511] Processing CreateTablet for tablet ed9bb5fa0d5842dfb3508b23e0a4a3a7 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:17.000267 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0405f6455d423cbefdabe29f4ea09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.997876 25747 tablet_service.cc:1511] Processing CreateTablet for tablet e5739b15c8ac4954a459dbcb444924dd (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:17.033155 25741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd8f222eaf04b4c8ab0dfc37a470592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.019475 26039 raft_consensus.cc:515] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.019012 25815 tablet_service.cc:1511] Processing CreateTablet for tablet e5739b15c8ac4954a459dbcb444924dd (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:17.020392 26037 raft_consensus.cc:2804] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.025771 25816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816921c4c524ae7a5976325662d4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.036284 26039 leader_election.cc:290] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:17.020283 26025 ts_tablet_manager.cc:1403] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.517s	user 0.027s	sys 0.038s
I20260709 13:21:17.000314 25888 tablet_service.cc:1511] Processing CreateTablet for tablet 611842cf4d6647579e69a91305193c72 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:17.036299 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9bb5fa0d5842dfb3508b23e0a4a3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.020383 26026 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:17.004714 26024 raft_consensus.cc:359] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.071973 25888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611842cf4d6647579e69a91305193c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.072743 25969 tablet_service.cc:1511] Processing CreateTablet for tablet e86e384892614e74903bbfff46ab5bab (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:17.065054 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5739b15c8ac4954a459dbcb444924dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:16.996809 25894 tablet_service.cc:1511] Processing CreateTablet for tablet bb0405f6455d423cbefdabe29f4ea09a (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:17.009774 25819 tablet_service.cc:1511] Processing CreateTablet for tablet a8a0733adf424224946e6d7af7c0857f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:17.025532 25893 tablet_service.cc:1511] Processing CreateTablet for tablet c4a6930862024730845f5f504c1e0116 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:17.031347 25897 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf81e1b5def481d86abc1ca4750ff7e (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:17.067096 26037 raft_consensus.cc:697] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:17.077754 26024 raft_consensus.cc:385] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.093508 26024 raft_consensus.cc:740] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
W20260709 13:21:17.094297 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:17.094419 26024 consensus_queue.cc:260] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:16.982354 25964 tablet_service.cc:1511] Processing CreateTablet for tablet 081438f330e54faf854a05dda77dc8a3 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:17.096423 25971 tablet_service.cc:1511] Processing CreateTablet for tablet 586bf3736da64db09924ed1a59a2d4ba (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:17.098029 25818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf81e1b5def481d86abc1ca4750ff7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.100800 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e86e384892614e74903bbfff46ab5bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.105192 25894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0405f6455d423cbefdabe29f4ea09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.105891 25897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf81e1b5def481d86abc1ca4750ff7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.110419 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:17.106606 25815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5739b15c8ac4954a459dbcb444924dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.111959 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:17.107864 26023 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:17.113633 26023 ts_tablet_manager.cc:1403] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.417s	user 0.031s	sys 0.000s
W20260709 13:21:17.114323 25797 leader_election.cc:343] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.114228 25966 tablet_service.cc:1511] Processing CreateTablet for tablet 049578b5413b48c796dc1da162f42a17 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:17.108189 26026 tablet_bootstrap.cc:654] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:17.115403 25797 leader_election.cc:343] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.115648 25966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049578b5413b48c796dc1da162f42a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.111959 25967 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7e69d55ce14023b50cedeb5feae2cf (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:17.118731 25967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7e69d55ce14023b50cedeb5feae2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.077258 26025 raft_consensus.cc:359] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.119264 26025 raft_consensus.cc:385] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.119588 26025 raft_consensus.cc:740] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.120086 25964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081438f330e54faf854a05dda77dc8a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.120525 26025 consensus_queue.cc:260] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.134312 25962 tablet_service.cc:1511] Processing CreateTablet for tablet 75b847d9971e4cc59c55d60bca9bd6fa (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:17.136490 25893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a6930862024730845f5f504c1e0116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.142578 25963 tablet_service.cc:1511] Processing CreateTablet for tablet 670569c4b0454f0e9605999e38e23e7f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:17.155609 26025 ts_tablet_manager.cc:1434] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.114s	user 0.004s	sys 0.003s
I20260709 13:21:17.161401 25971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 586bf3736da64db09924ed1a59a2d4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.165694 25963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670569c4b0454f0e9605999e38e23e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.169451 25962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b847d9971e4cc59c55d60bca9bd6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.173188 25968 tablet_service.cc:1511] Processing CreateTablet for tablet 611842cf4d6647579e69a91305193c72 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:17.173802 26025 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:17.174852 25968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611842cf4d6647579e69a91305193c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.177140 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a6930862024730845f5f504c1e0116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.181214 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a0733adf424224946e6d7af7c0857f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.117370 25970 tablet_service.cc:1511] Processing CreateTablet for tablet d6a5b70f7ceb4599ae0da4cec23f7963 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:17.180229 26037 consensus_queue.cc:237] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.224417 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:17.225297 25907 raft_consensus.cc:2468] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:17.226040 26023 raft_consensus.cc:359] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.226872 25945 leader_election.cc:304] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:17.227658 25889 tablet_service.cc:1511] Processing CreateTablet for tablet a8a0733adf424224946e6d7af7c0857f (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:17.228055 26039 raft_consensus.cc:2804] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.228549 26039 raft_consensus.cc:493] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.228947 26039 raft_consensus.cc:3060] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.229193 25889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a0733adf424224946e6d7af7c0857f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.229969 25895 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd8f222eaf04b4c8ab0dfc37a470592 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:17.230875 25970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a5b70f7ceb4599ae0da4cec23f7963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.231376 25895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd8f222eaf04b4c8ab0dfc37a470592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.226883 26023 raft_consensus.cc:385] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.233567 26023 raft_consensus.cc:740] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.234603 26023 consensus_queue.cc:260] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.241236 26049 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.236588 26025 tablet_bootstrap.cc:654] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.243814 26049 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.241772 26023 ts_tablet_manager.cc:1434] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.001s
I20260709 13:21:17.250239 26023 tablet_bootstrap.cc:492] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:17.241295 26024 ts_tablet_manager.cc:1434] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.319s	user 0.004s	sys 0.011s
I20260709 13:21:17.245273 26039 raft_consensus.cc:515] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.267750 26049 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:17.282140 26024 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:17.296260 26039 leader_election.cc:290] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:17.297407 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:17.298080 25907 raft_consensus.cc:3060] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.313424 25965 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf81e1b5def481d86abc1ca4750ff7e (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:17.314617 26023 tablet_bootstrap.cc:654] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.315490 25965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf81e1b5def481d86abc1ca4750ff7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.323010 25969 tablet_service.cc:1511] Processing CreateTablet for tablet bb0405f6455d423cbefdabe29f4ea09a (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:17.332315 25907 raft_consensus.cc:2468] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:17.337462 25971 tablet_service.cc:1511] Processing CreateTablet for tablet 4816921c4c524ae7a5976325662d4c03 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:17.338238 25945 leader_election.cc:304] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:17.339597 26039 raft_consensus.cc:2804] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.324735 25969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0405f6455d423cbefdabe29f4ea09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.349478 25966 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd8f222eaf04b4c8ab0dfc37a470592 (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:17.349910 25964 tablet_service.cc:1511] Processing CreateTablet for tablet e5739b15c8ac4954a459dbcb444924dd (DEFAULT_TABLE table=test-workload [id=5c66aa0725094075b8845f55ad136abe]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:17.350831 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.351100 25966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd8f222eaf04b4c8ab0dfc37a470592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.352761 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:17.355782 26026 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:17.355326 25654 catalog_manager.cc:5697] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.356285 26026 ts_tablet_manager.cc:1403] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.336s	user 0.030s	sys 0.008s
W20260709 13:21:17.357200 25946 leader_election.cc:343] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:17.358201 25946 leader_election.cc:343] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.374069 25971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816921c4c524ae7a5976325662d4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.376346 25964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5739b15c8ac4954a459dbcb444924dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.385878 26026 raft_consensus.cc:359] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.386889 26026 raft_consensus.cc:385] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.387252 26026 raft_consensus.cc:740] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.423276 26039 raft_consensus.cc:697] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:17.428962 26039 consensus_queue.cc:237] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.388165 26026 consensus_queue.cc:260] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.434204 25970 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52982 (request call id 34) took 1045 ms. Trace:
I20260709 13:21:17.426352 26024 tablet_bootstrap.cc:654] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.453620 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.442538 25970 rpcz_store.cc:276] 0709 13:21:16.387552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:17.082057 (+694505us) service_pool.cc:224] Handling call
0709 13:21:17.205629 (+123572us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:17.208390 (+  2761us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:17.325334 (+116944us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:17.431664 (+106330us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:17.432136 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:21:17.457240 25723 leader_election.cc:343] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.460578 26037 raft_consensus.cc:493] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.461133 26037 raft_consensus.cc:515] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.461570 26026 ts_tablet_manager.cc:1434] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.004s
I20260709 13:21:17.462649 26026 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:17.463533 26037 leader_election.cc:290] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:17.465277 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:17.468634 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:17.469352 26025 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:17.469930 26025 ts_tablet_manager.cc:1403] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.296s	user 0.036s	sys 0.033s
W20260709 13:21:17.470449 25799 leader_election.cc:343] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:17.471660 25722 leader_election.cc:343] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.472148 25722 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:17.472940 26049 raft_consensus.cc:2749] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.474642 26025 raft_consensus.cc:359] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.475387 26025 raft_consensus.cc:385] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.475684 26025 raft_consensus.cc:740] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.476473 26025 consensus_queue.cc:260] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.482637 26025 ts_tablet_manager.cc:1434] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:21:17.483687 26025 tablet_bootstrap.cc:492] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:17.484642 25963 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52982 (request call id 33) took 1110 ms. Trace:
I20260709 13:21:17.499428 25963 rpcz_store.cc:276] 0709 13:21:16.374608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:17.077577 (+702969us) service_pool.cc:224] Handling call
0709 13:21:17.165204 (+ 87627us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:21:17.165318 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:21:17.356799 (+191481us) tablet_metadata.cc:665] Metadata flushed
0709 13:21:17.484114 (+127315us) tablet_replica.cc:206] Creating consensus instance
0709 13:21:17.484554 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:17.500223 26024 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:17.489832 26025 tablet_bootstrap.cc:654] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.490423 26023 tablet_bootstrap.cc:492] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:17.491251 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:17.503840 26026 tablet_bootstrap.cc:654] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.500757 26024 ts_tablet_manager.cc:1403] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.225s	user 0.011s	sys 0.000s
I20260709 13:21:17.505069 26023 ts_tablet_manager.cc:1403] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.255s	user 0.028s	sys 0.056s
I20260709 13:21:17.507172 26024 raft_consensus.cc:359] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.507898 26024 raft_consensus.cc:385] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.508231 26024 raft_consensus.cc:740] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.508023 26023 raft_consensus.cc:359] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.508791 26023 raft_consensus.cc:385] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.509109 26023 raft_consensus.cc:740] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
W20260709 13:21:17.509812 25797 leader_election.cc:343] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.510475 25797 leader_election.cc:304] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:17.513121 26025 tablet_bootstrap.cc:492] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:17.513342 26037 raft_consensus.cc:2749] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.513693 26025 ts_tablet_manager.cc:1403] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 13:21:17.514909 26024 consensus_queue.cc:260] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.518024 26025 raft_consensus.cc:359] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.519157 26025 raft_consensus.cc:385] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.519590 26025 raft_consensus.cc:740] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.521351 26025 consensus_queue.cc:260] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.522455 26024 ts_tablet_manager.cc:1434] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:21:17.523036 26026 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:17.523577 26026 ts_tablet_manager.cc:1403] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.007s
I20260709 13:21:17.523788 26024 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:17.523998 26025 ts_tablet_manager.cc:1434] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:17.525189 26025 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:17.526600 26026 raft_consensus.cc:359] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.527357 26026 raft_consensus.cc:385] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.527702 26026 raft_consensus.cc:740] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.509817 26023 consensus_queue.cc:260] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.528659 26026 consensus_queue.cc:260] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.530896 26023 ts_tablet_manager.cc:1434] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:21:17.531314 26026 ts_tablet_manager.cc:1434] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:21:17.531956 26023 tablet_bootstrap.cc:492] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:17.532352 26026 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:17.533164 26025 tablet_bootstrap.cc:654] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.540385 26024 tablet_bootstrap.cc:654] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.540675 26026 tablet_bootstrap.cc:654] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.545401 26025 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:17.546033 26025 ts_tablet_manager.cc:1403] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:21:17.543818 26023 tablet_bootstrap.cc:654] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.549952 26025 raft_consensus.cc:359] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.550932 26025 raft_consensus.cc:385] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.551273 26025 raft_consensus.cc:740] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.552237 26025 consensus_queue.cc:260] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.555140 26025 ts_tablet_manager.cc:1434] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:21:17.556465 26025 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:17.531477 25653 catalog_manager.cc:5697] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.564904 26025 tablet_bootstrap.cc:654] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.577500 26049 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.578035 26049 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.581516 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.582846 26049 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:17.584750 26037 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.585261 26037 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.586921 26037 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:17.588356 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:17.589571 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:17.591231 25797 leader_election.cc:343] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:17.591914 25797 leader_election.cc:343] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.592334 25797 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:17.593397 26037 raft_consensus.cc:2749] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:17.595479 25723 leader_election.cc:343] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.605276 26026 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:17.604960 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:17.605891 26026 ts_tablet_manager.cc:1403] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.074s	user 0.040s	sys 0.012s
W20260709 13:21:17.607128 25722 leader_election.cc:343] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.607508 25722 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:17.608577 26049 raft_consensus.cc:2749] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.608795 26023 tablet_bootstrap.cc:492] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:17.609244 26025 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:17.609390 26023 ts_tablet_manager.cc:1403] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.024s
I20260709 13:21:17.609766 26024 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:17.609772 26025 ts_tablet_manager.cc:1403] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.025s
I20260709 13:21:17.610446 26024 ts_tablet_manager.cc:1403] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.002s
I20260709 13:21:17.610309 26026 raft_consensus.cc:359] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.611212 26026 raft_consensus.cc:385] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.611580 26026 raft_consensus.cc:740] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.612527 26023 raft_consensus.cc:359] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.612536 26026 consensus_queue.cc:260] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.613037 26025 raft_consensus.cc:359] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.613433 26023 raft_consensus.cc:385] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.613807 26025 raft_consensus.cc:385] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.613955 26023 raft_consensus.cc:740] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.614249 26025 raft_consensus.cc:740] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.614971 26023 consensus_queue.cc:260] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.615099 26025 consensus_queue.cc:260] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.615950 26026 ts_tablet_manager.cc:1434] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:21:17.617056 26026 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:17.617743 26023 ts_tablet_manager.cc:1434] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:17.622072 26031 raft_consensus.cc:493] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.622622 26031 raft_consensus.cc:515] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.624185 26026 tablet_bootstrap.cc:654] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.625170 26031 leader_election.cc:290] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:17.626428 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0689353df4c828d77cdd393901a86" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:17.627094 26025 ts_tablet_manager.cc:1434] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
W20260709 13:21:17.628083 25873 leader_election.cc:343] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.628208 26025 tablet_bootstrap.cc:492] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:17.632043 26023 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:17.613471 26024 raft_consensus.cc:359] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.635064 26024 raft_consensus.cc:385] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.635406 26024 raft_consensus.cc:740] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.637692 26024 consensus_queue.cc:260] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.638171 26025 tablet_bootstrap.cc:654] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.639607 26023 tablet_bootstrap.cc:654] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.649700 26024 ts_tablet_manager.cc:1434] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:21:17.650575 26026 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:17.651177 26026 ts_tablet_manager.cc:1403] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 13:21:17.654708 26023 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:17.654511 26026 raft_consensus.cc:359] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.655234 26023 ts_tablet_manager.cc:1403] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.007s
I20260709 13:21:17.655285 26026 raft_consensus.cc:385] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.655715 26026 raft_consensus.cc:740] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.656481 26026 consensus_queue.cc:260] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.658682 26026 ts_tablet_manager.cc:1434] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:21:17.659375 26023 raft_consensus.cc:359] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.659925 26026 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:17.660141 26023 raft_consensus.cc:385] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.660501 26023 raft_consensus.cc:740] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.657459 26024 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:17.661371 26025 tablet_bootstrap.cc:492] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:17.661942 26025 ts_tablet_manager.cc:1403] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.002s
I20260709 13:21:17.664827 26025 raft_consensus.cc:359] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.665560 26025 raft_consensus.cc:385] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.665917 26025 raft_consensus.cc:740] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.666923 26026 tablet_bootstrap.cc:654] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.666642 26023 consensus_queue.cc:260] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.666651 26025 consensus_queue.cc:260] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.669171 26025 ts_tablet_manager.cc:1434] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:21:17.670650 26025 tablet_bootstrap.cc:492] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:17.675858 26023 ts_tablet_manager.cc:1434] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:21:17.682669 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0689353df4c828d77cdd393901a86" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:17.683346 25980 raft_consensus.cc:2468] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:17.684777 25871 leader_election.cc:304] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:17.686021 26031 raft_consensus.cc:2804] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.686373 26031 raft_consensus.cc:493] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.686704 26031 raft_consensus.cc:3060] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.687578 26023 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:17.694469 26023 tablet_bootstrap.cc:654] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.694999 26031 raft_consensus.cc:515] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.697430 26049 raft_consensus.cc:493] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.698087 26049 raft_consensus.cc:515] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.698400 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0689353df4c828d77cdd393901a86" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:17.699209 25980 raft_consensus.cc:3060] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.700807 26049 leader_election.cc:290] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:17.702700 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:17.704770 25981 raft_consensus.cc:2468] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:17.705276 26024 tablet_bootstrap.cc:654] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.706419 25722 leader_election.cc:304] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:17.703222 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:17.708381 25907 raft_consensus.cc:2468] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:17.710651 26049 raft_consensus.cc:2804] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.711186 26049 raft_consensus.cc:493] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.711611 26049 raft_consensus.cc:3060] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.712288 26026 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:17.713063 26026 ts_tablet_manager.cc:1403] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.053s	user 0.029s	sys 0.023s
I20260709 13:21:17.715852 26024 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:17.716368 26024 ts_tablet_manager.cc:1403] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.002s
I20260709 13:21:17.716377 26026 raft_consensus.cc:359] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.717414 26026 raft_consensus.cc:385] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.717739 26026 raft_consensus.cc:740] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.718605 26026 consensus_queue.cc:260] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.721243 26026 ts_tablet_manager.cc:1434] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:17.722295 26026 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:17.676795 26025 tablet_bootstrap.cc:654] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.728730 26024 raft_consensus.cc:359] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.729773 26024 raft_consensus.cc:385] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.730046 26024 raft_consensus.cc:740] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.730892 26024 consensus_queue.cc:260] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.732452 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0689353df4c828d77cdd393901a86" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:17.733456 26026 tablet_bootstrap.cc:654] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.726672 25980 raft_consensus.cc:2468] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:17.751696 26024 ts_tablet_manager.cc:1434] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.005s
I20260709 13:21:17.752816 26024 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:17.769025 26049 raft_consensus.cc:515] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.737046 26031 leader_election.cc:290] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:17.774274 26024 tablet_bootstrap.cc:654] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.775501 26023 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
W20260709 13:21:17.777714 25873 leader_election.cc:343] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.777853 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:17.781996 26026 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:17.782127 26023 ts_tablet_manager.cc:1403] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.095s	user 0.036s	sys 0.050s
I20260709 13:21:17.782281 25980 raft_consensus.cc:3060] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.782745 26026 ts_tablet_manager.cc:1403] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.025s
I20260709 13:21:17.785916 26023 raft_consensus.cc:359] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.786732 26023 raft_consensus.cc:385] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.777874 26025 tablet_bootstrap.cc:492] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:17.780171 26049 leader_election.cc:290] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:17.777765 26079 raft_consensus.cc:493] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.781328 26031 raft_consensus.cc:493] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.787031 26026 raft_consensus.cc:359] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.787046 26023 raft_consensus.cc:740] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.787953 26031 raft_consensus.cc:515] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.789440 26023 consensus_queue.cc:260] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.787590 26025 ts_tablet_manager.cc:1403] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.005s
I20260709 13:21:17.792068 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.792527 26023 ts_tablet_manager.cc:1434] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:17.788023 26026 raft_consensus.cc:385] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.793313 26026 raft_consensus.cc:740] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.790122 25871 leader_election.cc:304] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:17.793731 25872 leader_election.cc:343] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.794260 26031 leader_election.cc:290] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:17.794363 26026 consensus_queue.cc:260] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.798244 26026 ts_tablet_manager.cc:1434] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:21:17.799817 26026 tablet_bootstrap.cc:492] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:17.801134 26082 raft_consensus.cc:2804] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.801569 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:17.801412 26025 raft_consensus.cc:359] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.802631 26025 raft_consensus.cc:385] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.802582 25907 raft_consensus.cc:3060] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.803367 26025 raft_consensus.cc:740] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.804337 26025 consensus_queue.cc:260] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.811684 26031 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.812264 26031 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.815339 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.815964 26023 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:17.816058 25833 raft_consensus.cc:2468] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:17.817610 25872 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:17.818615 26037 consensus_queue.cc:1048] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.823220 26031 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:17.825874 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:17.827205 26023 tablet_bootstrap.cc:654] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:17.828197 25871 leader_election.cc:343] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.829178 26031 raft_consensus.cc:2804] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.832175 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:17.834180 26031 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.787889 26079 raft_consensus.cc:515] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.826187 25980 raft_consensus.cc:2468] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:17.841634 26024 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:17.838603 26039 raft_consensus.cc:493] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.851193 26024 ts_tablet_manager.cc:1403] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.017s
I20260709 13:21:17.851451 26039 raft_consensus.cc:515] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:17.839607 25873 leader_election.cc:343] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.854372 25873 leader_election.cc:304] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:17.858165 26082 raft_consensus.cc:697] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:17.858794 26084 raft_consensus.cc:2749] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.849148 26031 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.838276 25907 raft_consensus.cc:2468] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:17.855221 26024 raft_consensus.cc:359] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.870079 26025 ts_tablet_manager.cc:1434] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.079s	user 0.013s	sys 0.027s
I20260709 13:21:17.870990 26025 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:17.869897 26024 raft_consensus.cc:385] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.874955 26039 leader_election.cc:290] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:17.859464 26082 consensus_queue.cc:237] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.874752 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771eedb34a9845bb876bb0217d55cb4f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.871558 25722 leader_election.cc:304] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:17.883585 26079 leader_election.cc:290] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:17.884202 26049 raft_consensus.cc:2804] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.884743 26049 raft_consensus.cc:697] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:17.885236 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:17.885571 26049 consensus_queue.cc:237] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:17.886677 25871 leader_election.cc:343] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.886960 26025 tablet_bootstrap.cc:654] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.888525 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.880074 26024 raft_consensus.cc:740] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.900228 26039 raft_consensus.cc:493] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.904000 26056 raft_consensus.cc:493] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.892239 25833 raft_consensus.cc:2468] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
W20260709 13:21:17.912696 25872 leader_election.cc:343] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.913709 26056 raft_consensus.cc:515] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.910555 26039 raft_consensus.cc:515] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:17.916356 26056 leader_election.cc:290] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:17.917274 25797 consensus_peers.cc:597] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c -> Peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Couldn't send request to peer 33e3240923e54438a22da49413055ab3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.917531 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:17.914083 25872 leader_election.cc:304] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:17.919041 26085 raft_consensus.cc:2749] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.916600 26039 leader_election.cc:290] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:17.920737 26024 consensus_queue.cc:260] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:17.921296 26031 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.923452 26024 ts_tablet_manager.cc:1434] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:21:17.924568 26024 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:17.931242 25946 leader_election.cc:304] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
W20260709 13:21:17.931694 25945 leader_election.cc:343] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.937955 26023 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:17.938470 26023 ts_tablet_manager.cc:1403] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.012s
I20260709 13:21:17.933694 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:17.934195 25655 catalog_manager.cc:5697] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.924582 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
W20260709 13:21:17.941681 25946 leader_election.cc:343] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.942025 25832 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.937970 26050 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.945160 26050 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.946992 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:17.948241 26050 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:17.940739 26039 raft_consensus.cc:2804] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.947038 26026 tablet_bootstrap.cc:654] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.948779 26031 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
W20260709 13:21:17.949270 25871 leader_election.cc:343] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.950568 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:17.949802 25654 catalog_manager.cc:5697] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.951256 25907 raft_consensus.cc:2468] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:17.953198 25722 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:17.954275 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:17.955856 25723 leader_election.cc:343] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.956933 26024 tablet_bootstrap.cc:654] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.958334 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771eedb34a9845bb876bb0217d55cb4f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:17.959172 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
W20260709 13:21:17.960378 25947 leader_election.cc:343] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.960625 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:17.948868 26039 raft_consensus.cc:493] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.963447 26050 raft_consensus.cc:2804] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.968212 26050 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.970044 26050 raft_consensus.cc:3060] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.971055 26023 raft_consensus.cc:359] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.971767 26023 raft_consensus.cc:385] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.972033 26023 raft_consensus.cc:740] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
W20260709 13:21:17.967470 25947 leader_election.cc:343] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.973996 25947 leader_election.cc:304] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:17.974346 25832 raft_consensus.cc:2468] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:17.967197 26039 raft_consensus.cc:3060] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.975553 25872 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:17.966313 25756 raft_consensus.cc:2468] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:17.977033 26050 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:17.977944 25947 leader_election.cc:304] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:17.979116 26050 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:17.980190 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:17.981755 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:17.982309 25907 raft_consensus.cc:3060] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:17.985517 25723 leader_election.cc:343] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.977131 26056 raft_consensus.cc:2749] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.986922 26031 raft_consensus.cc:2804] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.991961 26031 raft_consensus.cc:697] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:17.992816 26056 raft_consensus.cc:2804] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.993793 26056 raft_consensus.cc:493] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.994191 26056 raft_consensus.cc:3060] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.992823 26031 consensus_queue.cc:237] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:17.972743 26023 consensus_queue.cc:260] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.001212 26025 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:18.001840 26025 ts_tablet_manager.cc:1403] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.131s	user 0.032s	sys 0.030s
I20260709 13:21:18.013088 26025 raft_consensus.cc:359] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.013989 26025 raft_consensus.cc:385] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.014328 26025 raft_consensus.cc:740] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.015393 26025 consensus_queue.cc:260] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.020640 26026 tablet_bootstrap.cc:492] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:18.021240 26026 ts_tablet_manager.cc:1403] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.222s	user 0.011s	sys 0.007s
I20260709 13:21:18.024907 26026 raft_consensus.cc:359] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.025609 26026 raft_consensus.cc:385] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.027436 26026 raft_consensus.cc:740] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.027882 26025 ts_tablet_manager.cc:1434] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:21:18.028129 26026 consensus_queue.cc:260] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.029320 26025 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
W20260709 13:21:18.031098 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 53251.3us
I20260709 13:21:18.031906 26026 ts_tablet_manager.cc:1434] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:21:18.032078 26056 raft_consensus.cc:515] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.033263 26026 tablet_bootstrap.cc:492] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:18.034108 25907 raft_consensus.cc:2468] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:18.035403 26023 ts_tablet_manager.cc:1434] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260709 13:21:18.035387 25722 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:18.035693 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:18.036288 25756 raft_consensus.cc:3060] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.036665 26023 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.036934 26050 raft_consensus.cc:2804] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.037607 26050 raft_consensus.cc:697] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:18.038481 26050 consensus_queue.cc:237] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.043048 26023 tablet_bootstrap.cc:654] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.034142 26056 leader_election.cc:290] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.050558 26100 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.051061 26100 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.059806 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.061057 26026 tablet_bootstrap.cc:654] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.053581 26100 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:18.063825 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.064468 25757 raft_consensus.cc:2468] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:18.065552 25947 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:18.066473 26056 raft_consensus.cc:2804] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.066890 26056 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.067303 26056 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.066584 25656 catalog_manager.cc:5697] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.061022 26039 raft_consensus.cc:515] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:18.068960 25946 leader_election.cc:343] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.069819 26095 raft_consensus.cc:493] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.070320 26095 raft_consensus.cc:515] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.070843 26092 raft_consensus.cc:493] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.071318 26024 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:18.071331 26092 raft_consensus.cc:515] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.071873 25832 raft_consensus.cc:3060] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.071964 26024 ts_tablet_manager.cc:1403] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.052s
I20260709 13:21:18.072372 26095 leader_election.cc:290] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:18.073648 26092 leader_election.cc:290] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.074275 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:18.075207 26024 raft_consensus.cc:359] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.075923 26024 raft_consensus.cc:385] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.076193 26024 raft_consensus.cc:740] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.076527 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.077194 25906 raft_consensus.cc:2468] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:18.078933 25797 leader_election.cc:304] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:18.079991 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.080278 26025 tablet_bootstrap.cc:654] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:18.081439 25799 leader_election.cc:343] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.081717 26039 leader_election.cc:290] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:18.082408 26092 raft_consensus.cc:2804] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.083072 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771eedb34a9845bb876bb0217d55cb4f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:18.083724 25833 raft_consensus.cc:3060] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.085191 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771eedb34a9845bb876bb0217d55cb4f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:18.084650 25654 catalog_manager.cc:5697] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.081044 26056 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.088826 25756 raft_consensus.cc:2468] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:18.089068 26092 raft_consensus.cc:493] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.083058 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.091004 26092 raft_consensus.cc:3060] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.093353 26056 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:18.093641 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:18.091297 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:18.094489 25758 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.097100 25947 leader_election.cc:304] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:18.098866 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:18.099874 25833 raft_consensus.cc:2468] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
W20260709 13:21:18.100260 25946 leader_election.cc:343] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.100461 26056 raft_consensus.cc:2804] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.101269 25907 raft_consensus.cc:2393] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
W20260709 13:21:18.097396 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:18.101765 25758 raft_consensus.cc:2468] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:18.101788 25946 leader_election.cc:304] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:18.102516 25797 leader_election.cc:304] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:18.104113 26102 raft_consensus.cc:2804] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.104631 26102 raft_consensus.cc:697] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:18.105474 26102 consensus_queue.cc:237] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.106132 25947 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:18.107756 26100 raft_consensus.cc:2804] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.108317 26100 raft_consensus.cc:697] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:18.109331 26100 consensus_queue.cc:237] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.122171 26026 tablet_bootstrap.cc:492] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:18.122916 26026 ts_tablet_manager.cc:1403] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.005s
I20260709 13:21:18.101804 26056 raft_consensus.cc:697] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:18.090377 26024 consensus_queue.cc:260] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.126439 26037 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.126938 26037 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.127242 25757 raft_consensus.cc:3060] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.128123 26024 ts_tablet_manager.cc:1434] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:21:18.129215 26024 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:18.129525 26037 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.130919 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.131564 25758 raft_consensus.cc:2468] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:18.116364 26095 raft_consensus.cc:2749] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.112702 26092 raft_consensus.cc:515] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.132925 25799 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:18.135990 26031 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.137709 26037 raft_consensus.cc:2804] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.138293 26037 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.138033 26031 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.138758 26037 raft_consensus.cc:3060] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.140268 26031 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:18.141288 26039 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.141968 26039 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.143100 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:18.143846 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.144518 26039 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:18.134503 25945 leader_election.cc:343] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:18.148375 25871 leader_election.cc:343] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:18.145805 25797 leader_election.cc:343] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.149178 26023 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.149626 26023 ts_tablet_manager.cc:1403] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.002s
I20260709 13:21:18.150211 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.152384 26023 raft_consensus.cc:359] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.153944 26023 raft_consensus.cc:385] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.154197 26023 raft_consensus.cc:740] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.155306 26023 consensus_queue.cc:260] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.159124 26023 ts_tablet_manager.cc:1434] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:18.160462 26023 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.163663 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
W20260709 13:21:18.165132 25799 leader_election.cc:343] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.165984 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:18.166860 25907 raft_consensus.cc:3060] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.162001 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.167752 25833 raft_consensus.cc:2393] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:18.168752 26023 tablet_bootstrap.cc:654] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.168987 25946 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:18.159243 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.158915 26105 consensus_queue.cc:1048] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
W20260709 13:21:18.171249 25872 leader_election.cc:343] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.171684 25872 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:18.171787 26039 consensus_queue.cc:1048] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.172951 26031 raft_consensus.cc:2749] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.171710 26105 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.166036 25757 raft_consensus.cc:2468] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:18.187398 26025 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:18.188102 26025 ts_tablet_manager.cc:1403] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.159s	user 0.029s	sys 0.022s
I20260709 13:21:18.193084 26031 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.193782 26031 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.197214 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.197546 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:18.198972 25872 leader_election.cc:343] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:18.199474 25873 leader_election.cc:343] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.199615 26031 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:18.199919 25873 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.201248 26031 raft_consensus.cc:2749] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.200536 26025 raft_consensus.cc:359] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.202791 26025 raft_consensus.cc:385] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.203150 26025 raft_consensus.cc:740] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.204015 26025 consensus_queue.cc:260] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.181038 26092 leader_election.cc:290] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.212108 26025 ts_tablet_manager.cc:1434] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:21:18.161002 26056 consensus_queue.cc:237] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.213122 26025 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:18.215006 25907 raft_consensus.cc:2468] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:18.216244 25797 leader_election.cc:304] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.217463 26092 raft_consensus.cc:2804] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.219089 26025 tablet_bootstrap.cc:654] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.219313 26023 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.219755 26023 ts_tablet_manager.cc:1403] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.059s	user 0.027s	sys 0.019s
I20260709 13:21:18.224272 26023 raft_consensus.cc:359] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.226361 26023 raft_consensus.cc:385] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.226809 26023 raft_consensus.cc:740] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.227830 26023 consensus_queue.cc:260] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.231302 26023 ts_tablet_manager.cc:1434] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:21:18.220583 26092 raft_consensus.cc:697] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:18.232609 26023 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.233212 26092 consensus_queue.cc:237] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.234174 26105 raft_consensus.cc:2749] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.228837 26024 tablet_bootstrap.cc:654] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.234421 26037 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.238989 26026 raft_consensus.cc:359] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.239989 26026 raft_consensus.cc:385] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.240321 26026 raft_consensus.cc:740] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.245082 26026 consensus_queue.cc:260] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.245672 26037 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.249631 26023 tablet_bootstrap.cc:654] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.250937 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
W20260709 13:21:18.252930 25797 leader_election.cc:343] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.246300 25656 catalog_manager.cc:5697] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.246840 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:18.254045 25758 raft_consensus.cc:3060] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.275822 25654 catalog_manager.cc:5697] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.281342 26023 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.281363 26024 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:18.281994 26023 ts_tablet_manager.cc:1403] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.010s
I20260709 13:21:18.282083 26024 ts_tablet_manager.cc:1403] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.007s
I20260709 13:21:18.284658 26023 raft_consensus.cc:359] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.284821 26024 raft_consensus.cc:359] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.285390 26023 raft_consensus.cc:385] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.285665 26024 raft_consensus.cc:385] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.285689 26023 raft_consensus.cc:740] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.286273 26024 raft_consensus.cc:740] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.286899 26023 consensus_queue.cc:260] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.287108 26024 consensus_queue.cc:260] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.289186 26023 ts_tablet_manager.cc:1434] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:18.290102 26023 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.292498 26024 ts_tablet_manager.cc:1434] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:21:18.293254 26050 consensus_queue.cc:1048] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.293596 26024 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:18.295617 26023 tablet_bootstrap.cc:654] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.300675 26024 tablet_bootstrap.cc:654] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.298169 25655 catalog_manager.cc:5697] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.302330 25655 catalog_manager.cc:5697] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.247064 26026 ts_tablet_manager.cc:1434] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.124s	user 0.002s	sys 0.005s
I20260709 13:21:18.307313 26026 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:18.315251 26024 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:18.315831 26024 ts_tablet_manager.cc:1403] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.011s
I20260709 13:21:18.321759 26050 consensus_queue.cc:1048] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.330422 26024 raft_consensus.cc:359] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.331054 26024 raft_consensus.cc:385] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.331360 26024 raft_consensus.cc:740] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.332438 26023 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.332157 26024 consensus_queue.cc:260] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.333019 26023 ts_tablet_manager.cc:1403] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.010s
I20260709 13:21:18.334488 26024 ts_tablet_manager.cc:1434] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:21:18.335542 26024 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:18.335846 26023 raft_consensus.cc:359] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.336539 26023 raft_consensus.cc:385] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.336824 26023 raft_consensus.cc:740] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.337601 26023 consensus_queue.cc:260] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.339161 26023 ts_tablet_manager.cc:1434] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:18.340152 26023 tablet_bootstrap.cc:492] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.342479 26024 tablet_bootstrap.cc:654] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.345995 26023 tablet_bootstrap.cc:654] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.352257 26026 tablet_bootstrap.cc:654] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.354759 26024 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:18.355379 26024 ts_tablet_manager.cc:1403] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:21:18.358613 26023 tablet_bootstrap.cc:492] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.359124 26023 ts_tablet_manager.cc:1403] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:21:18.358901 26024 raft_consensus.cc:359] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.359573 26024 raft_consensus.cc:385] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.360231 26024 raft_consensus.cc:740] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.361047 26024 consensus_queue.cc:260] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.362252 26023 raft_consensus.cc:359] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.362953 26023 raft_consensus.cc:385] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.363277 26023 raft_consensus.cc:740] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.363483 26025 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:18.363981 26025 ts_tablet_manager.cc:1403] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.151s	user 0.029s	sys 0.038s
I20260709 13:21:18.364127 26023 consensus_queue.cc:260] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.366473 26024 ts_tablet_manager.cc:1434] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:21:18.366580 26025 raft_consensus.cc:359] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.366568 26023 ts_tablet_manager.cc:1434] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:18.367439 26025 raft_consensus.cc:385] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.367588 26024 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:18.367993 26025 raft_consensus.cc:740] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.368613 26023 tablet_bootstrap.cc:492] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.368909 26100 raft_consensus.cc:493] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.369376 26100 raft_consensus.cc:515] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.371186 25757 raft_consensus.cc:3060] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.371368 26100 leader_election.cc:290] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.373188 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.374869 25832 raft_consensus.cc:2468] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:18.376125 25946 leader_election.cc:304] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:18.377794 26100 raft_consensus.cc:2804] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.378175 26100 raft_consensus.cc:493] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.378516 26100 raft_consensus.cc:3060] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.368818 26025 consensus_queue.cc:260] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.380791 26025 ts_tablet_manager.cc:1434] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:18.381474 26024 tablet_bootstrap.cc:654] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.383491 26026 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:18.383996 26026 ts_tablet_manager.cc:1403] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 13:21:18.386656 26026 raft_consensus.cc:359] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.387311 26026 raft_consensus.cc:385] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.387573 26026 raft_consensus.cc:740] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.387633 26023 tablet_bootstrap.cc:654] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.388288 26025 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:18.389298 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.389417 26092 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.389984 25906 raft_consensus.cc:2468] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:18.390017 26092 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.392315 26092 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.392108 26100 raft_consensus.cc:515] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.394575 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.395011 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:18.395439 25756 raft_consensus.cc:2393] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:18.395386 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:18.396965 26026 consensus_queue.cc:260] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.397559 25797 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.397806 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:18.398452 25906 raft_consensus.cc:3060] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.399046 26026 ts_tablet_manager.cc:1434] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:21:18.399209 26122 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.399386 26100 leader_election.cc:290] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.400051 26026 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:18.399749 26122 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.405126 25758 raft_consensus.cc:2468] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:18.406728 26122 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.395623 25832 raft_consensus.cc:3060] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.411425 26026 tablet_bootstrap.cc:654] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.413264 25799 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:18.415221 26037 raft_consensus.cc:2804] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.415685 26056 raft_consensus.cc:493] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.416229 26056 raft_consensus.cc:515] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.416682 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.415709 26037 raft_consensus.cc:697] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:18.417896 26037 consensus_queue.cc:237] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.418363 26056 leader_election.cc:290] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:18.418562 25906 raft_consensus.cc:2468] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:18.420768 26095 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.400475 26092 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.404426 26031 consensus_queue.cc:1048] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.421311 26095 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.421625 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.421311 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.423426 26095 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:18.418684 25723 leader_election.cc:343] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.423153 25945 leader_election.cc:304] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:18.425189 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.425386 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.425498 26056 raft_consensus.cc:2804] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.426107 25906 raft_consensus.cc:2393] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:18.426884 25946 leader_election.cc:304] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.427876 26100 raft_consensus.cc:2749] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.400481 26025 tablet_bootstrap.cc:654] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.428998 26056 raft_consensus.cc:697] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:18.423892 25907 raft_consensus.cc:2468] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:18.430236 26056 consensus_queue.cc:237] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.431135 25722 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:18.431914 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.432317 26122 raft_consensus.cc:2804] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.432680 26122 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.433054 26122 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.433642 25799 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.434875 26095 raft_consensus.cc:3060] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.439149 25832 raft_consensus.cc:2468] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:18.440732 26122 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.454198 26023 tablet_bootstrap.cc:492] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.454770 26023 ts_tablet_manager.cc:1403] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.003s
I20260709 13:21:18.455988 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:18.456787 26092 raft_consensus.cc:2749] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.454198 26024 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
W20260709 13:21:18.457207 25723 leader_election.cc:343] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.457705 26024 ts_tablet_manager.cc:1403] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.003s
I20260709 13:21:18.457585 26023 raft_consensus.cc:359] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.458384 26023 raft_consensus.cc:385] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.458684 26023 raft_consensus.cc:740] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.459442 26023 consensus_queue.cc:260] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.459980 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:18.460809 25906 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.461570 26023 ts_tablet_manager.cc:1434] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:18.462453 26023 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.462958 26024 raft_consensus.cc:359] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.463599 26024 raft_consensus.cc:385] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.463852 26024 raft_consensus.cc:740] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.464926 26024 consensus_queue.cc:260] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.466818 26024 ts_tablet_manager.cc:1434] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:18.468014 26026 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:18.468474 26026 ts_tablet_manager.cc:1403] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.020s
I20260709 13:21:18.462400 26095 raft_consensus.cc:2749] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.465935 26122 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.474932 26082 consensus_queue.cc:1048] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.480528 26023 tablet_bootstrap.cc:654] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.482441 26026 raft_consensus.cc:359] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.488674 26026 raft_consensus.cc:385] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.489001 26026 raft_consensus.cc:740] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.489796 26026 consensus_queue.cc:260] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.483856 26024 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:18.498075 26122 consensus_queue.cc:1048] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.504076 26026 ts_tablet_manager.cc:1434] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:21:18.506304 26026 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:18.507854 26025 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:18.508383 26025 ts_tablet_manager.cc:1403] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.006s
I20260709 13:21:18.508961 25906 raft_consensus.cc:2468] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:18.512006 25722 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:18.512403 26026 tablet_bootstrap.cc:654] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.512533 26025 raft_consensus.cc:359] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.513334 26025 raft_consensus.cc:385] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.513613 26025 raft_consensus.cc:740] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.513971 26122 raft_consensus.cc:2804] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.514480 26122 raft_consensus.cc:697] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:18.514274 26025 consensus_queue.cc:260] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.515319 26122 consensus_queue.cc:237] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.528466 26025 ts_tablet_manager.cc:1434] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:21:18.530498 26025 tablet_bootstrap.cc:492] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:18.542186 26024 tablet_bootstrap.cc:654] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.529299 26031 consensus_queue.cc:1048] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:21:18.543443 26082 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.545130 26082 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.545822 26037 raft_consensus.cc:493] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.546327 26037 raft_consensus.cc:515] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.550419 26082 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.550676 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.551893 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:18.553015 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.548693 26037 leader_election.cc:290] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:18.561153 25799 leader_election.cc:343] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.561467 25757 raft_consensus.cc:2393] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:18.561259 26049 consensus_queue.cc:1048] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.534808 26100 consensus_queue.cc:1048] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:21:18.561254 25981 raft_consensus.cc:2468] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:18.555348 25655 catalog_manager.cc:5697] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.565277 25797 leader_election.cc:304] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.560513 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.559341 25656 catalog_manager.cc:5697] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.567924 26092 raft_consensus.cc:493] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.567094 26037 raft_consensus.cc:2804] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.569145 26037 raft_consensus.cc:493] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.566968 26031 consensus_queue.cc:1048] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:18.569533 26037 raft_consensus.cc:3060] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.568599 26092 raft_consensus.cc:515] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.579650 25872 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.579895 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.580922 26031 raft_consensus.cc:3060] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:18.581362 25799 leader_election.cc:343] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.583436 26092 leader_election.cc:290] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.584723 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:18.586393 25797 leader_election.cc:343] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.586939 25797 leader_election.cc:304] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.587903 26092 raft_consensus.cc:2749] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.596225 26025 tablet_bootstrap.cc:654] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.588724 25652 catalog_manager.cc:5697] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.600606 26026 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:18.602185 26023 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.605595 26023 ts_tablet_manager.cc:1403] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.143s	user 0.023s	sys 0.016s
I20260709 13:21:18.605648 26026 ts_tablet_manager.cc:1403] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.100s	user 0.024s	sys 0.003s
I20260709 13:21:18.604624 26031 raft_consensus.cc:2749] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.629155 26122 raft_consensus.cc:493] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.629400 26056 consensus_queue.cc:1048] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.629760 26122 raft_consensus.cc:515] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.604297 26037 raft_consensus.cc:515] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.632838 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.639638 26024 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:18.640266 26024 ts_tablet_manager.cc:1403] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.021s
I20260709 13:21:18.640631 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:18.641857 25980 raft_consensus.cc:3060] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.641489 26100 consensus_queue.cc:1048] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.641451 26026 raft_consensus.cc:359] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.643774 26023 raft_consensus.cc:359] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.644594 26023 raft_consensus.cc:385] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.644181 26026 raft_consensus.cc:385] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.645749 26026 raft_consensus.cc:740] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.644968 26023 raft_consensus.cc:740] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.649483 26026 consensus_queue.cc:260] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.649582 26023 consensus_queue.cc:260] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.655750 26026 ts_tablet_manager.cc:1434] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:21:18.656697 26026 tablet_bootstrap.cc:492] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:18.658337 26023 ts_tablet_manager.cc:1434] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:21:18.653487 26056 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.659910 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.659852 26056 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.660733 25907 raft_consensus.cc:2393] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:18.662022 26056 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.662118 25722 leader_election.cc:304] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:18.664508 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.666613 26023 tablet_bootstrap.cc:492] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.671623 26056 consensus_queue.cc:1048] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:18.672117 25947 leader_election.cc:343] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.673501 26049 raft_consensus.cc:3060] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.674569 26147 raft_consensus.cc:493] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.678188 26147 raft_consensus.cc:515] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.681811 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:18.682859 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.680619 26147 leader_election.cc:290] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.683044 25905 raft_consensus.cc:3060] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.683115 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.653862 26122 leader_election.cc:290] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.684069 25756 raft_consensus.cc:2393] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
W20260709 13:21:18.689880 25799 leader_election.cc:343] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:18.690762 25945 leader_election.cc:343] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.691359 25945 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.688411 26024 raft_consensus.cc:359] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.693156 26024 raft_consensus.cc:385] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.694651 26024 raft_consensus.cc:740] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.692852 26049 raft_consensus.cc:2749] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.675015 26037 leader_election.cc:290] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.696835 26023 tablet_bootstrap.cc:654] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.697038 26026 tablet_bootstrap.cc:654] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.695753 26024 consensus_queue.cc:260] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.698985 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:18.700050 26025 tablet_bootstrap.cc:492] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:18.700517 26025 ts_tablet_manager.cc:1403] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.011s
I20260709 13:21:18.695722 26056 raft_consensus.cc:2749] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.701586 25873 leader_election.cc:304] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.704057 26024 ts_tablet_manager.cc:1434] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 13:21:18.704769 26024 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:18.722347 26025 raft_consensus.cc:359] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.723034 26025 raft_consensus.cc:385] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.723327 26025 raft_consensus.cc:740] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.726662 26025 consensus_queue.cc:260] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.728279 26147 raft_consensus.cc:2749] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.731801 26056 consensus_queue.cc:1048] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.738338 26025 ts_tablet_manager.cc:1434] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:21:18.741065 26025 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:18.742247 25980 raft_consensus.cc:2468] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:18.743911 25797 leader_election.cc:304] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.746639 26025 tablet_bootstrap.cc:654] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.747025 26092 raft_consensus.cc:2804] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.747560 26092 raft_consensus.cc:697] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:18.748440 26092 consensus_queue.cc:237] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.751773 26024 tablet_bootstrap.cc:654] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.753124 26095 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.762002 26026 tablet_bootstrap.cc:492] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:18.762521 26026 ts_tablet_manager.cc:1403] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.106s	user 0.006s	sys 0.013s
I20260709 13:21:18.765349 26026 raft_consensus.cc:359] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.766006 26026 raft_consensus.cc:385] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.766273 26026 raft_consensus.cc:740] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.753800 26095 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:18.766944 26026 consensus_queue.cc:260] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.768693 26095 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:18.769086 26026 ts_tablet_manager.cc:1434] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:18.769912 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
W20260709 13:21:18.771297 25799 leader_election.cc:343] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.771379 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:18.772338 26026 tablet_bootstrap.cc:492] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
W20260709 13:21:18.772751 25797 leader_election.cc:343] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.773212 25797 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:18.781533 26026 tablet_bootstrap.cc:654] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.779337 26095 raft_consensus.cc:2749] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.790504 26023 tablet_bootstrap.cc:492] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.791117 26023 ts_tablet_manager.cc:1403] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.014s
I20260709 13:21:18.799371 26023 raft_consensus.cc:359] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.800047 26023 raft_consensus.cc:385] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.800429 26023 raft_consensus.cc:740] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.801492 26023 consensus_queue.cc:260] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.807349 26023 ts_tablet_manager.cc:1434] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:21:18.808583 26023 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:18.811832 26100 raft_consensus.cc:493] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.812537 26100 raft_consensus.cc:515] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.812913 26146 raft_consensus.cc:493] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.813406 26146 raft_consensus.cc:515] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.814757 26100 leader_election.cc:290] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.815397 26146 leader_election.cc:290] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:18.816587 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.817293 25906 raft_consensus.cc:2468] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:18.818461 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.820716 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:18.821362 25758 raft_consensus.cc:2468] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:18.823988 26023 tablet_bootstrap.cc:654] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.826138 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:18.826813 25833 raft_consensus.cc:2468] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:18.829511 26026 tablet_bootstrap.cc:492] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:18.830062 26026 ts_tablet_manager.cc:1403] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.011s
I20260709 13:21:18.831679 26092 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.832266 26092 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.833112 26100 consensus_queue.cc:1048] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.828365 25873 leader_election.cc:304] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:18.835975 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:18.836642 26146 raft_consensus.cc:2804] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.835073 26026 raft_consensus.cc:359] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.837426 26026 raft_consensus.cc:385] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.837724 26026 raft_consensus.cc:740] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.818500 25945 leader_election.cc:304] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:18.838713 26024 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:18.837077 26146 raft_consensus.cc:493] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.845826 26146 raft_consensus.cc:3060] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.838900 26092 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:18.842743 26024 ts_tablet_manager.cc:1403] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.020s
I20260709 13:21:18.850446 26025 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:18.850772 26024 raft_consensus.cc:359] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.851238 26025 ts_tablet_manager.cc:1403] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.110s	user 0.006s	sys 0.015s
I20260709 13:21:18.851598 26024 raft_consensus.cc:385] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.851974 26024 raft_consensus.cc:740] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.841315 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:18.852834 26024 consensus_queue.cc:260] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.854820 26024 ts_tablet_manager.cc:1434] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:18.855718 26095 consensus_queue.cc:1048] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.856105 26024 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:18.857901 25981 raft_consensus.cc:3060] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.845471 26026 consensus_queue.cc:260] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.860289 25980 raft_consensus.cc:2468] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:18.860225 26025 raft_consensus.cc:359] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.861025 26025 raft_consensus.cc:385] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:18.859393 25946 leader_election.cc:343] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.861323 26025 raft_consensus.cc:740] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
W20260709 13:21:18.862182 25797 leader_election.cc:343] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.862021 26025 consensus_queue.cc:260] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:18.866889 26026 ts_tablet_manager.cc:1434] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:21:18.872907 26025 ts_tablet_manager.cc:1434] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:18.874334 26025 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:18.866428 26100 raft_consensus.cc:2804] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.882382 26100 raft_consensus.cc:493] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.882742 26100 raft_consensus.cc:3060] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.887784 26026 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:18.889544 25797 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:18.890558 26159 raft_consensus.cc:2804] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.890924 26159 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.891260 26159 raft_consensus.cc:3060] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.891394 26049 raft_consensus.cc:493] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.891952 26049 raft_consensus.cc:515] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.894049 26049 leader_election.cc:290] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.895200 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:18.875157 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 56751.8us
W20260709 13:21:18.896832 25722 leader_election.cc:343] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.899155 26095 consensus_queue.cc:1048] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.901773 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:18.903659 25723 leader_election.cc:343] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.904286 25723 leader_election.cc:304] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:18.905629 26049 raft_consensus.cc:2749] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.837067 25652 catalog_manager.cc:5697] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.920244 26100 raft_consensus.cc:515] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.922464 26100 leader_election.cc:290] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:18.923179 26146 raft_consensus.cc:515] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:18.924506 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:18.925705 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:18.926123 26095 consensus_queue.cc:1048] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.935142 25906 raft_consensus.cc:3060] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:18.938478 25946 leader_election.cc:343] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.940270 26100 consensus_queue.cc:1048] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.942651 26159 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.944830 26159 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:18.946184 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:18.946808 25980 raft_consensus.cc:3060] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.949378 26026 tablet_bootstrap.cc:654] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.951889 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
W20260709 13:21:18.961726 25797 leader_election.cc:343] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.963507 25906 raft_consensus.cc:2468] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:18.964805 25945 leader_election.cc:304] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:18.965255 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:18.965862 25756 raft_consensus.cc:3060] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.966009 26023 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:18.966496 26023 ts_tablet_manager.cc:1403] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.047s
I20260709 13:21:18.967172 26100 raft_consensus.cc:2804] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.968221 26100 raft_consensus.cc:697] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:18.969319 26100 consensus_queue.cc:237] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:18.974102 26049 consensus_queue.cc:1048] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.991937 25980 raft_consensus.cc:2468] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:18.993410 25797 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:18.995472 26092 raft_consensus.cc:2804] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.996001 26092 raft_consensus.cc:697] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:19.002033 26092 consensus_queue.cc:237] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.018760 26105 consensus_queue.cc:1048] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.021492 26159 consensus_queue.cc:1048] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.022544 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:19.023361 25831 raft_consensus.cc:3060] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.033932 26023 raft_consensus.cc:359] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.035688 26023 raft_consensus.cc:385] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.036384 26023 raft_consensus.cc:740] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.041816 26024 tablet_bootstrap.cc:654] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.042452 26023 consensus_queue.cc:260] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.012388 26146 leader_election.cc:290] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.050021 25756 raft_consensus.cc:2468] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:19.053519 26025 tablet_bootstrap.cc:654] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.040688 26095 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.055663 26023 ts_tablet_manager.cc:1434] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 13:21:19.054989 26095 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.061136 25873 leader_election.cc:304] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.066620 26023 tablet_bootstrap.cc:492] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:19.063484 26146 raft_consensus.cc:2804] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.074100 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.074617 26146 raft_consensus.cc:697] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:19.074839 25902 raft_consensus.cc:2468] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:19.084079 26095 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.075555 26146 consensus_queue.cc:237] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.085377 25797 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:19.091646 26023 tablet_bootstrap.cc:654] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.098964 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.099978 26170 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:19.103729 25797 leader_election.cc:343] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.108206 26024 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.108734 26024 ts_tablet_manager.cc:1403] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.253s	user 0.003s	sys 0.014s
I20260709 13:21:19.111402 26024 raft_consensus.cc:359] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.112109 26024 raft_consensus.cc:385] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.100647 26170 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.112385 26024 raft_consensus.cc:740] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.091966 26095 raft_consensus.cc:2804] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.114441 26095 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.114809 26095 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.117060 26024 consensus_queue.cc:260] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.122936 26026 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:19.123032 25832 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.123574 26024 ts_tablet_manager.cc:1434] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:21:19.123634 26026 ts_tablet_manager.cc:1403] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.236s	user 0.029s	sys 0.034s
I20260709 13:21:19.126223 26170 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:19.126546 26024 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.127054 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.128058 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.130072 26026 raft_consensus.cc:359] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:19.130755 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:19.131017 26026 raft_consensus.cc:385] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.132839 25797 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:19.128172 26105 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.147874 26026 raft_consensus.cc:740] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.149302 26024 tablet_bootstrap.cc:654] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.150214 26105 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.157579 26122 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.158241 26122 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.162720 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.160740 26122 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.150018 26026 consensus_queue.cc:260] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.165184 26170 raft_consensus.cc:2749] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.167487 26122 consensus_queue.cc:1048] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.167615 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.168637 25981 raft_consensus.cc:2468] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
W20260709 13:21:19.169464 25945 leader_election.cc:343] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.167331 26026 ts_tablet_manager.cc:1434] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:21:19.174355 26095 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.175971 26025 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:19.176422 26025 ts_tablet_manager.cc:1403] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.302s	user 0.019s	sys 0.012s
I20260709 13:21:19.179121 26025 raft_consensus.cc:359] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.179744 26025 raft_consensus.cc:385] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.180001 26025 raft_consensus.cc:740] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.173944 26026 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:19.184075 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.172567 26105 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:19.195670 26025 consensus_queue.cc:260] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.195876 25722 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.196089 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.197429 25831 raft_consensus.cc:2468] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:19.198026 26146 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.205860 26146 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.208304 25905 raft_consensus.cc:2468] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
W20260709 13:21:19.204574 25947 leader_election.cc:343] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.209259 25947 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:19.210594 26049 raft_consensus.cc:2804] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.211081 26049 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.213503 26049 raft_consensus.cc:3060] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.218480 26105 raft_consensus.cc:2749] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.226184 26095 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
W20260709 13:21:19.254366 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 50198us
I20260709 13:21:19.241072 26049 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.258816 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.259483 25981 raft_consensus.cc:2468] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:19.254705 26026 tablet_bootstrap.cc:654] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.255149 26151 raft_consensus.cc:493] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.243691 25652 catalog_manager.cc:5697] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:19.256019 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 51494.6us
I20260709 13:21:19.257273 26024 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.258033 26146 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:19.262732 26024 ts_tablet_manager.cc:1403] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.025s
I20260709 13:21:19.260103 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:19.260759 26151 raft_consensus.cc:515] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:19.261386 25722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 51661.4us
I20260709 13:21:19.265009 25871 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:19.265981 26024 raft_consensus.cc:359] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.266383 25905 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.266697 26024 raft_consensus.cc:385] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.266958 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.267063 26024 raft_consensus.cc:740] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.267825 25755 raft_consensus.cc:2393] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:19.267940 26024 consensus_queue.cc:260] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.270267 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:19.270327 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:19.271019 25981 raft_consensus.cc:3060] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.271425 26023 tablet_bootstrap.cc:492] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:19.271941 26023 ts_tablet_manager.cc:1403] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.210s	user 0.014s	sys 0.001s
I20260709 13:21:19.272390 26151 leader_election.cc:290] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.279232 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:19.281348 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.282039 25830 raft_consensus.cc:2468] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:19.283145 26025 ts_tablet_manager.cc:1434] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.006s
I20260709 13:21:19.280016 25905 raft_consensus.cc:2468] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:19.264055 26049 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.281556 26024 ts_tablet_manager.cc:1434] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
W20260709 13:21:19.283226 25797 leader_election.cc:343] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.285787 26025 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:19.285744 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.286357 26024 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.283895 25872 leader_election.cc:304] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:19.283622 25655 catalog_manager.cc:5697] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.291169 26025 tablet_bootstrap.cc:654] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.292423 26024 tablet_bootstrap.cc:654] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.284231 26023 raft_consensus.cc:359] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.303689 26023 raft_consensus.cc:385] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.304147 26023 raft_consensus.cc:740] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.306386 26023 consensus_queue.cc:260] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.304947 26151 raft_consensus.cc:2804] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.307802 26151 raft_consensus.cc:493] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.306740 25654 catalog_manager.cc:5697] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.308171 26151 raft_consensus.cc:3060] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.309384 26023 ts_tablet_manager.cc:1434] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:21:19.310396 26023 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:19.305269 25797 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:19.279919 26146 raft_consensus.cc:2804] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.313817 26146 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.314229 26146 raft_consensus.cc:3060] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:19.314512 25799 consensus_peers.cc:597] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:19.316402 26023 tablet_bootstrap.cc:654] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.316802 26170 raft_consensus.cc:2804] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.317332 26170 raft_consensus.cc:697] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:19.318158 26170 consensus_queue.cc:237] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:19.325155 25873 leader_election.cc:343] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.279304 25981 raft_consensus.cc:2468] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:19.329774 26167 consensus_queue.cc:1048] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.342974 25722 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.345242 26049 raft_consensus.cc:2804] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.345964 26049 raft_consensus.cc:697] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:19.347057 26049 consensus_queue.cc:237] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.362350 26024 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.362859 26024 ts_tablet_manager.cc:1403] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.029s
I20260709 13:21:19.365201 26024 raft_consensus.cc:359] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.365806 26024 raft_consensus.cc:385] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.366055 26024 raft_consensus.cc:740] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.366745 26024 consensus_queue.cc:260] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.367071 26151 raft_consensus.cc:515] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.368533 26026 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:19.369037 26026 ts_tablet_manager.cc:1403] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.197s	user 0.013s	sys 0.011s
I20260709 13:21:19.369110 26024 ts_tablet_manager.cc:1434] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:21:19.369863 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:19.370052 26024 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
W20260709 13:21:19.371212 25873 leader_election.cc:343] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.371600 26026 raft_consensus.cc:359] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.372248 26026 raft_consensus.cc:385] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.372489 26026 raft_consensus.cc:740] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.373333 26026 consensus_queue.cc:260] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.375521 26024 tablet_bootstrap.cc:654] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.375533 26026 ts_tablet_manager.cc:1434] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:19.376840 26026 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:19.383806 26026 tablet_bootstrap.cc:654] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.386559 26049 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.387197 26049 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.389575 26024 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.389863 26049 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.390486 26024 ts_tablet_manager.cc:1403] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:21:19.391682 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.392057 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.392313 25981 raft_consensus.cc:2468] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:19.393518 26024 raft_consensus.cc:359] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:19.393736 25722 leader_election.cc:343] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.394635 25722 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:19.395656 26026 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:19.395756 26024 raft_consensus.cc:385] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.396235 26026 ts_tablet_manager.cc:1403] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:21:19.396205 26024 raft_consensus.cc:740] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.395684 26049 raft_consensus.cc:2804] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.397451 26049 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.397121 26024 consensus_queue.cc:260] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.397794 26049 raft_consensus.cc:3060] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.399487 26024 ts_tablet_manager.cc:1434] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:21:19.400460 26024 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.405053 26049 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.405977 26024 tablet_bootstrap.cc:654] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.407123 26049 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.408206 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:19.408962 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:19.408630 25655 catalog_manager.cc:5697] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.409444 25981 raft_consensus.cc:3060] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:19.410970 25722 leader_election.cc:343] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.411234 26026 raft_consensus.cc:359] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.412037 26026 raft_consensus.cc:385] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.412349 26026 raft_consensus.cc:740] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.413085 26026 consensus_queue.cc:260] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.415493 26026 ts_tablet_manager.cc:1434] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:19.415659 26024 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.416141 26024 ts_tablet_manager.cc:1403] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:21:19.416426 26026 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:19.417210 25981 raft_consensus.cc:2468] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:19.418440 25722 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:19.356444 26146 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.418540 26024 raft_consensus.cc:359] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.419207 26024 raft_consensus.cc:385] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.419485 26024 raft_consensus.cc:740] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.419636 25906 raft_consensus.cc:2393] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:19.420146 26024 consensus_queue.cc:260] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.422503 26024 ts_tablet_manager.cc:1434] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:19.423358 26024 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.419665 26049 raft_consensus.cc:2804] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.429677 26024 tablet_bootstrap.cc:654] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.430225 26049 raft_consensus.cc:697] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:19.431208 26049 consensus_queue.cc:237] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.431164 26026 tablet_bootstrap.cc:654] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.433243 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:19.433863 25830 raft_consensus.cc:3060] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.441212 26024 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.441731 26026 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:19.441859 26024 ts_tablet_manager.cc:1403] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:21:19.442239 26026 ts_tablet_manager.cc:1403] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:21:19.442868 25830 raft_consensus.cc:2468] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:19.445043 26024 raft_consensus.cc:359] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.445708 26024 raft_consensus.cc:385] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.445957 26024 raft_consensus.cc:740] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.446815 26024 consensus_queue.cc:260] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.448673 26024 ts_tablet_manager.cc:1434] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:19.448486 26026 raft_consensus.cc:359] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.449196 26026 raft_consensus.cc:385] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.449484 26026 raft_consensus.cc:740] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.449635 26024 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.450127 26026 consensus_queue.cc:260] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.455503 26026 ts_tablet_manager.cc:1434] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:21:19.456284 26024 tablet_bootstrap.cc:654] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.456442 26026 tablet_bootstrap.cc:492] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:19.456053 25872 leader_election.cc:304] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:19.461521 26031 raft_consensus.cc:2804] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.463516 26031 raft_consensus.cc:697] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:19.464547 26031 consensus_queue.cc:237] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.473740 26151 leader_election.cc:290] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.474697 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:19.475504 26146 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:19.385325 25656 catalog_manager.cc:5697] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.482787 25830 raft_consensus.cc:3060] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.483980 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:19.487087 26176 raft_consensus.cc:493] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.492517 26025 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:19.500746 26025 ts_tablet_manager.cc:1403] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.215s	user 0.011s	sys 0.002s
I20260709 13:21:19.501142 26023 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:19.500562 26176 raft_consensus.cc:515] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.501627 26023 ts_tablet_manager.cc:1403] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.191s	user 0.078s	sys 0.047s
I20260709 13:21:19.503602 26025 raft_consensus.cc:359] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.504249 26025 raft_consensus.cc:385] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.504168 26023 raft_consensus.cc:359] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.499325 26170 consensus_queue.cc:1048] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.505038 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.505730 26023 raft_consensus.cc:385] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.506042 26023 raft_consensus.cc:740] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.505901 25755 raft_consensus.cc:2468] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:19.506526 26026 tablet_bootstrap.cc:654] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.504598 26025 raft_consensus.cc:740] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
W20260709 13:21:19.498689 25797 consensus_peers.cc:597] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:19.507920 26025 consensus_queue.cc:260] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.508368 25947 leader_election.cc:304] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.509776 26025 ts_tablet_manager.cc:1434] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:19.510650 26025 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:19.511102 26100 raft_consensus.cc:2804] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.511479 26100 raft_consensus.cc:493] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.511804 26100 raft_consensus.cc:3060] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.513121 26023 consensus_queue.cc:260] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.513434 26056 consensus_queue.cc:1048] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.515486 26023 ts_tablet_manager.cc:1434] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:21:19.516371 26023 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:19.521998 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:19.523285 25946 leader_election.cc:343] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.526630 26023 tablet_bootstrap.cc:654] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.523443 26025 tablet_bootstrap.cc:654] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.522163 26176 leader_election.cc:290] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.533120 26100 raft_consensus.cc:515] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.551143 26176 consensus_queue.cc:1048] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.556376 26100 leader_election.cc:290] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.556560 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:19.560452 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:19.561149 25755 raft_consensus.cc:3060] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.542096 26023 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:19.572423 26023 ts_tablet_manager.cc:1403] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.000s
I20260709 13:21:19.576064 26023 raft_consensus.cc:359] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.535941 25979 raft_consensus.cc:2393] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:19.576977 26023 raft_consensus.cc:385] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.577417 26023 raft_consensus.cc:740] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.544718 26025 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:19.578097 25755 raft_consensus.cc:2468] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:19.578569 26025 ts_tablet_manager.cc:1403] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.002s
W20260709 13:21:19.562383 25946 leader_election.cc:343] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.581941 26025 raft_consensus.cc:359] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.582623 26025 raft_consensus.cc:385] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.562577 26024 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.582906 26025 raft_consensus.cc:740] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.583020 25871 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:19.583436 26024 ts_tablet_manager.cc:1403] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.134s	user 0.047s	sys 0.058s
I20260709 13:21:19.583710 26025 consensus_queue.cc:260] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.565742 26100 raft_consensus.cc:493] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.584673 26031 raft_consensus.cc:2749] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.571547 26049 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.585423 26049 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.586285 26024 raft_consensus.cc:359] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.586668 26025 ts_tablet_manager.cc:1434] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:19.586519 25947 leader_election.cc:304] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:19.586957 26024 raft_consensus.cc:385] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.587245 26024 raft_consensus.cc:740] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.587577 26049 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.587704 26176 raft_consensus.cc:2804] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.587833 26024 consensus_queue.cc:260] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.588282 26176 raft_consensus.cc:697] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:19.589282 26176 consensus_queue.cc:237] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.590014 26024 ts_tablet_manager.cc:1434] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:19.591014 26025 tablet_bootstrap.cc:492] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:19.590927 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.591650 25831 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:19.592842 25723 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.593163 26100 raft_consensus.cc:515] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.594174 26122 raft_consensus.cc:2804] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.594537 26122 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.594904 26122 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.595346 26100 leader_election.cc:290] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.547200 26026 tablet_bootstrap.cc:492] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:19.597671 26024 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.596976 26023 consensus_queue.cc:260] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.609017 26023 ts_tablet_manager.cc:1434] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:21:19.602068 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.610562 25831 raft_consensus.cc:2468] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:19.610026 25654 catalog_manager.cc:5697] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.598119 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.612596 25757 raft_consensus.cc:2468] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:19.613404 26023 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:19.599125 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.613852 25946 leader_election.cc:304] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:19.614998 26100 raft_consensus.cc:2804] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.615403 26100 raft_consensus.cc:493] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.615749 26100 raft_consensus.cc:3060] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.614574 25979 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:19.617462 26024 tablet_bootstrap.cc:654] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.601313 26146 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.621414 26146 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.621563 25652 catalog_manager.cc:5697] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.626327 26025 tablet_bootstrap.cc:654] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.627213 26023 tablet_bootstrap.cc:654] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.627766 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.628412 25757 raft_consensus.cc:2468] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:19.629594 25873 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.630959 26151 raft_consensus.cc:2804] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.631351 26151 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.631783 26151 raft_consensus.cc:3060] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.643697 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.644523 26024 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.645057 26024 ts_tablet_manager.cc:1403] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.001s
I20260709 13:21:19.648335 26024 raft_consensus.cc:359] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.648973 26024 raft_consensus.cc:385] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.649243 26024 raft_consensus.cc:740] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
W20260709 13:21:19.649492 25871 leader_election.cc:343] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.649904 26024 consensus_queue.cc:260] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.601450 26026 ts_tablet_manager.cc:1403] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.000s
I20260709 13:21:19.624138 26146 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:19.655272 26122 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.658172 26024 ts_tablet_manager.cc:1434] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:19.658689 26146 consensus_queue.cc:1048] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.659189 26024 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.659528 26031 consensus_queue.cc:1048] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.660730 26026 raft_consensus.cc:359] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.661654 26026 raft_consensus.cc:385] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.661998 26026 raft_consensus.cc:740] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.662858 26026 consensus_queue.cc:260] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.667635 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:19.673048 25979 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.680548 26049 raft_consensus.cc:493] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.681190 26049 raft_consensus.cc:515] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.683346 26049 leader_election.cc:290] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:19.667316 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:19.685091 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.685451 25830 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.686067 25831 raft_consensus.cc:2393] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:19.687969 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.667728 26122 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.689555 25722 leader_election.cc:304] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:19.672293 26024 tablet_bootstrap.cc:654] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.692039 26122 raft_consensus.cc:3060] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.700992 25979 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:19.702590 25722 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.703765 26049 raft_consensus.cc:2804] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.704725 26049 raft_consensus.cc:697] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:19.705843 26049 consensus_queue.cc:237] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.706110 26100 raft_consensus.cc:515] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.709491 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:19.710217 25757 raft_consensus.cc:3060] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.671348 26026 ts_tablet_manager.cc:1434] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:21:19.712531 26025 tablet_bootstrap.cc:492] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:19.713042 26025 ts_tablet_manager.cc:1403] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.122s	user 0.049s	sys 0.008s
I20260709 13:21:19.715764 26025 raft_consensus.cc:359] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.716404 26025 raft_consensus.cc:385] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.712543 26026 tablet_bootstrap.cc:492] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:19.718047 25757 raft_consensus.cc:2468] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:19.719024 25830 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:19.719328 25947 leader_election.cc:304] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.720224 26056 raft_consensus.cc:2804] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.720311 26050 raft_consensus.cc:493] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.720979 26056 raft_consensus.cc:697] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:19.721158 26050 raft_consensus.cc:515] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.722050 26056 consensus_queue.cc:237] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.725513 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.728173 26050 leader_election.cc:290] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.729457 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.732388 25723 leader_election.cc:304] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:19.733850 26050 raft_consensus.cc:2749] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.671657 26151 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.735414 26026 tablet_bootstrap.cc:654] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.716671 26025 raft_consensus.cc:740] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.737821 26025 consensus_queue.cc:260] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.743490 26023 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:19.744021 26023 ts_tablet_manager.cc:1403] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.131s	user 0.035s	sys 0.051s
I20260709 13:21:19.744565 26025 ts_tablet_manager.cc:1434] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:21:19.746733 26122 raft_consensus.cc:2749] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.747536 26024 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.748453 26105 raft_consensus.cc:493] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.748286 26023 raft_consensus.cc:359] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.749047 26105 raft_consensus.cc:515] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.749286 26023 raft_consensus.cc:385] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.748395 26024 ts_tablet_manager.cc:1403] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.010s
I20260709 13:21:19.749922 26023 raft_consensus.cc:740] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.750928 26023 consensus_queue.cc:260] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.753540 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.753952 26023 ts_tablet_manager.cc:1434] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:21:19.754665 26026 tablet_bootstrap.cc:492] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
W20260709 13:21:19.754935 25945 leader_election.cc:343] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.755179 26026 ts_tablet_manager.cc:1403] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.002s
I20260709 13:21:19.755357 26023 tablet_bootstrap.cc:492] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:19.755713 26105 leader_election.cc:290] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:19.749555 26025 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:19.752630 26024 raft_consensus.cc:359] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.763911 26024 raft_consensus.cc:385] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.764199 26024 raft_consensus.cc:740] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.764487 26023 tablet_bootstrap.cc:654] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.765123 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.766004 26026 raft_consensus.cc:359] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:19.766413 25946 leader_election.cc:343] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.766678 26026 raft_consensus.cc:385] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.766980 26026 raft_consensus.cc:740] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.766863 25946 leader_election.cc:304] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:19.767962 26105 raft_consensus.cc:2749] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.771258 26025 tablet_bootstrap.cc:654] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.773375 26024 consensus_queue.cc:260] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.775503 26024 ts_tablet_manager.cc:1434] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 13:21:19.776434 26024 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.778491 26026 consensus_queue.cc:260] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.780546 26026 ts_tablet_manager.cc:1434] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:21:19.781399 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
W20260709 13:21:19.783362 25871 leader_election.cc:343] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.788376 26026 tablet_bootstrap.cc:492] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:19.800287 26024 tablet_bootstrap.cc:654] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.809399 26023 tablet_bootstrap.cc:492] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:19.809862 26026 tablet_bootstrap.cc:654] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.810037 26023 ts_tablet_manager.cc:1403] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.035s
I20260709 13:21:19.815323 26023 raft_consensus.cc:359] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.815989 26023 raft_consensus.cc:385] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.816277 26023 raft_consensus.cc:740] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.816828 26037 consensus_queue.cc:1048] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.816977 26023 consensus_queue.cc:260] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.817713 26151 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:19.819422 26023 ts_tablet_manager.cc:1434] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:19.820495 26023 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:19.823282 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:19.827479 26023 tablet_bootstrap.cc:654] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.825230 26024 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.828233 26024 ts_tablet_manager.cc:1403] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 13:21:19.827387 25755 raft_consensus.cc:3060] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.833683 26024 raft_consensus.cc:359] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.834438 26024 raft_consensus.cc:385] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.834702 26024 raft_consensus.cc:740] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.835307 25656 catalog_manager.cc:5697] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.839725 26023 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:19.840185 26023 ts_tablet_manager.cc:1403] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 13:21:19.843392 25979 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.835351 26024 consensus_queue.cc:260] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.848253 26024 ts_tablet_manager.cc:1434] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:21:19.848318 26031 raft_consensus.cc:493] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.848838 26031 raft_consensus.cc:515] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.849267 26024 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.850514 26151 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.850865 26031 leader_election.cc:290] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.850989 26151 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.852619 26167 consensus_queue.cc:1048] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.854909 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.855464 26023 raft_consensus.cc:359] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.856128 26023 raft_consensus.cc:385] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.856400 26023 raft_consensus.cc:740] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.857017 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.861886 25758 raft_consensus.cc:3060] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.863557 26026 tablet_bootstrap.cc:492] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:19.864028 26026 ts_tablet_manager.cc:1403] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.000s
I20260709 13:21:19.865662 25755 raft_consensus.cc:2468] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:19.857054 26023 consensus_queue.cc:260] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.866961 25873 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:19.858151 26167 raft_consensus.cc:493] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.868750 26023 ts_tablet_manager.cc:1434] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:21:19.869391 26146 raft_consensus.cc:2804] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.870115 26023 tablet_bootstrap.cc:492] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:19.870025 26146 raft_consensus.cc:697] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:19.870596 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:19.859216 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.868544 26167 raft_consensus.cc:515] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.871167 26146 consensus_queue.cc:237] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:19.873492 25830 raft_consensus.cc:2468] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:19.857136 26151 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.871176 25831 raft_consensus.cc:3060] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.875460 26167 leader_election.cc:290] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:19.876500 26023 tablet_bootstrap.cc:654] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.876799 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.877483 25755 raft_consensus.cc:2468] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:19.878473 25799 leader_election.cc:304] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.879508 26167 raft_consensus.cc:2804] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.879926 26167 raft_consensus.cc:493] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.880309 26167 raft_consensus.cc:3060] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.881350 25871 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:19.881695 25872 leader_election.cc:304] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:19.882454 26031 raft_consensus.cc:2749] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.883306 26031 raft_consensus.cc:2804] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.883755 26031 raft_consensus.cc:493] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.884197 26031 raft_consensus.cc:3060] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.887383 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.892159 25831 raft_consensus.cc:2468] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:19.869517 26100 leader_election.cc:290] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.894305 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.895185 25757 raft_consensus.cc:2468] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:19.898902 26025 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:19.899415 26025 ts_tablet_manager.cc:1403] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.150s	user 0.022s	sys 0.008s
I20260709 13:21:19.900740 26049 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.901265 26049 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.902047 26025 raft_consensus.cc:359] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.902688 26025 raft_consensus.cc:385] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.902944 26025 raft_consensus.cc:740] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.867305 26024 tablet_bootstrap.cc:654] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.904222 26049 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:19.905542 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.906183 25833 raft_consensus.cc:2468] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:19.796092 25652 catalog_manager.cc:5697] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.907487 25723 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:19.908546 26049 raft_consensus.cc:2804] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.908989 26049 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.909718 26049 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.866775 26026 raft_consensus.cc:359] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.910845 26026 raft_consensus.cc:385] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.911242 26026 raft_consensus.cc:740] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.916216 26026 consensus_queue.cc:260] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.916957 26025 consensus_queue.cc:260] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.919369 26025 ts_tablet_manager.cc:1434] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 13:21:19.922111 26024 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:19.923321 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.924386 26024 ts_tablet_manager.cc:1403] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.000s
W20260709 13:21:19.924628 25722 leader_election.cc:343] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.927462 26024 raft_consensus.cc:359] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.928133 26024 raft_consensus.cc:385] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.928416 26024 raft_consensus.cc:740] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.928563 26212 consensus_queue.cc:1048] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.929207 26025 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:19.932404 26026 ts_tablet_manager.cc:1434] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:21:19.933792 26024 consensus_queue.cc:260] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.923853 26031 raft_consensus.cc:515] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.935230 25906 raft_consensus.cc:2393] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:19.936183 26024 ts_tablet_manager.cc:1434] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:19.941289 26049 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.941843 26122 consensus_queue.cc:1048] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.944823 26095 raft_consensus.cc:493] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.945376 26095 raft_consensus.cc:515] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:19.947425 26095 leader_election.cc:290] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.949776 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.950421 25979 raft_consensus.cc:2468] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:19.951467 25797 leader_election.cc:304] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:19.952481 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:19.953372 26170 raft_consensus.cc:2804] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:19.953842 25797 leader_election.cc:343] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.953804 26170 raft_consensus.cc:493] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.954484 26170 raft_consensus.cc:3060] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.965266 26026 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:19.966790 26122 consensus_queue.cc:1048] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.968526 26212 raft_consensus.cc:493] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.969059 26212 raft_consensus.cc:515] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.972671 26095 raft_consensus.cc:493] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.973160 26095 raft_consensus.cc:515] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:19.975203 26095 leader_election.cc:290] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:19.975453 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.976259 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:19.977095 25756 raft_consensus.cc:2393] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:19.977250 26170 raft_consensus.cc:515] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:19.977484 25873 leader_election.cc:343] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.979313 26170 leader_election.cc:290] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:19.981333 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:19.981959 25978 raft_consensus.cc:3060] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.972244 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:19.990931 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:19.992475 25833 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.941601 25655 catalog_manager.cc:5697] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.944355 26025 tablet_bootstrap.cc:654] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.887712 26167 raft_consensus.cc:515] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:19.944597 26024 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:19.986657 26212 leader_election.cc:290] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:19.997089 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:19.997391 26056 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.001024 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:19.999974 26146 consensus_queue.cc:1048] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:21:20.009763 25872 leader_election.cc:343] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.015187 25872 leader_election.cc:304] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:20.016865 26212 raft_consensus.cc:2749] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.020867 26024 tablet_bootstrap.cc:654] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.021096 25797 leader_election.cc:304] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:20.013278 26031 leader_election.cc:290] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:20.007308 26056 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.027498 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:20.028805 25946 leader_election.cc:343] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.029883 26056 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:20.030669 25833 raft_consensus.cc:2468] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:20.031958 25723 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:20.032371 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:20.033071 25756 raft_consensus.cc:3060] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.037070 26050 raft_consensus.cc:2804] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.037607 26050 raft_consensus.cc:697] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:20.038425 26050 consensus_queue.cc:237] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.012804 26049 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:20.057271 26023 tablet_bootstrap.cc:492] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:20.057881 26023 ts_tablet_manager.cc:1403] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.188s	user 0.033s	sys 0.037s
I20260709 13:21:20.054401 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:20.044836 26170 raft_consensus.cc:3060] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.054759 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:20.043256 25978 raft_consensus.cc:2468] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
W20260709 13:21:20.065421 25797 leader_election.cc:343] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.070990 26177 consensus_queue.cc:1048] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:20.071242 25797 leader_election.cc:304] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:20.073235 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
W20260709 13:21:20.073387 25945 leader_election.cc:343] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.074043 25831 raft_consensus.cc:2393] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:20.073871 25945 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:20.075109 26100 raft_consensus.cc:2749] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.075300 25756 raft_consensus.cc:2468] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:20.076293 25902 raft_consensus.cc:3060] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.076812 25799 leader_election.cc:304] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:20.076323 26092 raft_consensus.cc:2804] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.077745 26037 raft_consensus.cc:2804] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.078256 26037 raft_consensus.cc:697] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:20.079056 26037 consensus_queue.cc:237] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.079485 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:20.080545 25906 raft_consensus.cc:2393] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:20.083843 26026 tablet_bootstrap.cc:654] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.067026 26049 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.097245 26025 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:20.067351 26167 leader_election.cc:290] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:20.108201 26122 raft_consensus.cc:493] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.106274 26025 ts_tablet_manager.cc:1403] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.186s	user 0.031s	sys 0.022s
I20260709 13:21:20.102094 26092 raft_consensus.cc:697] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:20.108968 26049 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.117828 26049 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:20.118187 26025 raft_consensus.cc:359] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.118848 26025 raft_consensus.cc:385] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.119093 26025 raft_consensus.cc:740] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.105501 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:20.108683 26122 raft_consensus.cc:515] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.121505 25653 catalog_manager.cc:5697] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.122889 26122 leader_election.cc:290] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:20.124457 26056 consensus_queue.cc:1048] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.125005 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:20.126628 26170 raft_consensus.cc:2749] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:20.126777 25723 leader_election.cc:343] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.114279 26023 raft_consensus.cc:359] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.128811 26023 raft_consensus.cc:385] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.128662 26025 consensus_queue.cc:260] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.129221 26023 raft_consensus.cc:740] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.136778 26023 consensus_queue.cc:260] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.141662 26023 ts_tablet_manager.cc:1434] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 13:21:20.144773 26092 consensus_queue.cc:237] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.150189 26025 ts_tablet_manager.cc:1434] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:21:20.151211 26025 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:20.153306 26024 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:20.155269 26024 ts_tablet_manager.cc:1403] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.217s	user 0.021s	sys 0.000s
I20260709 13:21:20.160655 26026 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:20.161432 26026 ts_tablet_manager.cc:1403] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.005s
I20260709 13:21:20.177659 26026 raft_consensus.cc:359] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.178869 26026 raft_consensus.cc:385] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.179209 26026 raft_consensus.cc:740] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.177861 26170 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.181422 26170 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.183887 26170 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:20.184734 26023 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:20.184645 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:20.186230 26105 consensus_queue.cc:1048] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:20.191646 26025 tablet_bootstrap.cc:654] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:20.192435 25797 leader_election.cc:343] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.185925 26026 consensus_queue.cc:260] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.188221 26056 consensus_queue.cc:1048] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:20.189467 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:20.194743 25978 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:20.196185 25797 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:20.197932 26023 tablet_bootstrap.cc:654] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.199862 26235 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.200268 26235 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.200611 26235 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:20.200937 25722 consensus_peers.cc:597] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:20.201861 25722 leader_election.cc:343] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.203868 25873 leader_election.cc:304] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:20.204653 26146 raft_consensus.cc:2749] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.211794 26026 ts_tablet_manager.cc:1434] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.002s
I20260709 13:21:20.214355 26026 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:20.241869 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:20.242661 25905 raft_consensus.cc:2468] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:20.246619 26024 raft_consensus.cc:359] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.248713 26024 raft_consensus.cc:385] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.249090 26024 raft_consensus.cc:740] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.249982 26024 consensus_queue.cc:260] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.257514 26024 ts_tablet_manager.cc:1434] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 13:21:20.258530 26024 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:20.266633 25722 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:20.271826 26050 raft_consensus.cc:2804] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.272249 26050 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.272570 26050 raft_consensus.cc:3060] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.266826 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:20.281499 25977 raft_consensus.cc:2468] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:20.281771 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:20.287514 26100 consensus_queue.cc:1048] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.288120 26235 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.302790 25655 catalog_manager.cc:5697] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.306348 26049 consensus_queue.cc:1048] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.306758 26023 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:20.307452 26023 ts_tablet_manager.cc:1403] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.023s
I20260709 13:21:20.300756 26026 tablet_bootstrap.cc:654] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.316442 26050 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.323535 26050 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:20.318493 26025 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:20.327997 26024 tablet_bootstrap.cc:654] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.328972 26025 ts_tablet_manager.cc:1403] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.178s	user 0.029s	sys 0.013s
I20260709 13:21:20.320662 26023 raft_consensus.cc:359] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.329761 26023 raft_consensus.cc:385] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:20.323530 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:20.330116 26023 raft_consensus.cc:740] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.331209 26023 consensus_queue.cc:260] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.332597 26050 consensus_queue.cc:1048] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.337186 26105 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.337736 26105 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.331760 26025 raft_consensus.cc:359] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.344045 26025 raft_consensus.cc:385] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.335309 26023 ts_tablet_manager.cc:1434] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:21:20.344344 26025 raft_consensus.cc:740] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.345453 26025 consensus_queue.cc:260] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.347071 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
W20260709 13:21:20.349721 25797 leader_election.cc:343] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.350920 26025 ts_tablet_manager.cc:1434] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
W20260709 13:21:20.345283 25722 leader_election.cc:343] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.352171 25981 raft_consensus.cc:3060] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.354833 26023 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:20.356252 26025 tablet_bootstrap.cc:492] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:20.368283 26024 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:20.368814 26024 ts_tablet_manager.cc:1403] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.111s	user 0.021s	sys 0.000s
I20260709 13:21:20.370342 26235 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:20.371925 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:20.372526 25978 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.373296 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:20.360657 25722 leader_election.cc:304] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:20.376354 26049 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.376839 26049 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.377283 26177 raft_consensus.cc:2749] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.378974 26049 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:20.379683 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:20.380489 25757 raft_consensus.cc:2393] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:20.376367 26105 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:20.380985 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:20.381637 25830 raft_consensus.cc:2468] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:20.383539 25723 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:20.384558 25945 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:20.386886 26105 raft_consensus.cc:2749] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.385175 26226 consensus_queue.cc:1048] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:20.390817 26025 tablet_bootstrap.cc:654] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.384831 26177 raft_consensus.cc:2804] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.393298 26177 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.393669 26177 raft_consensus.cc:3060] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.398667 26026 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:20.399248 26026 ts_tablet_manager.cc:1403] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.185s	user 0.013s	sys 0.010s
I20260709 13:21:20.399896 26023 tablet_bootstrap.cc:654] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.400306 26024 raft_consensus.cc:359] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.401013 26024 raft_consensus.cc:385] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.401355 26024 raft_consensus.cc:740] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.402752 26024 consensus_queue.cc:260] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.398587 25978 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:20.405906 25797 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:20.407107 26235 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.407608 26235 raft_consensus.cc:697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:20.407959 26026 raft_consensus.cc:359] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.408993 26026 raft_consensus.cc:385] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.409121 26024 ts_tablet_manager.cc:1434] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:21:20.408777 26235 consensus_queue.cc:237] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.409494 26026 raft_consensus.cc:740] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.410359 26026 consensus_queue.cc:260] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.412508 26026 ts_tablet_manager.cc:1434] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:21:20.413863 26024 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:20.415283 25653 catalog_manager.cc:5697] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.422148 26026 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:20.432721 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:20.433508 25902 raft_consensus.cc:3060] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.429445 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:20.435719 25977 raft_consensus.cc:3060] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.440037 25653 catalog_manager.cc:5697] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.443265 26023 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:20.443984 26023 ts_tablet_manager.cc:1403] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.003s
I20260709 13:21:20.446060 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:20.446753 25979 raft_consensus.cc:2468] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:20.447636 26023 raft_consensus.cc:359] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.448349 26023 raft_consensus.cc:385] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.448597 26023 raft_consensus.cc:740] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.449479 26023 consensus_queue.cc:260] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.452270 26023 ts_tablet_manager.cc:1434] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:20.452518 26025 tablet_bootstrap.cc:492] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:20.453258 26023 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:20.453189 26025 ts_tablet_manager.cc:1403] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.000s
I20260709 13:21:20.459863 26226 consensus_queue.cc:1048] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.462558 26025 raft_consensus.cc:359] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.463325 26025 raft_consensus.cc:385] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.463613 26025 raft_consensus.cc:740] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.464366 26025 consensus_queue.cc:260] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.467535 26025 ts_tablet_manager.cc:1434] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:21:20.468467 26025 tablet_bootstrap.cc:492] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:20.470891 25977 raft_consensus.cc:2468] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:20.474017 26177 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.475513 25902 raft_consensus.cc:2468] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:20.478384 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:20.478998 25832 raft_consensus.cc:3060] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.477895 25722 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:20.480002 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:20.480203 26049 raft_consensus.cc:2804] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.480620 25980 raft_consensus.cc:3060] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.480711 26049 raft_consensus.cc:697] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:20.481967 26049 consensus_queue.cc:237] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.484329 26177 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:20.487140 26023 tablet_bootstrap.cc:654] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.494907 26177 consensus_queue.cc:1048] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.497527 26024 tablet_bootstrap.cc:654] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.503810 26146 raft_consensus.cc:493] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.504488 26146 raft_consensus.cc:515] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.633538 26235 consensus_queue.cc:1048] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.637576 26167 consensus_queue.cc:1048] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:20.640308 26031 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.641026 26031 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.645125 26235 raft_consensus.cc:493] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.652697 26177 raft_consensus.cc:493] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.653414 26177 raft_consensus.cc:515] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.669868 26167 consensus_queue.cc:1048] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.740948 26235 raft_consensus.cc:515] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.758318 26025 tablet_bootstrap.cc:654] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.759689 26235 leader_election.cc:290] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:20.763370 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
W20260709 13:21:20.765537 25799 leader_election.cc:343] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.768062 25832 raft_consensus.cc:2468] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:20.768474 26177 leader_election.cc:290] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:20.769299 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:20.769856 26031 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:20.772029 26026 tablet_bootstrap.cc:654] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.772607 26177 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:20.772917 25723 leader_election.cc:343] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.773257 26177 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.773461 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:20.761340 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 91362.8us
I20260709 13:21:20.785480 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:20.786267 25906 raft_consensus.cc:2468] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:20.788587 25906 raft_consensus.cc:3060] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.797989 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:20.775646 25980 raft_consensus.cc:2468] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:20.778107 26146 leader_election.cc:290] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:20.804973 25655 catalog_manager.cc:5697] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:20.810525 26177 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
W20260709 13:21:20.831489 25871 leader_election.cc:343] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.835392 25723 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:20.837152 26177 raft_consensus.cc:2804] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.837790 26177 raft_consensus.cc:697] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:20.838922 26177 consensus_queue.cc:237] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.845130 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:20.853068 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:20.854031 25755 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:20.862004 25797 leader_election.cc:304] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:20.863222 26263 raft_consensus.cc:2804] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.863775 26263 raft_consensus.cc:493] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.864187 26263 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.869144 26235 consensus_queue.cc:1048] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:20.892343 25797 consensus_peers.cc:597] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.889182 25871 leader_election.cc:304] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
W20260709 13:21:20.876446 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 109037us
I20260709 13:21:20.920639 26023 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:20.921141 26023 ts_tablet_manager.cc:1403] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.468s	user 0.045s	sys 0.081s
I20260709 13:21:20.925066 26026 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:20.925601 26026 ts_tablet_manager.cc:1403] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.504s	user 0.018s	sys 0.038s
I20260709 13:21:20.928247 26026 raft_consensus.cc:359] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.928961 26026 raft_consensus.cc:385] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.929232 26026 raft_consensus.cc:740] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.930070 26026 consensus_queue.cc:260] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.929337 26023 raft_consensus.cc:359] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.933651 26023 raft_consensus.cc:385] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.933916 26024 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:20.933969 26023 raft_consensus.cc:740] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.934542 26024 ts_tablet_manager.cc:1403] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.521s	user 0.060s	sys 0.074s
I20260709 13:21:20.932641 25655 catalog_manager.cc:5697] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.935166 26031 raft_consensus.cc:2749] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.938174 26025 tablet_bootstrap.cc:492] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:20.938696 26025 ts_tablet_manager.cc:1403] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.470s	user 0.013s	sys 0.006s
I20260709 13:21:20.930394 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:20.941653 26025 raft_consensus.cc:359] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.943365 26025 raft_consensus.cc:385] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.943269 26026 ts_tablet_manager.cc:1434] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:20.944171 26025 raft_consensus.cc:740] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.945186 26026 tablet_bootstrap.cc:492] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:20.944851 26025 consensus_queue.cc:260] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.948231 26024 raft_consensus.cc:359] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.949057 26024 raft_consensus.cc:385] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.949379 26024 raft_consensus.cc:740] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.948266 26025 ts_tablet_manager.cc:1434] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:21:20.950702 26024 consensus_queue.cc:260] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:20.953136 26026 tablet_bootstrap.cc:654] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.953554 26024 ts_tablet_manager.cc:1434] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 13:21:20.953549 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:20.954421 25904 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:20.954872 26024 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:20.961167 26024 tablet_bootstrap.cc:654] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.965046 26023 consensus_queue.cc:260] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:20.974783 26263 raft_consensus.cc:515] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:20.977144 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:20.991346 26026 tablet_bootstrap.cc:492] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:20.978492 25873 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:20.991904 26026 ts_tablet_manager.cc:1403] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.020s
I20260709 13:21:20.992717 26263 leader_election.cc:290] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:20.993310 26151 raft_consensus.cc:2804] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.993798 26151 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.994119 26151 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.994652 26026 raft_consensus.cc:359] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.995378 26026 raft_consensus.cc:385] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.995668 26026 raft_consensus.cc:740] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.996474 26026 consensus_queue.cc:260] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:20.997221 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:20.998288 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:20.986270 26235 consensus_queue.cc:1048] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.999123 26026 ts_tablet_manager.cc:1434] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:20.988492 26025 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
W20260709 13:21:20.999907 25799 leader_election.cc:343] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.000070 26026 tablet_bootstrap.cc:492] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:21.000695 25902 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.003515 26177 raft_consensus.cc:493] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.004019 26177 raft_consensus.cc:515] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:20.985391 25722 consensus_peers.cc:597] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.998559 26024 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:21.005932 26024 ts_tablet_manager.cc:1403] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:21:21.007009 26023 ts_tablet_manager.cc:1434] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:21:21.008002 26023 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:21.008582 26177 leader_election.cc:290] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:21.015451 25652 catalog_manager.cc:5697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:21.010756 26024 raft_consensus.cc:359] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.021677 26024 raft_consensus.cc:385] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.021956 26024 raft_consensus.cc:740] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.022727 26024 consensus_queue.cc:260] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.023943 25722 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:21.024552 26024 ts_tablet_manager.cc:1434] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:21:21.024554 26025 tablet_bootstrap.cc:654] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.025573 26024 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:21.027787 26177 raft_consensus.cc:2804] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.028213 26177 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.028553 26177 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:21.033250 25722 leader_election.cc:343] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.033789 25722 leader_election.cc:304] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:21.035137 26026 tablet_bootstrap.cc:654] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.018807 26151 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.037832 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:21.038115 26024 tablet_bootstrap.cc:654] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:21.039378 25871 leader_election.cc:343] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.045270 26050 raft_consensus.cc:2749] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.049160 26024 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:21.049738 26024 ts_tablet_manager.cc:1403] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 13:21:21.053793 25902 raft_consensus.cc:2468] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:21.055333 25797 leader_election.cc:304] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:21.056411 26151 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:21.056624 26235 raft_consensus.cc:2804] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.057197 26235 raft_consensus.cc:697] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:21.058038 26235 consensus_queue.cc:237] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:21.060568 25722 leader_election.cc:343] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.073693 26177 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.064945 26024 raft_consensus.cc:359] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.075158 26024 raft_consensus.cc:385] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.075485 26024 raft_consensus.cc:740] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.075809 26177 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:21.077250 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.077122 26024 consensus_queue.cc:260] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.081220 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:21.085357 26024 ts_tablet_manager.cc:1434] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.003s
I20260709 13:21:21.085405 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:21.086359 25756 raft_consensus.cc:2393] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:21.086547 26024 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:21.087864 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:21.088611 25902 raft_consensus.cc:2393] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:21.090483 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:21.092648 26024 tablet_bootstrap.cc:654] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.092648 25873 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:21.093603 26146 raft_consensus.cc:2749] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.094491 26177 consensus_queue.cc:1048] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:21.094622 25722 leader_election.cc:343] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:21.095522 25722 leader_election.cc:343] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.096029 26268 raft_consensus.cc:493] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:21.096495 25722 leader_election.cc:343] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.096675 26177 consensus_queue.cc:1048] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:21.097033 25722 leader_election.cc:304] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:21.096537 26268 raft_consensus.cc:515] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.098345 26050 raft_consensus.cc:2749] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.099822 25722 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:21.100605 26050 raft_consensus.cc:2749] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.101835 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:21.102504 25756 raft_consensus.cc:2468] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:21.103461 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:21.105506 25947 leader_election.cc:304] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:21.106648 26105 raft_consensus.cc:2804] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.107154 26105 raft_consensus.cc:493] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.107857 26105 raft_consensus.cc:3060] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.112237 26023 tablet_bootstrap.cc:654] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:21.116932 25946 leader_election.cc:343] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.118358 26122 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.118762 26026 tablet_bootstrap.cc:492] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:21.118861 26122 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.122339 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:21.123486 26025 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
W20260709 13:21:21.123809 25723 leader_election.cc:343] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.124043 26025 ts_tablet_manager.cc:1403] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.136s	user 0.020s	sys 0.023s
I20260709 13:21:21.120330 25654 catalog_manager.cc:5697] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:21.126181 26122 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:21.127282 26025 raft_consensus.cc:359] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.128178 26025 raft_consensus.cc:385] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.128525 26025 raft_consensus.cc:740] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.119367 26026 ts_tablet_manager.cc:1403] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.119s	user 0.024s	sys 0.018s
I20260709 13:21:21.130651 26025 consensus_queue.cc:260] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.099817 26268 leader_election.cc:290] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:21.137162 26023 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:21.137660 26023 ts_tablet_manager.cc:1403] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.000s
I20260709 13:21:21.138628 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.140154 26025 ts_tablet_manager.cc:1434] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:21:21.133137 26026 raft_consensus.cc:359] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.141203 26025 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:21.140488 26105 raft_consensus.cc:515] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.145970 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:21.146543 25756 raft_consensus.cc:3060] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.149456 26025 tablet_bootstrap.cc:654] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:21.155347 25722 leader_election.cc:343] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.155694 26026 raft_consensus.cc:385] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.155893 25722 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:21.156054 26026 raft_consensus.cc:740] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.156710 26177 raft_consensus.cc:2749] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.158424 26026 consensus_queue.cc:260] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.161988 26025 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:21.162536 26025 ts_tablet_manager.cc:1403] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:21:21.163267 25756 raft_consensus.cc:2468] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:21.162425 26026 ts_tablet_manager.cc:1434] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:21:21.164839 25947 leader_election.cc:304] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:21.165215 26026 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:21.165656 26268 raft_consensus.cc:2804] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.165771 26025 raft_consensus.cc:359] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.166181 26268 raft_consensus.cc:697] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:21.167336 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:21.167213 26268 consensus_queue.cc:237] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:21.168954 25946 leader_election.cc:343] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.169874 26105 leader_election.cc:290] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:21.170840 26025 raft_consensus.cc:385] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.171216 26025 raft_consensus.cc:740] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.171463 26146 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.171911 26025 consensus_queue.cc:260] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.172164 26146 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.174788 26146 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:21.178236 26025 ts_tablet_manager.cc:1434] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:21:21.180689 26025 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:21.183869 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:21.187314 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:21.140372 26023 raft_consensus.cc:359] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.188959 25871 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:21.189415 26023 raft_consensus.cc:385] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.189815 26023 raft_consensus.cc:740] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.190220 26146 raft_consensus.cc:2749] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.193308 26025 tablet_bootstrap.cc:654] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.200662 26268 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.201207 26268 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.203289 26268 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:21.204859 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.205511 26023 consensus_queue.cc:260] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.206084 25905 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.206348 26026 tablet_bootstrap.cc:654] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.215245 26023 ts_tablet_manager.cc:1434] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.003s
I20260709 13:21:21.216629 26023 tablet_bootstrap.cc:492] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
W20260709 13:21:21.220391 25945 leader_election.cc:343] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.221269 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:21.223250 25946 leader_election.cc:343] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.223860 25946 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:21.232528 26105 raft_consensus.cc:2749] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.248353 26023 tablet_bootstrap.cc:654] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.255653 25653 catalog_manager.cc:5697] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:21.256651 26025 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:21.257329 26025 ts_tablet_manager.cc:1403] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.018s
I20260709 13:21:21.262986 26024 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:21.263657 26024 ts_tablet_manager.cc:1403] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.177s	user 0.015s	sys 0.008s
I20260709 13:21:21.273330 26026 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:21.274117 26026 ts_tablet_manager.cc:1403] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.009s
I20260709 13:21:21.277369 26026 raft_consensus.cc:359] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.279584 26026 raft_consensus.cc:385] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.280004 26026 raft_consensus.cc:740] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.282482 26026 consensus_queue.cc:260] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.293280 26026 ts_tablet_manager.cc:1434] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:21:21.294271 26026 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:21.298364 26023 tablet_bootstrap.cc:492] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:21.298904 26023 ts_tablet_manager.cc:1403] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.012s
I20260709 13:21:21.298573 26024 raft_consensus.cc:359] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.299494 26024 raft_consensus.cc:385] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.299844 26024 raft_consensus.cc:740] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.300560 26024 consensus_queue.cc:260] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.301662 26023 raft_consensus.cc:359] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.302326 26023 raft_consensus.cc:385] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.302625 26024 ts_tablet_manager.cc:1434] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:21:21.302560 26023 raft_consensus.cc:740] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.303355 26023 consensus_queue.cc:260] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.304299 26024 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:21.305671 26023 ts_tablet_manager.cc:1434] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:21.306581 26023 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:21.310529 26024 tablet_bootstrap.cc:654] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.308449 26025 raft_consensus.cc:359] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.311474 26025 raft_consensus.cc:385] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.312156 26023 tablet_bootstrap.cc:654] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.313526 26025 raft_consensus.cc:740] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.314405 26025 consensus_queue.cc:260] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.315780 26025 ts_tablet_manager.cc:1434] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:21:21.316583 26025 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:21.391631 26056 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.402495 26026 tablet_bootstrap.cc:654] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.416577 26268 raft_consensus.cc:493] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.417881 26268 raft_consensus.cc:515] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.422654 26023 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:21.422768 25905 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.426899 26023 ts_tablet_manager.cc:1403] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.001s
I20260709 13:21:21.426791 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.445600 26024 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:21.448598 26037 raft_consensus.cc:493] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.449585 26037 raft_consensus.cc:515] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.452629 26037 leader_election.cc:290] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:21.453989 25945 leader_election.cc:343] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.407871 26056 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.459335 26024 ts_tablet_manager.cc:1403] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.002s
I20260709 13:21:21.422708 26268 leader_election.cc:290] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:21.461880 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.471251 25902 raft_consensus.cc:2393] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:21.460809 26056 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:21.468761 26025 tablet_bootstrap.cc:654] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.562520 26026 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:21.563339 26026 ts_tablet_manager.cc:1403] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.269s	user 0.021s	sys 0.047s
I20260709 13:21:21.573268 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.574157 26026 raft_consensus.cc:359] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.575196 26026 raft_consensus.cc:385] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.576799 26026 raft_consensus.cc:740] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.582401 26031 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.583191 26031 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:21.586946 25797 leader_election.cc:343] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.592985 26023 raft_consensus.cc:359] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.593923 26023 raft_consensus.cc:385] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.594235 26023 raft_consensus.cc:740] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.577790 26026 consensus_queue.cc:260] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.608929 26026 ts_tablet_manager.cc:1434] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:21:21.605839 26023 consensus_queue.cc:260] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.607784 26031 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:21.617458 26023 ts_tablet_manager.cc:1434] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.190s	user 0.005s	sys 0.006s
I20260709 13:21:21.622794 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:21.624018 25755 raft_consensus.cc:2393] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:21.625283 26122 raft_consensus.cc:493] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.626137 26122 raft_consensus.cc:515] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.628511 26294 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:21.628688 25722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 207686us
I20260709 13:21:21.633952 26026 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:21.629416 26294 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.636405 26294 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:21.645895 26026 tablet_bootstrap.cc:654] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.646469 26025 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:21.647279 26025 ts_tablet_manager.cc:1403] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.331s	user 0.011s	sys 0.008s
I20260709 13:21:21.649911 26122 leader_election.cc:290] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:21.664057 26037 raft_consensus.cc:493] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.665309 26037 raft_consensus.cc:515] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.664130 26024 raft_consensus.cc:359] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.669118 26024 raft_consensus.cc:385] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.669529 26024 raft_consensus.cc:740] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.670076 26037 leader_election.cc:290] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:21.670477 26024 consensus_queue.cc:260] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.672785 26024 ts_tablet_manager.cc:1434] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.213s	user 0.002s	sys 0.004s
I20260709 13:21:21.675493 26049 raft_consensus.cc:493] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:21.695744 26298 log.cc:927] Time spent T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:21:21.789121 26049 raft_consensus.cc:515] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.789563 25758 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.795090 26049 leader_election.cc:290] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:21.766810 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:21.658329 26025 raft_consensus.cc:359] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.798871 26025 raft_consensus.cc:385] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.799221 26025 raft_consensus.cc:740] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.799970 26025 consensus_queue.cc:260] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.788328 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:21.801826 26301 consensus_queue.cc:1048] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:21.802196 25756 raft_consensus.cc:2468] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:21.802661 26025 ts_tablet_manager.cc:1434] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.155s	user 0.011s	sys 0.000s
I20260709 13:21:21.804111 26025 tablet_bootstrap.cc:492] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:21.807426 25799 leader_election.cc:304] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:21.808946 26301 raft_consensus.cc:2804] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.809327 26301 raft_consensus.cc:493] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.809681 26301 raft_consensus.cc:3060] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.811697 26025 tablet_bootstrap.cc:654] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.821134 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.822151 25905 raft_consensus.cc:2393] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:21.823910 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:21.828615 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9adacf3baa64bbc9f77334887ac19bd" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.830552 25905 raft_consensus.cc:3060] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:21.842989 25722 leader_election.cc:343] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.843703 25947 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:21.847915 26294 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.820204 26301 raft_consensus.cc:515] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:21.855187 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:21.855381 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:21.855826 25755 raft_consensus.cc:3060] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.856988 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:21.860824 25873 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:21.865052 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:21.865761 25981 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:21.868069 26151 raft_consensus.cc:493] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.869939 26151 raft_consensus.cc:515] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.873756 26026 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:21.874298 26026 ts_tablet_manager.cc:1403] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.242s	user 0.032s	sys 0.004s
I20260709 13:21:21.874331 25797 leader_election.cc:304] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:21.875205 26023 tablet_bootstrap.cc:492] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:21.877851 26026 raft_consensus.cc:359] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.878554 26026 raft_consensus.cc:385] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.878840 26026 raft_consensus.cc:740] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
W20260709 13:21:21.880432 25947 leader_election.cc:343] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.881151 26235 raft_consensus.cc:2804] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.881551 26235 raft_consensus.cc:493] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.881661 26301 leader_election.cc:290] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:21.881956 26235 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.872282 26151 leader_election.cc:290] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:21.879472 26026 consensus_queue.cc:260] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:21.881829 26303 consensus_queue.cc:1048] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:21.888703 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:21.889137 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:21.889478 25903 raft_consensus.cc:3060] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:21.893182 25871 leader_election.cc:343] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.886343 26151 raft_consensus.cc:2749] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.897825 26025 tablet_bootstrap.cc:492] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:21.898347 26025 ts_tablet_manager.cc:1403] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.019s
I20260709 13:21:21.901662 26025 raft_consensus.cc:359] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.902565 26025 raft_consensus.cc:385] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.902913 26025 raft_consensus.cc:740] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.903790 26025 consensus_queue.cc:260] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.906672 26025 ts_tablet_manager.cc:1434] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:21.919945 26023 tablet_bootstrap.cc:654] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.921236 26025 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:21.921886 26294 raft_consensus.cc:2749] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.923080 25755 raft_consensus.cc:2468] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:21.924744 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:21.925452 25907 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:21.926129 26122 consensus_queue.cc:1048] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:21.932631 26026 ts_tablet_manager.cc:1434] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:21:21.934069 26026 tablet_bootstrap.cc:492] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:21.934903 26024 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:21.935549 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:21.930531 25799 leader_election.cc:304] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:21.940173 26303 raft_consensus.cc:2804] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.940728 26303 raft_consensus.cc:697] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:21.941975 26303 consensus_queue.cc:237] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:21.944988 25873 leader_election.cc:343] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.946105 25873 leader_election.cc:304] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:21.948531 26151 raft_consensus.cc:2749] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.952139 26301 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.952993 26301 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.967689 26302 raft_consensus.cc:493] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.968320 26302 raft_consensus.cc:515] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:21.970835 26302 leader_election.cc:290] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:21.983954 26235 raft_consensus.cc:515] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:21.961985 26301 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:21.994542 26235 leader_election.cc:290] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:21.995857 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:21.990355 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:21.996814 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.009689 25979 raft_consensus.cc:2468] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:22.006130 26100 consensus_queue.cc:1048] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.010645 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:22.011281 25978 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.007565 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.023981 25797 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
W20260709 13:21:22.024715 25799 leader_election.cc:343] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.025292 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.026049 26167 raft_consensus.cc:2804] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.026530 26167 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.026739 25753 raft_consensus.cc:2393] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:22.026937 26167 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.031468 26025 tablet_bootstrap.cc:654] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.014463 25905 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.012444 25903 raft_consensus.cc:2468] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:22.058092 25799 leader_election.cc:304] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:22.066586 26024 tablet_bootstrap.cc:654] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.071796 26301 raft_consensus.cc:3060] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.093101 25654 catalog_manager.cc:5697] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.096448 26026 tablet_bootstrap.cc:654] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.108300 26025 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:22.108796 26025 ts_tablet_manager.cc:1403] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.015s
I20260709 13:21:22.108618 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.089038 26167 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.117654 26023 tablet_bootstrap.cc:492] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:22.118139 26023 ts_tablet_manager.cc:1403] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.243s	user 0.018s	sys 0.014s
I20260709 13:21:22.124697 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:22.125385 25977 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.125703 25978 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:22.126782 26023 raft_consensus.cc:359] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.127576 26023 raft_consensus.cc:385] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.127854 26023 raft_consensus.cc:740] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.125414 26025 raft_consensus.cc:359] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.129096 25797 leader_election.cc:304] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:22.129472 26025 raft_consensus.cc:385] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.129825 26025 raft_consensus.cc:740] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.130100 26235 raft_consensus.cc:2804] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.130618 26235 raft_consensus.cc:697] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:22.130554 26025 consensus_queue.cc:260] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.131691 26235 consensus_queue.cc:237] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.128609 26023 consensus_queue.cc:260] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.133800 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9adacf3baa64bbc9f77334887ac19bd" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.132795 26025 ts_tablet_manager.cc:1434] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.001s
I20260709 13:21:22.136736 26023 ts_tablet_manager.cc:1434] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:21:22.137180 26167 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:22.139515 26026 tablet_bootstrap.cc:492] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:22.139719 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:22.142789 26026 ts_tablet_manager.cc:1403] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.008s
I20260709 13:21:22.146571 26024 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:22.147333 26024 ts_tablet_manager.cc:1403] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.213s	user 0.007s	sys 0.009s
I20260709 13:21:22.147601 26023 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:22.152668 26294 raft_consensus.cc:493] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.153424 26294 raft_consensus.cc:515] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.154175 26025 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:22.156332 26294 leader_election.cc:290] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:22.156622 25977 raft_consensus.cc:2468] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:22.157296 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.158017 25797 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:22.159014 26037 raft_consensus.cc:2804] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.159492 26037 raft_consensus.cc:697] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:22.161403 26177 raft_consensus.cc:493] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.161897 26177 raft_consensus.cc:515] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.164014 26177 leader_election.cc:290] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:22.166256 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:22.167407 26301 raft_consensus.cc:2749] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:22.168458 25799 leader_election.cc:343] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:22.168807 25945 leader_election.cc:343] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.171953 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.171890 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.173305 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:22.173547 25722 leader_election.cc:343] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.160455 26037 consensus_queue.cc:237] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:22.174752 25722 leader_election.cc:343] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.174548 26024 raft_consensus.cc:359] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.175483 25722 leader_election.cc:304] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.175923 26024 raft_consensus.cc:385] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.176453 26024 raft_consensus.cc:740] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.176692 26177 raft_consensus.cc:2749] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.178164 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.178818 25757 raft_consensus.cc:2468] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:22.180227 25947 leader_election.cc:304] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.181411 26294 raft_consensus.cc:2804] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.181841 26294 raft_consensus.cc:493] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.182191 26294 raft_consensus.cc:3060] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.177366 26024 consensus_queue.cc:260] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.184095 26026 raft_consensus.cc:359] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.186153 25905 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:22.184806 26026 raft_consensus.cc:385] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.188103 26026 raft_consensus.cc:740] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.189951 26026 consensus_queue.cc:260] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.190723 26025 tablet_bootstrap.cc:654] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.195752 26294 raft_consensus.cc:515] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.199014 26024 ts_tablet_manager.cc:1434] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:21:22.200201 26024 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:22.207290 26286 consensus_queue.cc:1048] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:22.208328 26026 ts_tablet_manager.cc:1434] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 13:21:22.209934 26026 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:22.211501 25723 leader_election.cc:304] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.213053 26177 raft_consensus.cc:2749] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.215318 26024 tablet_bootstrap.cc:654] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.215394 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:22.216281 25753 raft_consensus.cc:3060] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.214306 26294 leader_election.cc:290] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:22.217692 25723 leader_election.cc:343] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.218237 25723 leader_election.cc:304] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.221236 26177 raft_consensus.cc:2749] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.223853 26023 tablet_bootstrap.cc:654] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.227679 25946 leader_election.cc:304] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.228598 26294 raft_consensus.cc:2749] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.232383 25946 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:22.234433 26025 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:22.234395 26100 raft_consensus.cc:2749] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.235529 26025 ts_tablet_manager.cc:1403] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.006s
I20260709 13:21:22.235981 26294 consensus_queue.cc:1048] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:22.222168 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
W20260709 13:21:22.238044 25945 leader_election.cc:343] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.238610 26025 raft_consensus.cc:359] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.239269 25753 raft_consensus.cc:2468] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:22.240584 25947 leader_election.cc:304] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.239306 26025 raft_consensus.cc:385] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.241771 26294 raft_consensus.cc:2804] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.241881 26025 raft_consensus.cc:740] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.242635 26294 raft_consensus.cc:697] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:22.243151 26025 consensus_queue.cc:260] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.243917 26026 tablet_bootstrap.cc:654] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.243939 26294 consensus_queue.cc:237] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.247450 26025 ts_tablet_manager.cc:1434] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:21:22.248521 26025 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:22.249056 26024 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:22.249606 26024 ts_tablet_manager.cc:1403] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.003s
I20260709 13:21:22.252919 26024 raft_consensus.cc:359] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.253643 26024 raft_consensus.cc:385] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.253950 26024 raft_consensus.cc:740] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.255092 26025 tablet_bootstrap.cc:654] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.255136 26024 consensus_queue.cc:260] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.257773 26024 ts_tablet_manager.cc:1434] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:22.258986 26024 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:22.264380 26024 tablet_bootstrap.cc:654] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.299187 26023 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:22.299690 26023 ts_tablet_manager.cc:1403] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.001s
I20260709 13:21:22.302609 26023 raft_consensus.cc:359] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.303045 26026 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:22.303296 26023 raft_consensus.cc:385] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.303581 26026 ts_tablet_manager.cc:1403] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.023s
I20260709 13:21:22.303628 26023 raft_consensus.cc:740] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.304697 26023 consensus_queue.cc:260] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.315223 26023 ts_tablet_manager.cc:1434] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:21:22.317255 26024 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:22.317746 26024 ts_tablet_manager.cc:1403] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.004s
I20260709 13:21:22.321946 26023 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:22.322657 26024 raft_consensus.cc:359] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.323354 26024 raft_consensus.cc:385] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.323630 26024 raft_consensus.cc:740] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.323661 25653 catalog_manager.cc:5697] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.324467 26024 consensus_queue.cc:260] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.328377 26023 tablet_bootstrap.cc:654] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.332134 26024 ts_tablet_manager.cc:1434] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:21:22.333299 26024 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:22.340585 26024 tablet_bootstrap.cc:654] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.346446 26025 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:22.346712 26235 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.346910 26025 ts_tablet_manager.cc:1403] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.007s
I20260709 13:21:22.347254 26235 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.346745 26026 raft_consensus.cc:359] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.348963 26026 raft_consensus.cc:385] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.349210 26026 raft_consensus.cc:740] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.349370 26235 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:22.349771 26025 raft_consensus.cc:359] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.349990 26026 consensus_queue.cc:260] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.350447 26025 raft_consensus.cc:385] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.351161 26025 raft_consensus.cc:740] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.351907 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.352442 26026 ts_tablet_manager.cc:1434] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:21:22.352593 25977 raft_consensus.cc:2468] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:22.353945 25797 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:22.355134 26301 raft_consensus.cc:2804] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.355489 26301 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.355847 26301 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.356387 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:22.357997 25797 leader_election.cc:343] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.355840 26026 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:22.351939 26025 consensus_queue.cc:260] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.370121 26025 ts_tablet_manager.cc:1434] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:21:22.376621 26025 tablet_bootstrap.cc:492] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:22.383512 26037 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.370121 26151 raft_consensus.cc:493] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.384054 26037 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.385664 26024 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:22.386224 26024 ts_tablet_manager.cc:1403] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.003s
I20260709 13:21:22.387341 26026 tablet_bootstrap.cc:654] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.387518 26031 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.388036 26031 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.388425 26025 tablet_bootstrap.cc:654] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.390254 26031 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:22.370134 25654 catalog_manager.cc:5697] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.392328 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.399425 25753 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:22.392279 26235 consensus_queue.cc:1048] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:21:22.403021 25873 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:22.407472 26177 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.408084 26037 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:22.408013 26177 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.409989 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.410761 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:22.411880 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:22.413779 25722 leader_election.cc:343] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.417181 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.417893 25757 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:22.411859 25654 catalog_manager.cc:5697] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:22.410634 25832 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:22.417397 26023 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:22.419215 25799 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:22.419561 26023 ts_tablet_manager.cc:1403] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.018s
I20260709 13:21:22.420347 26167 raft_consensus.cc:2804] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.420790 26167 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.421221 26167 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.385603 26151 raft_consensus.cc:515] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.426776 26151 leader_election.cc:290] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:22.422376 26023 raft_consensus.cc:359] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.427855 26023 raft_consensus.cc:385] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.428807 26023 raft_consensus.cc:740] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.430533 26177 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:22.430974 26301 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.432999 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.433017 26023 consensus_queue.cc:260] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.427089 26031 raft_consensus.cc:2804] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:22.437958 25723 leader_election.cc:343] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.438444 25723 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:22.438962 26023 ts_tablet_manager.cc:1434] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:21:22.440454 26049 raft_consensus.cc:2749] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.441072 26049 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.441454 26049 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.443398 26049 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:22.445465 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.452540 26023 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:22.453413 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.454396 25977 raft_consensus.cc:2393] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:22.455439 25722 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:22.457736 26177 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.459029 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:22.461567 26122 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.462229 26122 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.463790 26023 tablet_bootstrap.cc:654] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.464457 26025 tablet_bootstrap.cc:492] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:22.441504 26024 raft_consensus.cc:359] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.464841 26122 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:22.466359 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:22.467504 25977 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.465010 26025 ts_tablet_manager.cc:1403] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.005s
I20260709 13:21:22.465415 26024 raft_consensus.cc:385] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:22.470470 25797 leader_election.cc:343] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.470749 26024 raft_consensus.cc:740] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.469585 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.437371 26031 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.476169 26031 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.478845 26024 consensus_queue.cc:260] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.471747 26301 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
W20260709 13:21:22.483657 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 70222us
I20260709 13:21:22.491366 26026 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:22.499434 26026 ts_tablet_manager.cc:1403] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.019s
I20260709 13:21:22.502329 26026 raft_consensus.cc:359] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.485378 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.502995 25977 raft_consensus.cc:2468] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
W20260709 13:21:22.487643 25722 leader_election.cc:343] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.503046 26026 raft_consensus.cc:385] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.505059 26026 raft_consensus.cc:740] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.505889 26026 consensus_queue.cc:260] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.506259 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.506836 25797 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.493196 26167 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.508153 26310 raft_consensus.cc:2804] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.508646 26310 raft_consensus.cc:697] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:22.509625 26026 ts_tablet_manager.cc:1434] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:22.509462 26310 consensus_queue.cc:237] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.509696 26167 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:22.511284 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:22.511888 25753 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.502638 26177 raft_consensus.cc:2749] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.514808 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:22.492269 26024 ts_tablet_manager.cc:1434] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.001s
I20260709 13:21:22.497849 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:22.518008 25906 raft_consensus.cc:2468] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:22.521878 25753 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:22.510816 26026 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:22.524340 26024 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:22.495834 26025 raft_consensus.cc:359] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.507066 25757 raft_consensus.cc:2393] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:22.536712 26025 raft_consensus.cc:385] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.533633 25722 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:22.537528 26025 raft_consensus.cc:740] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.540390 26025 consensus_queue.cc:260] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.541941 26026 tablet_bootstrap.cc:654] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.543448 26025 ts_tablet_manager.cc:1434] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 13:21:22.546025 26122 raft_consensus.cc:2804] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.546427 26122 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.546692 26031 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.548328 25905 raft_consensus.cc:2393] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate e0f5cbbd64e14739bd096bf5d7b85828 in this term.
I20260709 13:21:22.535987 25799 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:22.554965 26301 raft_consensus.cc:2804] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.546720 26122 raft_consensus.cc:3060] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.555706 26301 raft_consensus.cc:697] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:22.558861 26301 consensus_queue.cc:237] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.565608 25873 leader_election.cc:304] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:22.566803 26339 raft_consensus.cc:3060] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.549178 26167 consensus_queue.cc:1048] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:21:22.576155 26024 tablet_bootstrap.cc:654] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.579949 26025 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:22.603358 26303 raft_consensus.cc:493] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.604130 26303 raft_consensus.cc:515] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.608686 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.609576 25758 raft_consensus.cc:2468] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:22.613448 26294 raft_consensus.cc:493] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.614028 26294 raft_consensus.cc:515] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.614297 25799 leader_election.cc:304] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:22.615484 26303 leader_election.cc:290] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:22.616268 26303 raft_consensus.cc:2804] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.617029 26303 raft_consensus.cc:493] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.617641 26303 raft_consensus.cc:3060] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.616322 26294 leader_election.cc:290] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:22.618499 26031 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:22.618649 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:22.618819 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.619925 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:22.643373 25753 raft_consensus.cc:2393] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:22.644400 25903 raft_consensus.cc:2468] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:22.644833 26023 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:22.645411 26023 ts_tablet_manager.cc:1403] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.205s	user 0.026s	sys 0.013s
I20260709 13:21:22.654232 26026 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:22.654825 26026 ts_tablet_manager.cc:1403] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.144s	user 0.004s	sys 0.032s
I20260709 13:21:22.647842 26339 raft_consensus.cc:2749] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:22.678921 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 72995.8us
W20260709 13:21:22.669601 25947 leader_election.cc:343] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.675031 26177 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.690495 26024 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
W20260709 13:21:22.707576 25854 debug-util.cc:398] Leaking SignalData structure 0x7b0800277860 after lost signal to thread 17967
W20260709 13:21:22.708704 25854 debug-util.cc:398] Leaking SignalData structure 0x7b080025c080 after lost signal to thread 25690
W20260709 13:21:22.709803 25854 debug-util.cc:398] Leaking SignalData structure 0x7b0800188f80 after lost signal to thread 25782
I20260709 13:21:22.694919 26310 consensus_queue.cc:1048] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
W20260709 13:21:22.710989 25854 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0680 after lost signal to thread 25857
I20260709 13:21:22.711571 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
W20260709 13:21:22.712229 25854 debug-util.cc:398] Leaking SignalData structure 0x7b0800221980 after lost signal to thread 25931
I20260709 13:21:22.675755 26122 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.714975 26122 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:22.718360 25872 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:22.719430 26339 raft_consensus.cc:2749] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.719810 26023 raft_consensus.cc:359] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.720525 26023 raft_consensus.cc:385] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.720770 26023 raft_consensus.cc:740] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.721417 26023 consensus_queue.cc:260] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.721622 26056 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.722124 26056 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.723105 26023 ts_tablet_manager.cc:1434] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.077s	user 0.003s	sys 0.002s
I20260709 13:21:22.724053 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:22.719473 25654 catalog_manager.cc:5697] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.724730 25902 raft_consensus.cc:3060] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.725627 26056 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:22.726984 26056 raft_consensus.cc:493] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.727392 26056 raft_consensus.cc:515] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.729439 26056 leader_election.cc:290] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:22.730338 26024 ts_tablet_manager.cc:1403] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.206s	user 0.024s	sys 0.024s
I20260709 13:21:22.724130 26023 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:22.738999 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:22.739778 25854 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec180 after lost signal to thread 26005
I20260709 13:21:22.742117 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.743532 26024 raft_consensus.cc:359] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.745632 26303 raft_consensus.cc:515] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.746181 26024 raft_consensus.cc:385] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.746627 26024 raft_consensus.cc:740] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.747745 26024 consensus_queue.cc:260] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.733148 26177 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.752648 25945 leader_election.cc:304] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:22.753440 26235 consensus_queue.cc:1048] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:22.754005 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 78488.6us
I20260709 13:21:22.754607 26177 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:22.756331 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:22.757278 25902 raft_consensus.cc:2468] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:22.757639 26303 leader_election.cc:290] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:22.759975 26024 ts_tablet_manager.cc:1434] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:21:22.761062 25722 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:22.761958 26177 raft_consensus.cc:2804] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.763918 26025 tablet_bootstrap.cc:654] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.765240 26026 raft_consensus.cc:359] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.765893 26026 raft_consensus.cc:385] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.766134 26026 raft_consensus.cc:740] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.766710 26026 consensus_queue.cc:260] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:22.767576 25946 leader_election.cc:343] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.771457 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.772279 25832 raft_consensus.cc:2393] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:22.772176 25980 raft_consensus.cc:2468] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:22.750028 26339 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.793918 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:22.794826 25757 raft_consensus.cc:3060] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.796977 26339 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:22.815857 26339 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:22.816748 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:22.818744 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:22.819727 25978 raft_consensus.cc:2393] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:22.821144 25871 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:22.823916 26031 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.791421 26356 raft_consensus.cc:2804] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.829768 26356 raft_consensus.cc:493] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.830170 26356 raft_consensus.cc:3060] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.830983 25654 catalog_manager.cc:5697] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.775614 26026 ts_tablet_manager.cc:1434] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.002s
I20260709 13:21:22.770247 26177 raft_consensus.cc:697] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:22.776259 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:22.787122 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:22.788118 25945 leader_election.cc:343] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.789240 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:22.842316 25945 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
W20260709 13:21:22.847589 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 59510.7us
I20260709 13:21:22.842927 25980 raft_consensus.cc:3060] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.853142 26024 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:22.841773 25902 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:22.842595 25977 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:22.858217 26177 consensus_queue.cc:237] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.861227 26025 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:22.861423 25722 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:22.861752 26025 ts_tablet_manager.cc:1403] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.284s	user 0.013s	sys 0.015s
I20260709 13:21:22.862370 26350 raft_consensus.cc:2804] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:22.862741 26350 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.863075 26350 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:22.853014 26357 raft_consensus.cc:2749] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.865303 26023 tablet_bootstrap.cc:654] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.871980 25757 raft_consensus.cc:2468] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:22.878746 25799 leader_election.cc:304] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:22.879932 26303 raft_consensus.cc:2804] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.880447 26303 raft_consensus.cc:697] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:22.881265 26303 consensus_queue.cc:237] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:22.884204 26024 tablet_bootstrap.cc:654] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.864562 26025 raft_consensus.cc:359] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.884631 26025 raft_consensus.cc:385] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.889032 26026 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:22.894025 26350 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:22.896322 26350 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:22.885102 26025 raft_consensus.cc:740] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.898969 26025 consensus_queue.cc:260] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.908655 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:22.909442 25902 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:22.900889 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:22.913444 25978 raft_consensus.cc:3060] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.930944 25654 catalog_manager.cc:5697] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:22.924655 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:22.943853 25979 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:22.946033 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:22.945886 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:22.947043 25757 raft_consensus.cc:2393] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:22.923729 25980 raft_consensus.cc:2468] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:22.959499 26031 raft_consensus.cc:2749] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.964563 26026 tablet_bootstrap.cc:654] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.969275 25656 catalog_manager.cc:5697] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:22.956002 26303 raft_consensus.cc:493] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.975646 26025 ts_tablet_manager.cc:1434] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.001s
I20260709 13:21:22.976598 26303 raft_consensus.cc:515] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:22.989317 26348 consensus_queue.cc:1048] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.985401 26235 consensus_queue.cc:1048] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:21:22.996407 26303 leader_election.cc:290] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:22.997416 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9adacf3baa64bbc9f77334887ac19bd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:22.998113 25906 raft_consensus.cc:2468] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:23.000147 25797 leader_election.cc:304] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:23.001137 26348 raft_consensus.cc:2804] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.001574 26348 raft_consensus.cc:493] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.001957 26348 raft_consensus.cc:3060] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.002540 26025 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:23.003257 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9adacf3baa64bbc9f77334887ac19bd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:23.005510 25758 raft_consensus.cc:2468] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:23.012763 26235 consensus_queue.cc:1048] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.987237 26356 raft_consensus.cc:515] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.018466 26356 leader_election.cc:290] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:23.031201 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:23.031885 25903 raft_consensus.cc:3060] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.044168 26023 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:23.045084 26024 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:23.044692 26023 ts_tablet_manager.cc:1403] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.321s	user 0.035s	sys 0.012s
I20260709 13:21:23.045670 26024 ts_tablet_manager.cc:1403] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.202s	user 0.021s	sys 0.035s
I20260709 13:21:23.053737 26355 consensus_queue.cc:1048] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:23.057081 25947 leader_election.cc:304] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:23.048321 26023 raft_consensus.cc:359] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.058643 26023 raft_consensus.cc:385] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.058959 26023 raft_consensus.cc:740] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.062836 26023 consensus_queue.cc:260] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.041023 25979 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:23.072501 26100 consensus_queue.cc:1048] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:23.083428 26025 tablet_bootstrap.cc:654] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.086189 25902 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:23.088382 25903 raft_consensus.cc:2468] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:23.088543 25722 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:23.089458 26350 raft_consensus.cc:2804] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:23.089953 26350 raft_consensus.cc:697] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:23.090899 26350 consensus_queue.cc:237] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.091933 26023 ts_tablet_manager.cc:1434] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:21:23.095455 26023 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:23.090071 26024 raft_consensus.cc:359] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.100061 26024 raft_consensus.cc:385] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.100435 26024 raft_consensus.cc:740] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.108892 26024 consensus_queue.cc:260] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.096807 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:23.113094 25757 raft_consensus.cc:3060] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.118683 26037 consensus_queue.cc:1048] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.133971 26024 ts_tablet_manager.cc:1434] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:21:23.143381 26023 tablet_bootstrap.cc:654] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.145046 26024 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:23.149487 26351 raft_consensus.cc:493] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.149976 26351 raft_consensus.cc:515] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.152074 26351 leader_election.cc:290] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:23.155190 26167 consensus_queue.cc:1048] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.111096 25978 raft_consensus.cc:2468] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:23.163538 26056 raft_consensus.cc:2749] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.162659 25757 raft_consensus.cc:2468] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:23.182751 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:23.186142 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:23.194912 25723 leader_election.cc:343] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.207535 26301 consensus_queue.cc:1048] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.209385 26348 raft_consensus.cc:515] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.212813 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9adacf3baa64bbc9f77334887ac19bd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:23.213526 25756 raft_consensus.cc:3060] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.213975 26348 leader_election.cc:290] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:23.213672 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9adacf3baa64bbc9f77334887ac19bd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:23.214931 25904 raft_consensus.cc:3060] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.215824 25945 leader_election.cc:304] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:23.221424 26056 raft_consensus.cc:2804] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.221931 26056 raft_consensus.cc:697] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:23.222759 26056 consensus_queue.cc:237] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:23.229779 25722 leader_election.cc:343] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.230392 25722 leader_election.cc:304] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:23.241617 26023 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:23.242307 26023 ts_tablet_manager.cc:1403] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.002s
I20260709 13:21:23.226788 25904 raft_consensus.cc:2468] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:23.248991 25654 catalog_manager.cc:5697] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 2, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:23.236745 26350 raft_consensus.cc:2749] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.260792 26024 tablet_bootstrap.cc:654] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.262401 26025 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:23.262857 26025 ts_tablet_manager.cc:1403] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.261s	user 0.017s	sys 0.001s
I20260709 13:21:23.264631 26026 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:23.265116 26026 ts_tablet_manager.cc:1403] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.421s	user 0.011s	sys 0.013s
I20260709 13:21:23.267755 26026 raft_consensus.cc:359] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.268409 26026 raft_consensus.cc:385] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.268663 26026 raft_consensus.cc:740] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.221876 25756 raft_consensus.cc:2468] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:23.274243 26025 raft_consensus.cc:359] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.274917 26025 raft_consensus.cc:385] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.275151 26025 raft_consensus.cc:740] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.280467 26023 raft_consensus.cc:359] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.281551 26023 raft_consensus.cc:385] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.282876 26023 raft_consensus.cc:740] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.276080 26025 consensus_queue.cc:260] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.283743 26023 consensus_queue.cc:260] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.284914 25797 leader_election.cc:304] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:23.285219 26026 consensus_queue.cc:260] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.287599 26310 raft_consensus.cc:2804] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.288079 26310 raft_consensus.cc:697] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:23.288461 26023 ts_tablet_manager.cc:1434] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:21:23.288625 26025 ts_tablet_manager.cc:1434] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:21:23.288944 26310 consensus_queue.cc:237] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.289728 26025 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:23.289789 26023 tablet_bootstrap.cc:492] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:23.296392 26023 tablet_bootstrap.cc:654] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.296648 26025 tablet_bootstrap.cc:654] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.337554 26026 ts_tablet_manager.cc:1434] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 13:21:23.356637 25655 catalog_manager.cc:5697] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.366254 26167 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.366797 26167 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.372478 26037 consensus_queue.cc:1048] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.372706 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:23.374604 26122 consensus_queue.cc:1048] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.368786 26167 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:23.378459 26023 tablet_bootstrap.cc:492] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:23.379067 26023 ts_tablet_manager.cc:1403] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.004s
W20260709 13:21:23.379436 25797 leader_election.cc:343] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.380368 26026 tablet_bootstrap.cc:492] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:23.397985 26351 consensus_queue.cc:1048] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:23.388772 25654 catalog_manager.cc:5697] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.403983 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:23.404699 25757 raft_consensus.cc:2468] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:23.415536 25799 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:23.416496 26167 raft_consensus.cc:2804] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.416905 26167 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.417217 26167 raft_consensus.cc:3060] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.417814 26023 raft_consensus.cc:359] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.418532 26023 raft_consensus.cc:385] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.418795 26023 raft_consensus.cc:740] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.419409 26023 consensus_queue.cc:260] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.427846 26025 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:23.428356 26025 ts_tablet_manager.cc:1403] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.031s
I20260709 13:21:23.430855 26025 raft_consensus.cc:359] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.431464 26025 raft_consensus.cc:385] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.431737 26025 raft_consensus.cc:740] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.433727 26024 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:23.434294 26024 ts_tablet_manager.cc:1403] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.290s	user 0.017s	sys 0.011s
I20260709 13:21:23.437050 26024 raft_consensus.cc:359] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.437129 26025 consensus_queue.cc:260] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.440160 26025 ts_tablet_manager.cc:1434] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:21:23.437847 26024 raft_consensus.cc:385] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.442267 26024 raft_consensus.cc:740] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.442070 26167 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.443042 26024 consensus_queue.cc:260] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.444255 26026 tablet_bootstrap.cc:654] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.446270 26023 ts_tablet_manager.cc:1434] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.001s
I20260709 13:21:23.447302 26025 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:23.450356 26310 consensus_queue.cc:1048] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.453977 26024 ts_tablet_manager.cc:1434] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:23.455121 26024 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:23.459041 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
W20260709 13:21:23.460297 25797 leader_election.cc:343] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.460625 26023 tablet_bootstrap.cc:492] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:23.464612 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:23.465258 25758 raft_consensus.cc:3060] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.467458 26023 tablet_bootstrap.cc:654] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.470767 26167 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:23.481812 25758 raft_consensus.cc:2468] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:23.486207 25799 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:23.487850 26024 tablet_bootstrap.cc:654] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.488022 26310 raft_consensus.cc:2804] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.488565 26310 raft_consensus.cc:697] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:23.489380 26025 tablet_bootstrap.cc:654] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.489440 26310 consensus_queue.cc:237] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.498054 26026 tablet_bootstrap.cc:492] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:23.499009 26026 ts_tablet_manager.cc:1403] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.010s
I20260709 13:21:23.511149 26167 raft_consensus.cc:493] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.511729 26167 raft_consensus.cc:515] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:23.512969 26026 raft_consensus.cc:359] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.513695 26026 raft_consensus.cc:385] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.513985 26026 raft_consensus.cc:740] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.514042 26167 leader_election.cc:290] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:23.515738 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b847d9971e4cc59c55d60bca9bd6fa" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:23.522303 25797 leader_election.cc:343] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.521708 26026 consensus_queue.cc:260] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.526455 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b847d9971e4cc59c55d60bca9bd6fa" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:23.520315 26151 raft_consensus.cc:493] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.527415 26151 raft_consensus.cc:515] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.544010 26026 ts_tablet_manager.cc:1434] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:21:23.557147 26026 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
W20260709 13:21:23.544818 25799 leader_election.cc:343] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.563812 25653 catalog_manager.cc:5697] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:23.574545 26024 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:23.575259 26024 ts_tablet_manager.cc:1403] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.120s	user 0.022s	sys 0.007s
I20260709 13:21:23.579358 26024 raft_consensus.cc:359] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.580394 26024 raft_consensus.cc:385] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.580807 26024 raft_consensus.cc:740] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.581923 26024 consensus_queue.cc:260] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.589653 25799 leader_election.cc:304] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:23.591022 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 49889.6us
I20260709 13:21:23.592219 26167 raft_consensus.cc:2749] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.596167 26301 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.596613 26301 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.598726 26301 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:23.603864 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:23.604537 25979 raft_consensus.cc:2468] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:23.606863 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:23.609531 25797 leader_election.cc:304] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:23.612569 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:23.613242 25757 raft_consensus.cc:2468] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:23.613314 26303 raft_consensus.cc:2804] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.613826 26303 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:23.610348 25871 leader_election.cc:343] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.611173 26151 leader_election.cc:290] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:23.614179 26303 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.614192 26024 ts_tablet_manager.cc:1434] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:21:23.615864 26024 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:23.621062 25873 leader_election.cc:304] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:23.621922 26151 raft_consensus.cc:2804] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.622291 26151 raft_consensus.cc:493] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.622607 26151 raft_consensus.cc:3060] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.630100 26151 raft_consensus.cc:515] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.632099 26151 leader_election.cc:290] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:23.633097 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:23.633498 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:23.633091 26351 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.634333 25757 raft_consensus.cc:3060] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.634557 26351 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.637018 26024 tablet_bootstrap.cc:654] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.638438 26351 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
W20260709 13:21:23.639412 25871 leader_election.cc:343] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.640442 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:23.641112 25979 raft_consensus.cc:2468] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:23.642388 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:23.641119 25902 raft_consensus.cc:1275] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:21:23.644299 25722 leader_election.cc:343] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.645545 25722 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:23.647126 26350 raft_consensus.cc:2804] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.647595 26350 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.648335 26350 raft_consensus.cc:3060] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.651170 25979 raft_consensus.cc:1275] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:23.653079 26351 consensus_queue.cc:1048] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:23.655750 26351 consensus_queue.cc:1048] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.647455 26356 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.660297 26356 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.661038 26056 consensus_queue.cc:1048] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.663781 26356 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:23.663842 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:23.665205 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:23.667682 26025 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:23.668334 26025 ts_tablet_manager.cc:1403] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.227s	user 0.022s	sys 0.015s
I20260709 13:21:23.669834 26151 raft_consensus.cc:493] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:23.670761 25945 leader_election.cc:343] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.670722 26151 raft_consensus.cc:515] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.674038 26151 leader_election.cc:290] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:23.676246 25753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:23.677094 25753 raft_consensus.cc:2468] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:23.678421 25873 leader_election.cc:304] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:23.681144 26151 raft_consensus.cc:2804] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.681525 26151 raft_consensus.cc:493] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.681843 26151 raft_consensus.cc:3060] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.674697 25757 raft_consensus.cc:2468] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:23.685016 26303 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.676272 26350 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.690707 26303 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:23.691859 26350 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:23.692335 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:23.693554 25758 raft_consensus.cc:2393] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:23.694233 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:23.694577 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:23.694836 25979 raft_consensus.cc:3060] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.695192 25980 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.697230 26025 raft_consensus.cc:359] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.697932 26025 raft_consensus.cc:385] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.698623 25947 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:23.698180 26025 raft_consensus.cc:740] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.706849 26025 consensus_queue.cc:260] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.704656 25979 raft_consensus.cc:2468] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:23.709021 25904 raft_consensus.cc:3060] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.717640 25873 leader_election.cc:304] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:23.728050 26031 raft_consensus.cc:2804] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.728792 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:23.730464 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:23.731668 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
W20260709 13:21:23.735839 25797 leader_election.cc:343] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:23.737316 25797 leader_election.cc:343] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.716816 26356 raft_consensus.cc:2749] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.740554 26023 tablet_bootstrap.cc:492] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:23.741171 26023 ts_tablet_manager.cc:1403] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.281s	user 0.031s	sys 0.070s
I20260709 13:21:23.739267 26303 consensus_queue.cc:1048] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:23.743841 26023 raft_consensus.cc:359] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.744508 26023 raft_consensus.cc:385] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.744764 26023 raft_consensus.cc:740] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.745504 26023 consensus_queue.cc:260] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.748342 26023 ts_tablet_manager.cc:1434] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:23.748435 26026 tablet_bootstrap.cc:654] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.749348 25722 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:23.749763 26023 tablet_bootstrap.cc:492] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:23.750093 26122 raft_consensus.cc:2804] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.750610 26122 raft_consensus.cc:697] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:23.751443 26122 consensus_queue.cc:237] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.788780 26024 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:23.789467 26024 ts_tablet_manager.cc:1403] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.174s	user 0.007s	sys 0.022s
I20260709 13:21:23.790300 26356 consensus_queue.cc:1048] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.792276 26024 raft_consensus.cc:359] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.793284 26031 raft_consensus.cc:697] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:23.795928 26024 raft_consensus.cc:385] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.796229 26024 raft_consensus.cc:740] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.796844 26024 consensus_queue.cc:260] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.796716 26031 consensus_queue.cc:237] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:23.776149 25904 raft_consensus.cc:2468] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:23.781904 25980 raft_consensus.cc:2468] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:23.805984 26023 tablet_bootstrap.cc:654] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.809558 26024 ts_tablet_manager.cc:1434] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:21:23.813328 25797 leader_election.cc:304] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:23.814339 26037 raft_consensus.cc:2804] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.814803 26037 raft_consensus.cc:697] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:23.815544 26037 consensus_queue.cc:237] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.818295 26024 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
W20260709 13:21:23.814725 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 80916.4us
I20260709 13:21:23.850890 26025 ts_tablet_manager.cc:1434] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.182s	user 0.009s	sys 0.000s
I20260709 13:21:23.852010 26025 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
W20260709 13:21:23.848037 26393 log.cc:927] Time spent T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:21:23.855594 26394 log.cc:927] Time spent T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:21:23.844720 25723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 92219.2us
I20260709 13:21:23.874476 26023 tablet_bootstrap.cc:492] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:23.875427 26023 ts_tablet_manager.cc:1403] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.005s
I20260709 13:21:23.890965 26037 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.891433 26037 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:23.900965 26037 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:23.921180 26151 raft_consensus.cc:515] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:23.923382 26151 leader_election.cc:290] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:23.911701 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:23.924573 25980 raft_consensus.cc:2468] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:23.933662 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:23.933940 25872 leader_election.cc:343] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.958989 25797 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:23.961894 26037 raft_consensus.cc:2804] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.962385 26037 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.962778 26037 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.962710 25656 catalog_manager.cc:5697] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.971767 26024 tablet_bootstrap.cc:654] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.984200 26025 tablet_bootstrap.cc:654] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:23.986583 26400 log.cc:927] Time spent T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:21:24.013828 26023 raft_consensus.cc:359] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.014566 26023 raft_consensus.cc:385] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.014838 26023 raft_consensus.cc:740] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.028609 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:24.029424 25758 raft_consensus.cc:3060] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.029945 26303 consensus_queue.cc:1048] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:23.977634 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 43732.2us
W20260709 13:21:24.032104 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:21:24.036556 25797 consensus_peers.cc:597] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c -> Peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Couldn't send request to peer 33e3240923e54438a22da49413055ab3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.038116 26037 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.043316 25653 catalog_manager.cc:5697] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.029953 26023 consensus_queue.cc:260] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.049054 26026 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:24.049530 26026 ts_tablet_manager.cc:1403] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.496s	user 0.016s	sys 0.019s
I20260709 13:21:24.047305 25656 catalog_manager.cc:5697] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.053310 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:24.040194 26350 raft_consensus.cc:493] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.055176 26350 raft_consensus.cc:515] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.057775 26350 leader_election.cc:290] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:24.059015 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:24.061846 25722 leader_election.cc:343] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.064563 26025 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:24.065080 26025 ts_tablet_manager.cc:1403] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.213s	user 0.010s	sys 0.004s
I20260709 13:21:24.070669 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:24.044806 26167 consensus_queue.cc:1048] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:21:24.078481 26037 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:24.092862 26024 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:24.096362 26024 ts_tablet_manager.cc:1403] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.283s	user 0.028s	sys 0.024s
I20260709 13:21:24.098598 25758 raft_consensus.cc:2468] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
W20260709 13:21:24.099560 25723 leader_election.cc:343] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.112476 26025 raft_consensus.cc:359] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.123138 26025 raft_consensus.cc:385] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.123555 26025 raft_consensus.cc:740] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.099236 26024 raft_consensus.cc:359] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.109721 26122 raft_consensus.cc:493] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.124495 26024 raft_consensus.cc:385] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.132380 26024 raft_consensus.cc:740] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.125422 26122 raft_consensus.cc:515] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.128201 25723 leader_election.cc:304] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:24.134213 26024 consensus_queue.cc:260] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.134631 26122 leader_election.cc:290] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:24.136384 26398 raft_consensus.cc:2749] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.130275 25873 leader_election.cc:304] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:24.139933 26391 raft_consensus.cc:2804] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.140410 26391 raft_consensus.cc:697] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:24.140519 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:24.141278 26391 consensus_queue.cc:237] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.128924 26025 consensus_queue.cc:260] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.153398 26024 ts_tablet_manager.cc:1434] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.004s
W20260709 13:21:24.154147 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 116473us
W20260709 13:21:24.155306 25797 leader_election.cc:343] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.162406 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:24.163762 25722 leader_election.cc:343] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:24.164623 25723 leader_election.cc:343] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.165083 25723 leader_election.cc:304] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:24.166129 26350 raft_consensus.cc:2749] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.170389 26024 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:24.171542 26023 ts_tablet_manager.cc:1434] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.296s	user 0.008s	sys 0.008s
I20260709 13:21:24.180716 26177 consensus_queue.cc:1048] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.183851 26026 raft_consensus.cc:359] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.184623 26026 raft_consensus.cc:385] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.184921 26026 raft_consensus.cc:740] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.185570 26026 consensus_queue.cc:260] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.187537 26026 ts_tablet_manager.cc:1434] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.138s	user 0.005s	sys 0.000s
I20260709 13:21:24.188486 26026 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:24.198902 26024 tablet_bootstrap.cc:654] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.201838 26023 tablet_bootstrap.cc:492] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:24.202546 26025 ts_tablet_manager.cc:1434] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.137s	user 0.008s	sys 0.000s
I20260709 13:21:24.206281 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:24.219492 26025 tablet_bootstrap.cc:492] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
W20260709 13:21:24.204344 25872 leader_election.cc:343] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.203855 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:24.210420 25977 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.292829 26026 tablet_bootstrap.cc:654] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.296605 26025 tablet_bootstrap.cc:654] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.316224 25656 catalog_manager.cc:5697] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.309989 26414 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:24.361318 25871 consensus_peers.cc:597] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Couldn't send request to peer 33e3240923e54438a22da49413055ab3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.365679 26177 consensus_queue.cc:1048] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.385377 26023 tablet_bootstrap.cc:700] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c: Time spent opening tablet: real 0.117s	user 0.004s	sys 0.000s
I20260709 13:21:24.387701 26023 tablet_bootstrap.cc:654] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.381848 26414 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.394366 26024 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
W20260709 13:21:24.381383 25797 leader_election.cc:343] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.394968 26024 ts_tablet_manager.cc:1403] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.225s	user 0.024s	sys 0.006s
I20260709 13:21:24.395685 26414 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:24.366417 26405 consensus_queue.cc:1048] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:21:24.408495 25977 raft_consensus.cc:2468] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:24.400982 26024 raft_consensus.cc:359] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.418598 26024 raft_consensus.cc:385] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.418927 26024 raft_consensus.cc:740] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.387954 26391 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.421365 26024 consensus_queue.cc:260] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.423985 26410 raft_consensus.cc:493] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.426103 26024 ts_tablet_manager.cc:1434] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:21:24.426165 26410 raft_consensus.cc:515] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.428483 26410 leader_election.cc:290] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:24.433931 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b847d9971e4cc59c55d60bca9bd6fa" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:24.434626 25831 raft_consensus.cc:2468] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:24.422886 26391 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.435853 25946 leader_election.cc:304] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:24.436668 26410 raft_consensus.cc:2804] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.437059 26410 raft_consensus.cc:493] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.437376 26410 raft_consensus.cc:3060] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.438360 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:24.439502 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:24.439879 25873 leader_election.cc:343] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.440618 26391 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:24.441468 25871 leader_election.cc:343] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.447172 25871 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:24.450528 26391 raft_consensus.cc:2749] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.439702 26024 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:24.445279 26026 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:24.453151 26026 ts_tablet_manager.cc:1403] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.265s	user 0.039s	sys 0.033s
I20260709 13:21:24.453329 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b847d9971e4cc59c55d60bca9bd6fa" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:24.454128 25758 raft_consensus.cc:2468] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:24.457645 26026 raft_consensus.cc:359] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.459791 26026 raft_consensus.cc:385] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.460081 26026 raft_consensus.cc:740] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.463385 25797 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:24.463577 26026 consensus_queue.cc:260] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.465234 26025 tablet_bootstrap.cc:492] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:24.465744 26025 ts_tablet_manager.cc:1403] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.253s	user 0.022s	sys 0.022s
I20260709 13:21:24.465950 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:24.469815 26025 raft_consensus.cc:359] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.470336 26167 raft_consensus.cc:2804] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.470507 26025 raft_consensus.cc:385] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.470973 26167 raft_consensus.cc:697] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:24.474498 26167 consensus_queue.cc:237] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.479034 26024 tablet_bootstrap.cc:654] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.470901 26025 raft_consensus.cc:740] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
W20260709 13:21:24.480624 25797 leader_election.cc:343] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.488765 26023 tablet_bootstrap.cc:492] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:24.489262 26023 ts_tablet_manager.cc:1403] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.288s	user 0.020s	sys 0.003s
I20260709 13:21:24.485772 26025 consensus_queue.cc:260] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.491909 26023 raft_consensus.cc:359] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.492540 26023 raft_consensus.cc:385] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.492651 26025 ts_tablet_manager.cc:1434] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.001s
I20260709 13:21:24.471021 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:24.492861 26023 raft_consensus.cc:740] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.493716 26025 tablet_bootstrap.cc:492] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:24.494210 26023 consensus_queue.cc:260] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.497052 26122 raft_consensus.cc:493] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.497663 26122 raft_consensus.cc:515] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.502640 26122 leader_election.cc:290] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:24.486045 26414 consensus_queue.cc:1048] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:21:24.505995 26410 raft_consensus.cc:515] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.506817 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:24.507274 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:24.511193 26026 ts_tablet_manager.cc:1434] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
W20260709 13:21:24.511260 25722 leader_election.cc:343] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.524686 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b847d9971e4cc59c55d60bca9bd6fa" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:24.525393 25758 raft_consensus.cc:3060] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:24.530092 25723 leader_election.cc:343] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.533038 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b847d9971e4cc59c55d60bca9bd6fa" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:24.533679 25831 raft_consensus.cc:3060] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.541592 26023 ts_tablet_manager.cc:1434] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:21:24.553622 26025 tablet_bootstrap.cc:654] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.555692 25758 raft_consensus.cc:2468] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
W20260709 13:21:24.558879 25797 consensus_peers.cc:597] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.559505 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 74894.1us
I20260709 13:21:24.563446 26023 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:24.542878 26410 leader_election.cc:290] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:24.571197 25797 leader_election.cc:343] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.574005 25797 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:24.574997 26037 raft_consensus.cc:2749] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.591217 26026 tablet_bootstrap.cc:492] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:24.611581 25723 leader_election.cc:304] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:24.612442 26177 raft_consensus.cc:2749] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.612651 26024 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:24.613422 26024 ts_tablet_manager.cc:1403] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.174s	user 0.023s	sys 0.024s
I20260709 13:21:24.615772 26024 raft_consensus.cc:359] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.616288 26024 raft_consensus.cc:385] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.616511 26024 raft_consensus.cc:740] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
W20260709 13:21:24.612623 25723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 99592.3us
I20260709 13:21:24.629084 26024 consensus_queue.cc:260] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.633566 26024 ts_tablet_manager.cc:1434] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:21:24.634631 26024 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:24.634681 26026 tablet_bootstrap.cc:654] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.638021 25653 catalog_manager.cc:5697] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:24.599416 25946 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 67000.5us
I20260709 13:21:24.661897 26023 tablet_bootstrap.cc:654] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.652788 26024 tablet_bootstrap.cc:654] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.665042 26025 tablet_bootstrap.cc:492] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:24.665524 26025 ts_tablet_manager.cc:1403] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.011s
I20260709 13:21:24.668258 26025 raft_consensus.cc:359] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.675325 26026 tablet_bootstrap.cc:492] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:24.675855 26026 ts_tablet_manager.cc:1403] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.005s
I20260709 13:21:24.678556 26026 raft_consensus.cc:359] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.679219 26026 raft_consensus.cc:385] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.679499 26026 raft_consensus.cc:740] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.680075 26025 raft_consensus.cc:385] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.680439 26025 raft_consensus.cc:740] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.681656 26025 consensus_queue.cc:260] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.682235 26026 consensus_queue.cc:260] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.685792 26023 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:24.686316 26023 ts_tablet_manager.cc:1403] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.141s	user 0.008s	sys 0.011s
I20260709 13:21:24.687767 26025 ts_tablet_manager.cc:1434] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:21:24.688723 26025 tablet_bootstrap.cc:492] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:24.690757 26023 raft_consensus.cc:359] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.691224 26026 ts_tablet_manager.cc:1434] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:21:24.692348 26026 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:24.697280 26025 tablet_bootstrap.cc:654] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.697453 26023 raft_consensus.cc:385] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.698411 26023 raft_consensus.cc:740] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.646148 25831 raft_consensus.cc:2468] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:24.700412 25946 leader_election.cc:304] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:24.701390 26056 raft_consensus.cc:2804] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.701906 26056 raft_consensus.cc:697] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:24.700206 26023 consensus_queue.cc:260] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.702384 26026 tablet_bootstrap.cc:654] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.702721 26056 consensus_queue.cc:237] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.704499 26023 ts_tablet_manager.cc:1434] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:21:24.709550 26023 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:24.721446 26026 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:24.722872 26026 ts_tablet_manager.cc:1403] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:21:24.726892 26026 raft_consensus.cc:359] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:24.727514 25872 consensus_peers.cc:597] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.730294 26025 tablet_bootstrap.cc:492] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:24.730918 26023 tablet_bootstrap.cc:654] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.732834 26025 ts_tablet_manager.cc:1403] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.006s
I20260709 13:21:24.732421 26026 raft_consensus.cc:385] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.735802 26026 raft_consensus.cc:740] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.735915 26025 raft_consensus.cc:359] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.736696 26025 raft_consensus.cc:385] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.737031 26025 raft_consensus.cc:740] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.737542 26026 consensus_queue.cc:260] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.737840 26025 consensus_queue.cc:260] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.741082 26026 ts_tablet_manager.cc:1434] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:24.746626 26026 tablet_bootstrap.cc:492] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:24.749712 26025 ts_tablet_manager.cc:1434] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:21:24.744935 26023 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:24.750409 26023 ts_tablet_manager.cc:1403] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:21:24.750730 26025 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:24.756479 26025 tablet_bootstrap.cc:654] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.765703 26405 consensus_queue.cc:1048] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.759334 26023 raft_consensus.cc:359] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.767926 26023 raft_consensus.cc:385] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.768587 26023 raft_consensus.cc:740] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.771518 26023 consensus_queue.cc:260] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.775492 26023 ts_tablet_manager.cc:1434] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:21:24.770556 26026 tablet_bootstrap.cc:654] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.782248 26023 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:24.788681 26348 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.789412 26348 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.793397 26348 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:24.795064 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:24.792665 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:24.799068 26023 tablet_bootstrap.cc:654] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:24.803411 25797 leader_election.cc:343] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.795807 26056 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.809333 26056 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.810252 25981 raft_consensus.cc:2468] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:24.811247 26056 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:24.814020 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:24.814738 25831 raft_consensus.cc:2468] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:24.816100 25946 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:24.817358 26410 raft_consensus.cc:2804] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.817822 26410 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.818255 26410 raft_consensus.cc:3060] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.820511 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:24.825798 25797 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
W20260709 13:21:24.827035 25945 leader_election.cc:343] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.828459 26301 raft_consensus.cc:2804] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.829005 26301 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.829425 26301 raft_consensus.cc:3060] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.816114 26025 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:24.833575 26025 ts_tablet_manager.cc:1403] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.003s
I20260709 13:21:24.836586 26025 raft_consensus.cc:359] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.841662 26025 raft_consensus.cc:385] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.842028 26025 raft_consensus.cc:740] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.842924 26025 consensus_queue.cc:260] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.846935 25981 raft_consensus.cc:3060] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.854146 26410 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.857625 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:24.868185 26310 raft_consensus.cc:493] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.868757 26310 raft_consensus.cc:515] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.871380 26310 leader_election.cc:290] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:24.871531 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:24.873610 25797 leader_election.cc:343] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.875751 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:24.876387 25757 raft_consensus.cc:2468] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:24.759716 25653 catalog_manager.cc:5697] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.880780 26025 ts_tablet_manager.cc:1434] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 13:21:24.887921 25799 leader_election.cc:304] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:24.892932 26413 raft_consensus.cc:2804] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.899189 26413 raft_consensus.cc:493] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.899542 26413 raft_consensus.cc:3060] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.898483 26301 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.909821 25831 raft_consensus.cc:2393] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:24.912715 26025 tablet_bootstrap.cc:492] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:24.922468 26024 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:24.922986 26024 ts_tablet_manager.cc:1403] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.289s	user 0.049s	sys 0.031s
I20260709 13:21:24.925284 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:24.926190 25979 raft_consensus.cc:2393] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:24.930099 26023 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:24.930598 26023 ts_tablet_manager.cc:1403] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.005s
I20260709 13:21:24.935983 26413 raft_consensus.cc:515] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.918639 26410 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:24.928962 26301 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:24.949230 26031 raft_consensus.cc:493] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.937158 25905 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.949738 26031 raft_consensus.cc:515] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:24.958367 26023 raft_consensus.cc:359] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.958904 26023 raft_consensus.cc:385] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.959062 26023 raft_consensus.cc:740] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.959489 26023 consensus_queue.cc:260] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:24.959679 26031 leader_election.cc:290] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:24.944779 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:24.966795 26024 raft_consensus.cc:359] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.967170 26023 ts_tablet_manager.cc:1434] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:21:24.967526 26024 raft_consensus.cc:385] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.967839 26024 raft_consensus.cc:740] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.968523 26024 consensus_queue.cc:260] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.953348 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:24.971737 26413 leader_election.cc:290] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:24.974915 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:24.976928 26024 ts_tablet_manager.cc:1434] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:21:24.976969 26023 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
W20260709 13:21:24.980654 25872 leader_election.cc:343] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.982812 25977 raft_consensus.cc:3060] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.983098 26151 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.983556 26151 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:24.985497 26151 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:24.985569 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:24.986212 25756 raft_consensus.cc:3060] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.986541 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:24.992571 26024 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:24.993628 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:24.994289 25757 raft_consensus.cc:2468] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
W20260709 13:21:24.996455 25797 leader_election.cc:343] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.998010 26026 tablet_bootstrap.cc:492] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:24.998473 26026 ts_tablet_manager.cc:1403] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.252s	user 0.041s	sys 0.026s
I20260709 13:21:24.998400 26122 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.996995 25797 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:24.998946 26122 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:24.995294 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:25.000538 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:25.002872 25873 leader_election.cc:304] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:24.993418 26301 consensus_queue.cc:1048] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:21:24.993643 25945 leader_election.cc:343] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.004942 25945 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:25.005101 25872 leader_election.cc:304] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:25.005658 26056 raft_consensus.cc:2749] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.005905 26405 raft_consensus.cc:2749] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.000732 26414 raft_consensus.cc:2749] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.006878 26414 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.007294 26414 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.008780 26122 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:25.005620 26031 raft_consensus.cc:2804] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.009233 26414 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:25.009495 26031 raft_consensus.cc:493] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.009975 26031 raft_consensus.cc:3060] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.013440 25797 leader_election.cc:343] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.016777 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:25.020201 26031 raft_consensus.cc:515] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:25.022500 25799 leader_election.cc:343] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.027877 25756 raft_consensus.cc:2468] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:25.030741 25799 leader_election.cc:304] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:25.057727 26023 tablet_bootstrap.cc:654] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.033911 26443 raft_consensus.cc:493] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.062077 26031 leader_election.cc:290] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:25.062493 25901 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.063120 26026 raft_consensus.cc:359] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.064544 26024 tablet_bootstrap.cc:654] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.064283 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:25.071115 26026 raft_consensus.cc:385] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.072944 26026 raft_consensus.cc:740] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
W20260709 13:21:25.072968 25722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 73575.9us
I20260709 13:21:25.053058 26413 raft_consensus.cc:2804] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.054988 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:25.083731 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:25.084355 25757 raft_consensus.cc:3060] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.077849 26413 raft_consensus.cc:697] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
W20260709 13:21:25.078099 25723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 79514.5us
I20260709 13:21:25.083887 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:25.105391 25872 leader_election.cc:343] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.094328 26413 consensus_queue.cc:237] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.072412 26443 raft_consensus.cc:515] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.104379 26026 consensus_queue.cc:260] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:25.113929 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:25.114385 25903 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:25.115446 26031 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.115904 26031 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.121740 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:25.125521 26443 leader_election.cc:290] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:25.125715 26031 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:25.128756 26303 consensus_queue.cc:1048] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.137038 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:25.137704 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:25.139003 26025 tablet_bootstrap.cc:654] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.150939 26026 ts_tablet_manager.cc:1434] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.152s	user 0.008s	sys 0.002s
I20260709 13:21:25.108214 25757 raft_consensus.cc:2468] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:25.104974 26405 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.166003 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:25.166162 26405 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.169153 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:25.170934 26405 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:25.172222 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:25.172890 25832 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:25.174383 25872 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:25.174787 26026 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:25.176090 26303 raft_consensus.cc:493] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.176514 26405 raft_consensus.cc:2804] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.177006 26405 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.176703 26303 raft_consensus.cc:515] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.177489 26405 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.181318 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:25.181969 25756 raft_consensus.cc:2468] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 0.
I20260709 13:21:25.183187 25799 leader_election.cc:304] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:25.183473 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:25.183911 26303 leader_election.cc:290] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:25.184530 26167 raft_consensus.cc:2804] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:25.184899 25797 leader_election.cc:343] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.185148 26167 raft_consensus.cc:493] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.185973 26167 raft_consensus.cc:3060] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.187374 25722 leader_election.cc:343] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:25.190189 25722 leader_election.cc:343] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.192130 25722 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
W20260709 13:21:25.217555 25722 leader_election.cc:343] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.218003 25722 leader_election.cc:304] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
W20260709 13:21:25.236836 25946 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 104386us
I20260709 13:21:25.225896 26177 raft_consensus.cc:2804] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:25.251585 25797 leader_election.cc:343] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.254114 25797 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:25.229804 26398 raft_consensus.cc:2749] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.253099 25871 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:25.258487 26031 raft_consensus.cc:2749] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.254015 26177 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.260192 26301 raft_consensus.cc:2749] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.280884 26177 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.319088 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 62316.7us
I20260709 13:21:25.262192 25873 leader_election.cc:304] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:25.304474 26427 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:25.333750 26023 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:25.334223 26023 ts_tablet_manager.cc:1403] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.364s	user 0.021s	sys 0.023s
I20260709 13:21:25.338989 26151 raft_consensus.cc:2804] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.339524 26151 raft_consensus.cc:697] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:25.350945 26023 raft_consensus.cc:359] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.351760 26023 raft_consensus.cc:385] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.352046 26023 raft_consensus.cc:740] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.344429 26450 consensus_queue.cc:1048] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:21:25.347919 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 94374.8us
I20260709 13:21:25.352716 26023 consensus_queue.cc:260] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.365984 26151 consensus_queue.cc:237] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.370199 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:25.370963 25976 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 0.
I20260709 13:21:25.335456 26427 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.377566 26024 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: No bootstrap required, opened a new log
I20260709 13:21:25.378286 26024 ts_tablet_manager.cc:1403] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.396s	user 0.021s	sys 0.000s
W20260709 13:21:25.381600 26451 log.cc:927] Time spent T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:21:25.385421 25654 catalog_manager.cc:5697] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.400456 25831 raft_consensus.cc:3060] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.408130 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 45256.4us
I20260709 13:21:25.413990 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:25.412473 26023 ts_tablet_manager.cc:1434] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:21:25.433039 26024 raft_consensus.cc:359] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.434162 26024 raft_consensus.cc:385] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.442683 26025 tablet_bootstrap.cc:492] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:25.443370 26025 ts_tablet_manager.cc:1403] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.551s	user 0.017s	sys 0.008s
I20260709 13:21:25.346909 26167 raft_consensus.cc:515] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.434553 26024 raft_consensus.cc:740] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.457746 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:25.418123 26427 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:25.464556 25946 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:25.475767 26023 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c: Bootstrap starting.
I20260709 13:21:25.416277 26409 consensus_queue.cc:1048] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
W20260709 13:21:25.485859 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 57768.3us
I20260709 13:21:25.476791 26024 consensus_queue.cc:260] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:25.489462 26457 log.cc:927] Time spent T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:21:25.445355 26405 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.502265 26167 leader_election.cc:290] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:25.502782 26024 ts_tablet_manager.cc:1434] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.002s
I20260709 13:21:25.490073 26410 raft_consensus.cc:2749] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:25.521993 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 58417us
I20260709 13:21:25.533430 26026 tablet_bootstrap.cc:654] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.550323 26025 raft_consensus.cc:359] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.551131 26025 raft_consensus.cc:385] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.551486 26025 raft_consensus.cc:740] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.552214 26025 consensus_queue.cc:260] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.553071 26177 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:25.546427 26463 log.cc:927] Time spent T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:21:25.558296 26025 ts_tablet_manager.cc:1434] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.000s
I20260709 13:21:25.559676 26025 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:25.565902 26405 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:25.566844 26023 tablet_bootstrap.cc:654] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.567656 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:25.568408 25977 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.572577 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 47056.3us
I20260709 13:21:25.576377 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:25.577073 25901 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.578274 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
W20260709 13:21:25.580789 25722 leader_election.cc:343] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.567623 26177 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:25.596956 26310 raft_consensus.cc:493] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:25.597503 26310 raft_consensus.cc:515] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.601927 26025 tablet_bootstrap.cc:654] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.614867 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:25.615653 25833 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.622145 25797 consensus_peers.cc:597] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c -> Peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321): Couldn't send request to peer 33e3240923e54438a22da49413055ab3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:25.616550 26310 leader_election.cc:290] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:25.617539 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:25.618855 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:25.631940 25797 leader_election.cc:343] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.635695 25833 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:25.640192 25872 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:25.641008 26405 raft_consensus.cc:2804] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.641521 26405 raft_consensus.cc:697] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:25.642409 26405 consensus_queue.cc:237] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.644328 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:25.644918 25757 raft_consensus.cc:3060] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.648093 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:25.652508 25757 raft_consensus.cc:2468] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:25.653545 26151 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.654043 26151 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:25.656113 26151 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:25.657922 25977 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:25.658780 25901 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:25.658850 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:25.659778 25831 raft_consensus.cc:2393] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:25.660624 26025 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:25.661142 26025 ts_tablet_manager.cc:1403] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.001s
I20260709 13:21:25.662482 25722 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:25.663018 26026 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:25.663477 26026 ts_tablet_manager.cc:1403] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.489s	user 0.012s	sys 0.019s
I20260709 13:21:25.663787 26472 raft_consensus.cc:2804] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.664309 26472 raft_consensus.cc:697] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:25.665108 26472 consensus_queue.cc:237] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.665704 26025 raft_consensus.cc:359] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.666381 26025 raft_consensus.cc:385] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.666633 26025 raft_consensus.cc:740] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.668671 26025 consensus_queue.cc:260] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.670794 26025 ts_tablet_manager.cc:1434] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:25.671728 26025 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828: Bootstrap starting.
I20260709 13:21:25.675237 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:25.675565 25799 leader_election.cc:304] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:25.676087 25977 raft_consensus.cc:2393] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:25.676659 26413 raft_consensus.cc:2749] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.677655 25799 leader_election.cc:304] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:25.678681 26413 raft_consensus.cc:2804] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.679142 26413 raft_consensus.cc:697] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:25.679951 26413 consensus_queue.cc:237] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.689222 25872 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:25.690641 26391 raft_consensus.cc:3060] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.698318 26391 raft_consensus.cc:2749] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.704834 26025 tablet_bootstrap.cc:654] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.714280 26026 raft_consensus.cc:359] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.715029 26026 raft_consensus.cc:385] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.715286 26026 raft_consensus.cc:740] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.718663 26023 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c: No bootstrap required, opened a new log
I20260709 13:21:25.719180 26023 ts_tablet_manager.cc:1403] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c: Time spent bootstrapping tablet: real 0.253s	user 0.012s	sys 0.000s
I20260709 13:21:25.715921 26026 consensus_queue.cc:260] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.724402 26025 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828: No bootstrap required, opened a new log
I20260709 13:21:25.724970 26025 ts_tablet_manager.cc:1403] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.000s
I20260709 13:21:25.727764 26025 raft_consensus.cc:359] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.729622 26026 ts_tablet_manager.cc:1434] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:21:25.729668 26025 raft_consensus.cc:385] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.733104 26025 raft_consensus.cc:740] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.733217 26026 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:25.733785 26025 consensus_queue.cc:260] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.749205 26025 ts_tablet_manager.cc:1434] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:21:25.744148 25656 catalog_manager.cc:5697] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.750113 25655 catalog_manager.cc:5697] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.721778 26023 raft_consensus.cc:359] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.758338 26023 raft_consensus.cc:385] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.758754 26023 raft_consensus.cc:740] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.758888 26026 tablet_bootstrap.cc:654] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.766971 26023 consensus_queue.cc:260] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:25.771651 25656 catalog_manager.cc:5697] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.781999 26310 consensus_queue.cc:1048] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.783960 26023 ts_tablet_manager.cc:1434] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.004s
I20260709 13:21:25.784257 26391 consensus_queue.cc:1048] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.793638 26026 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:25.794180 26026 ts_tablet_manager.cc:1403] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.013s
I20260709 13:21:25.800271 25652 catalog_manager.cc:5697] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 1, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 1 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.820034 26026 raft_consensus.cc:359] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.821458 26026 raft_consensus.cc:385] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.821723 26026 raft_consensus.cc:740] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.823920 26026 consensus_queue.cc:260] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.832432 26026 ts_tablet_manager.cc:1434] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:21:25.833561 26026 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:25.841845 26026 tablet_bootstrap.cc:654] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.854177 25831 raft_consensus.cc:3060] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.855844 26026 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:25.856389 26026 ts_tablet_manager.cc:1403] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.007s
I20260709 13:21:25.859066 26391 raft_consensus.cc:493] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.859588 26391 raft_consensus.cc:515] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:25.860788 26062 log.cc:927] Time spent T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:21:25.861047 26026 raft_consensus.cc:359] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.861776 26391 leader_election.cc:290] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:25.861878 26026 raft_consensus.cc:385] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.862356 26026 raft_consensus.cc:740] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.863229 26026 consensus_queue.cc:260] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.865367 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:25.867183 26026 ts_tablet_manager.cc:1434] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:21:25.869278 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:25.870086 25756 raft_consensus.cc:2393] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 1: Already voted for candidate 07f41f48d6b44bbb8d23868f1366476c in this term.
I20260709 13:21:25.872017 26026 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3: Bootstrap starting.
I20260709 13:21:25.875924 25873 leader_election.cc:304] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:25.877243 26449 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.877794 26449 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.878131 26391 raft_consensus.cc:3060] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.880060 26449 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:25.882913 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:25.883702 25901 raft_consensus.cc:2393] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 1: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:25.885181 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:25.886581 25947 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:25.887437 26449 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.899248 26031 consensus_queue.cc:1048] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.900764 26026 tablet_bootstrap.cc:654] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.905347 26449 raft_consensus.cc:2749] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.916289 26026 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3: No bootstrap required, opened a new log
I20260709 13:21:25.916846 26026 ts_tablet_manager.cc:1403] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 13:21:25.918898 26391 raft_consensus.cc:2749] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.919891 26026 raft_consensus.cc:359] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.920666 26026 raft_consensus.cc:385] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.920976 26026 raft_consensus.cc:740] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.921682 26026 consensus_queue.cc:260] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:25.924216 26026 ts_tablet_manager.cc:1434] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:21:25.972627 26472 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.973268 26472 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.976161 26472 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:25.976416 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:25.977830 25980 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:25.979511 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:25.979838 25722 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:25.980391 25831 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 0.
I20260709 13:21:25.980749 26398 raft_consensus.cc:2804] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.981469 26398 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.981802 26398 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.991528 26398 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:25.994573 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:25.995352 25977 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.997184 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:25.997202 26398 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:25.997954 25831 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.002233 25977 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:26.003691 25722 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:26.005028 26398 raft_consensus.cc:2804] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.006873 26398 raft_consensus.cc:697] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:26.008144 25831 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:26.007921 26398 consensus_queue.cc:237] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:26.022470 25655 catalog_manager.cc:5697] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.026788 26449 raft_consensus.cc:493] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.027407 26449 raft_consensus.cc:515] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:26.031443 26449 leader_election.cc:290] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:26.033882 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:26.035642 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:26.037947 25947 leader_election.cc:304] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:26.038558 26409 raft_consensus.cc:2749] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.042774 26409 raft_consensus.cc:493] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.043246 26409 raft_consensus.cc:515] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:26.046105 26409 leader_election.cc:290] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:26.046722 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:26.047556 25901 raft_consensus.cc:2468] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:26.047766 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:26.048524 25756 raft_consensus.cc:2468] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 0.
I20260709 13:21:26.048995 25945 leader_election.cc:304] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:26.049808 26409 raft_consensus.cc:2804] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.050235 26409 raft_consensus.cc:493] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.050673 26409 raft_consensus.cc:3060] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.061120 26391 consensus_queue.cc:1048] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.064190 26409 raft_consensus.cc:515] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:26.067983 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:26.068579 25901 raft_consensus.cc:3060] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.084103 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:26.110267 25756 raft_consensus.cc:3060] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.124302 25901 raft_consensus.cc:2468] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:26.127576 26448 consensus_queue.cc:1048] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.069664 26409 leader_election.cc:290] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:26.156018 25945 leader_election.cc:304] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:26.164386 26449 raft_consensus.cc:2804] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.164896 26449 raft_consensus.cc:697] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:26.165733 26449 consensus_queue.cc:237] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:26.184640 25704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:26.189908 26167 consensus_queue.cc:1048] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:21:26.202692 26413 consensus_queue.cc:1048] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.202474 25756 raft_consensus.cc:2468] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
W20260709 13:21:26.220023 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 62086.7us
I20260709 13:21:26.224980 25980 raft_consensus.cc:3060] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.224829 26398 consensus_queue.cc:1048] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:21:26.335505 26499 consensus_queue.cc:1048] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:26.341308 26496 log.cc:927] Time spent T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:21:26.310834 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 87747.1us
I20260709 13:21:26.383826 25652 catalog_manager.cc:5697] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 1 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.508590 26398 consensus_queue.cc:1048] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.521207 26177 consensus_queue.cc:1048] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.598146 26409 consensus_queue.cc:1048] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.615525 26490 consensus_queue.cc:1048] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.669677 26464 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.670228 26464 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:26.672348 26464 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:26.674276 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:26.675035 25904 raft_consensus.cc:2468] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:26.676097 25797 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:26.677345 26414 raft_consensus.cc:2804] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.677697 26414 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.677738 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:26.678124 26414 raft_consensus.cc:3060] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.678500 25981 raft_consensus.cc:2468] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:26.683821 26414 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:26.685689 26414 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:26.686767 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:26.686717 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:26.687464 25981 raft_consensus.cc:3060] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.687597 25904 raft_consensus.cc:3060] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.698274 25904 raft_consensus.cc:2468] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:26.699564 25797 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:26.700851 25981 raft_consensus.cc:2468] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:26.702404 26414 raft_consensus.cc:2804] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.703428 26414 raft_consensus.cc:697] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:26.704777 26414 consensus_queue.cc:237] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:26.784431 25656 catalog_manager.cc:5697] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 0 to 2, leader changed from <none> to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 2 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.194591 25978 raft_consensus.cc:1275] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:27.199994 26414 consensus_queue.cc:1048] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:27.246754 25904 raft_consensus.cc:1275] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:27.250583 26413 consensus_queue.cc:1048] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.215883 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
I20260709 13:21:28.268399 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:28.269829 17964 tablet_replica.cc:333] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.271296 17964 raft_consensus.cc:2243] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.271992 17964 raft_consensus.cc:2272] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.275899 17964 tablet_replica.cc:333] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.277352 17964 raft_consensus.cc:2243] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:28.280340 25799 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 324 similar messages]
W20260709 13:21:28.281379 25721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:28.291441 17964 raft_consensus.cc:2272] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.294179 17964 tablet_replica.cc:333] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
W20260709 13:21:28.294828 25799 consensus_peers.cc:597] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.295054 17964 raft_consensus.cc:2243] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.295637 17964 raft_consensus.cc:2272] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.297910 17964 tablet_replica.cc:333] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.298794 17964 raft_consensus.cc:2243] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.299834 17964 raft_consensus.cc:2272] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.301818 17964 tablet_replica.cc:333] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.302591 17964 raft_consensus.cc:2243] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.303067 17964 raft_consensus.cc:2272] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.305821 17964 tablet_replica.cc:333] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.306567 17964 raft_consensus.cc:2243] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.307034 17964 raft_consensus.cc:2272] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.309178 17964 tablet_replica.cc:333] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.309873 17964 raft_consensus.cc:2243] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.310762 17964 raft_consensus.cc:2272] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.314056 17964 tablet_replica.cc:333] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.314774 17964 raft_consensus.cc:2243] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.315979 17964 raft_consensus.cc:2272] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.322705 17964 tablet_replica.cc:333] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.323508 17964 raft_consensus.cc:2243] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.324007 17964 raft_consensus.cc:2272] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.331808 17964 tablet_replica.cc:333] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.333086 17964 raft_consensus.cc:2243] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.333597 17964 raft_consensus.cc:2272] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.336584 17964 tablet_replica.cc:333] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.339039 17964 raft_consensus.cc:2243] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.339829 17964 raft_consensus.cc:2272] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.339375 25947 consensus_peers.cc:597] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.342432 17964 tablet_replica.cc:333] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.343199 17964 raft_consensus.cc:2243] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.343688 17964 raft_consensus.cc:2272] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.346189 17964 tablet_replica.cc:333] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.347245 17964 raft_consensus.cc:2243] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.347802 17964 raft_consensus.cc:2272] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.350688 17964 tablet_replica.cc:333] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.351430 17964 raft_consensus.cc:2243] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.351944 17964 raft_consensus.cc:2272] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.355382 17964 tablet_replica.cc:333] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.356335 17964 raft_consensus.cc:2243] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.356954 17964 raft_consensus.cc:2272] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.360265 17964 tablet_replica.cc:333] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.361301 17964 raft_consensus.cc:2243] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.361920 17964 raft_consensus.cc:2272] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.364830 17964 tablet_replica.cc:333] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.366065 17964 raft_consensus.cc:2243] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.366636 17964 raft_consensus.cc:2272] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.369199 17964 tablet_replica.cc:333] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.369977 17964 raft_consensus.cc:2243] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.370528 17964 raft_consensus.cc:2272] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.373474 17964 tablet_replica.cc:333] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.375253 17964 raft_consensus.cc:2243] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.376294 17964 raft_consensus.cc:2272] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.376389 25799 consensus_peers.cc:597] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.379225 17964 tablet_replica.cc:333] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.380009 17964 raft_consensus.cc:2243] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.380545 17964 raft_consensus.cc:2272] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.383714 17964 tablet_replica.cc:333] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
W20260709 13:21:28.384088 25799 consensus_peers.cc:597] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.384488 17964 raft_consensus.cc:2243] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:28.385031 25799 consensus_peers.cc:597] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.385094 17964 raft_consensus.cc:2272] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.385632 25799 consensus_peers.cc:597] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.387610 17964 tablet_replica.cc:333] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.388428 17964 raft_consensus.cc:2243] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.389477 17964 raft_consensus.cc:2272] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.390180 25947 consensus_peers.cc:597] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.392010 17964 tablet_replica.cc:333] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
W20260709 13:21:28.391969 25947 consensus_peers.cc:597] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.393307 17964 raft_consensus.cc:2243] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.394271 17964 raft_consensus.cc:2272] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.398065 17964 tablet_replica.cc:333] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
W20260709 13:21:28.398097 25799 consensus_peers.cc:597] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.399467 25799 consensus_peers.cc:597] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.398835 17964 raft_consensus.cc:2243] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.400247 17964 raft_consensus.cc:2272] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.403419 17964 tablet_replica.cc:333] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.404367 17964 raft_consensus.cc:2243] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.404922 17964 raft_consensus.cc:2272] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.410076 17964 tablet_replica.cc:333] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.410854 17964 raft_consensus.cc:2243] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.411826 17964 raft_consensus.cc:2272] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.414763 17964 tablet_replica.cc:333] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.415454 17964 raft_consensus.cc:2243] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.415953 17964 raft_consensus.cc:2272] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.418591 25947 consensus_peers.cc:597] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.418861 17964 tablet_replica.cc:333] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.419660 17964 raft_consensus.cc:2243] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.420701 17964 raft_consensus.cc:2272] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.422072 25799 consensus_peers.cc:597] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.422495 25873 consensus_peers.cc:597] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.423429 17964 tablet_replica.cc:333] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.424912 17964 raft_consensus.cc:2243] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.425453 17964 raft_consensus.cc:2272] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.428220 17964 tablet_replica.cc:333] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.429006 17964 raft_consensus.cc:2243] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.429543 17964 raft_consensus.cc:2272] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.432300 17964 tablet_replica.cc:333] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.433099 17964 raft_consensus.cc:2243] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.434279 17964 raft_consensus.cc:2272] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.436993 17964 tablet_replica.cc:333] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.437738 17964 raft_consensus.cc:2243] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.438258 17964 raft_consensus.cc:2272] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.440810 17964 tablet_replica.cc:333] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.441560 17964 raft_consensus.cc:2243] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.442509 17964 raft_consensus.cc:2272] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.445187 17964 tablet_replica.cc:333] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.446039 17964 raft_consensus.cc:2243] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.447005 17964 raft_consensus.cc:2272] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.449820 17964 tablet_replica.cc:333] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.450582 17964 raft_consensus.cc:2243] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.451161 17964 raft_consensus.cc:2272] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.451507 25873 consensus_peers.cc:597] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.452174 25873 consensus_peers.cc:597] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.453739 17964 tablet_replica.cc:333] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.454627 17964 raft_consensus.cc:2243] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.455165 17964 raft_consensus.cc:2272] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.458303 17964 tablet_replica.cc:333] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.459091 17964 raft_consensus.cc:2243] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.460080 17964 raft_consensus.cc:2272] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.462821 17964 tablet_replica.cc:333] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.465400 17964 raft_consensus.cc:2243] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.465907 17964 raft_consensus.cc:2272] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.468287 17964 tablet_replica.cc:333] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.469552 17964 raft_consensus.cc:2243] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.470046 17964 raft_consensus.cc:2272] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.472776 17964 tablet_replica.cc:333] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.473567 17964 raft_consensus.cc:2243] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.474119 17964 raft_consensus.cc:2272] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.477016 17964 tablet_replica.cc:333] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.477829 17964 raft_consensus.cc:2243] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.478374 17964 raft_consensus.cc:2272] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.480763 17964 tablet_replica.cc:333] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.481488 17964 raft_consensus.cc:2243] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:28.482510 17964 raft_consensus.cc:2272] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.485210 17964 tablet_replica.cc:333] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.485996 17964 raft_consensus.cc:2243] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.486505 17964 raft_consensus.cc:2272] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.488998 17964 tablet_replica.cc:333] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.489679 17964 raft_consensus.cc:2243] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:28.489920 25873 consensus_peers.cc:597] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.490631 17964 raft_consensus.cc:2272] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:28.493439 17964 tablet_replica.cc:333] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: stopping tablet replica
I20260709 13:21:28.494091 17964 raft_consensus.cc:2243] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:28.494565 17964 raft_consensus.cc:2272] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:28.517403 25873 consensus_peers.cc:597] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.564515 25799 consensus_peers.cc:597] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.575016 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
W20260709 13:21:28.621937 25947 consensus_peers.cc:597] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.622541 25947 consensus_peers.cc:597] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.623339 25873 consensus_peers.cc:597] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.623855 25873 consensus_peers.cc:597] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.632136 25799 consensus_peers.cc:597] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.653630 25799 consensus_peers.cc:597] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.675781 25947 consensus_peers.cc:597] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.676369 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:28.677439 25799 consensus_peers.cc:597] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.691280 26527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:28.691416 25947 consensus_peers.cc:597] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.693214 25799 consensus_peers.cc:597] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.702518 25799 consensus_peers.cc:597] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.709082 26528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:28.712821 26530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:28.713491 25947 consensus_peers.cc:597] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.721619 17964 server_base.cc:1061] running on GCE node
W20260709 13:21:28.726596 25947 consensus_peers.cc:597] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.729832 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:28.730154 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:28.730374 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603288730355 us; error 0 us; skew 500 ppm
I20260709 13:21:28.731201 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:28.734577 17964 webserver.cc:533] Webserver started at http://127.17.139.1:44497/ using document root <none> and password file <none>
I20260709 13:21:28.735045 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:28.735208 17964 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:21:28.739137 17964 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:21:28.746722 26535 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:28.747605 17964 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:21:28.747943 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
format_stamp: "Formatted at 2026-07-09 13:21:15 on dist-test-slave-z675"
I20260709 13:21:28.748378 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:28.777892 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:28.779508 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:28.781517 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:28.807824 26542 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:21:29.067468 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 55321.9us
I20260709 13:21:29.210638 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:21:29.211086 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.419s	user 0.019s	sys 0.005s
I20260709 13:21:29.211413 17964 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:21:29.216993 26542 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.243098 26542 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.244380 26542 tablet_bootstrap.cc:492] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.245174 26542 ts_tablet_manager.cc:1403] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.012s
I20260709 13:21:29.250702 26542 raft_consensus.cc:359] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.251665 26542 raft_consensus.cc:740] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.252722 26542 consensus_queue.cc:260] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.268788 26542 ts_tablet_manager.cc:1434] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 13:21:29.270031 26542 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.292140 26542 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.293215 26542 tablet_bootstrap.cc:492] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.294014 26542 ts_tablet_manager.cc:1403] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:21:29.296672 26542 raft_consensus.cc:359] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.297451 26542 raft_consensus.cc:740] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.298306 26542 consensus_queue.cc:260] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.300357 26542 ts_tablet_manager.cc:1434] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:29.301216 26542 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.309029 26546 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.317159 26546 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.329685 26546 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:29.333050 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:29.334865 26542 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.336050 26542 tablet_bootstrap.cc:492] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.336980 26542 ts_tablet_manager.cc:1403] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.004s
I20260709 13:21:29.339849 26542 raft_consensus.cc:359] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.340674 26542 raft_consensus.cc:740] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.341634 26542 consensus_queue.cc:260] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.345013 26542 ts_tablet_manager.cc:1434] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:29.345971 26542 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.368184 26520 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.368765 26520 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.370817 26520 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.374082 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:29.389688 26549 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.390067 26520 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.390398 26549 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.390589 26520 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.392949 26520 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.394483 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:29.414788 26549 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:29.426915 25799 leader_election.cc:336] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.443176 26519 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.447665 25799 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.447896 26519 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.449254 26549 raft_consensus.cc:2749] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.450510 26519 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:29.455901 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:29.459553 25873 leader_election.cc:336] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.460034 25873 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.461263 26519 raft_consensus.cc:2749] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.461758 26520 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.462263 26520 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.464100 26520 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:29.446822 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 65961.2us
I20260709 13:21:29.465673 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:29.467912 25799 leader_election.cc:336] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.468990 26520 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.469547 26520 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.472586 26520 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.473495 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:29.482259 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:29.484936 25947 leader_election.cc:336] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.485473 25947 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.486277 26520 raft_consensus.cc:2749] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.488337 26549 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.489055 26549 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.501540 26549 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.535619 25797 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.540948 26550 raft_consensus.cc:2749] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:29.544185 25947 leader_election.cc:336] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.544976 25947 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.546212 26544 raft_consensus.cc:2749] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:29.546247 25947 leader_election.cc:336] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.546965 25947 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.548319 26544 raft_consensus.cc:2749] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.559387 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.559981 26542 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.560957 26542 tablet_bootstrap.cc:492] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.561635 26542 ts_tablet_manager.cc:1403] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.216s	user 0.076s	sys 0.068s
I20260709 13:21:29.564299 26542 raft_consensus.cc:359] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.565044 26542 raft_consensus.cc:740] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.565912 26542 consensus_queue.cc:260] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.567996 26542 ts_tablet_manager.cc:1434] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:29.568774 26542 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.571244 26544 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.571779 26544 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.573830 26544 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:29.575454 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:29.571264 25947 leader_election.cc:336] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.579013 25947 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.579849 26544 raft_consensus.cc:2749] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:29.585731 25799 leader_election.cc:336] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.586237 25799 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.587179 26542 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.587395 26546 raft_consensus.cc:2749] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.588351 26542 tablet_bootstrap.cc:492] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.589126 26542 ts_tablet_manager.cc:1403] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:21:29.589320 17964 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:21:29.589686 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.378s	user 0.233s	sys 0.021s
I20260709 13:21:29.592026 26542 raft_consensus.cc:359] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.592825 26542 raft_consensus.cc:740] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.593748 26542 consensus_queue.cc:260] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.596135 26542 ts_tablet_manager.cc:1434] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:21:29.597524 26542 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
W20260709 13:21:29.602607 25947 leader_election.cc:336] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.603116 25947 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.604038 26544 raft_consensus.cc:2749] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.608750 26544 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.609310 26544 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.611627 26544 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.612425 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:29.626776 25947 leader_election.cc:336] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.627269 25947 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.627972 26544 raft_consensus.cc:2749] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:29.637691 26542 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.638803 26542 tablet_bootstrap.cc:492] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.639509 26542 ts_tablet_manager.cc:1403] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.004s
I20260709 13:21:29.642400 26542 raft_consensus.cc:359] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.643194 26542 raft_consensus.cc:740] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.644105 26542 consensus_queue.cc:260] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.646610 26542 ts_tablet_manager.cc:1434] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:29.650869 26542 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.688912 26519 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.689625 26542 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.689473 26519 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.693511 26542 tablet_bootstrap.cc:492] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.694288 26542 ts_tablet_manager.cc:1403] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.004s
I20260709 13:21:29.694591 26519 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.690243 26548 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.695428 26548 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.696936 26542 raft_consensus.cc:359] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.703424 26542 raft_consensus.cc:740] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.701191 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.702008 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.705621 25980 raft_consensus.cc:2468] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:29.705106 26542 consensus_queue.cc:260] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.707401 25871 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:29.708302 26543 raft_consensus.cc:2804] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.708701 26543 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.709113 26543 raft_consensus.cc:3060] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.710355 26548 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.710942 26548 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.711412 26548 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.713603 26548 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:29.718479 25873 leader_election.cc:336] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:29.719511 25873 leader_election.cc:336] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.720088 25873 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.721194 26519 raft_consensus.cc:2749] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:29.722198 25873 leader_election.cc:336] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.725003 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:29.727876 25872 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.729048 26519 raft_consensus.cc:2749] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.708701 26542 ts_tablet_manager.cc:1434] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:21:29.729835 26543 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.731472 26542 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.734863 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:29.735509 25980 raft_consensus.cc:3060] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.743667 25980 raft_consensus.cc:2468] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:29.744822 25871 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:29.745652 26519 raft_consensus.cc:2804] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:29.745851 26548 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.746465 26548 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:29.747712 25873 leader_election.cc:336] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.749411 26543 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.749689 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:29.750324 25833 raft_consensus.cc:2468] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:29.751271 25872 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:29.751281 26548 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:29.753367 26548 raft_consensus.cc:2804] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.753928 26548 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.754456 26548 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.755779 26519 raft_consensus.cc:697] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:29.756781 26519 consensus_queue.cc:237] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:29.759013 25873 leader_election.cc:336] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.766467 26543 raft_consensus.cc:493] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.767405 26543 raft_consensus.cc:515] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.778415 26542 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.779134 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.779480 26542 tablet_bootstrap.cc:492] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.780256 26542 ts_tablet_manager.cc:1403] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.007s
I20260709 13:21:29.783031 26542 raft_consensus.cc:359] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.783748 26542 raft_consensus.cc:740] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.784584 26542 consensus_queue.cc:260] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.786871 26542 ts_tablet_manager.cc:1434] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 13:21:29.786846 25656 catalog_manager.cc:5697] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.788362 26543 leader_election.cc:290] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.790396 26543 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.791016 26543 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:29.792273 25873 leader_election.cc:336] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.792757 25873 leader_election.cc:304] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.793967 26519 raft_consensus.cc:2749] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.794656 26572 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.795708 26542 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.795289 26572 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.795843 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.797904 26572 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.798695 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.801180 25980 raft_consensus.cc:2468] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
W20260709 13:21:29.802698 25873 leader_election.cc:336] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.803390 25871 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.804379 26519 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.804548 26547 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.804950 26519 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.805262 26547 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.808039 26572 raft_consensus.cc:2804] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.808483 26572 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.808851 26572 raft_consensus.cc:3060] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.812521 26547 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.819433 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.820123 25981 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:29.826936 25797 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:29.827890 26547 raft_consensus.cc:2804] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.816459 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:29.828296 26547 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.828516 25980 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:29.828715 26547 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.830109 26549 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.833791 26549 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.836016 26549 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:29.836712 25871 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:29.839226 26544 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.839403 26545 raft_consensus.cc:493] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.839807 26544 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.839881 26545 raft_consensus.cc:515] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.841904 26544 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.842171 26545 leader_election.cc:290] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:29.847337 25799 leader_election.cc:336] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.855734 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:29.856079 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:29.856539 25901 raft_consensus.cc:2468] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:29.856848 25907 raft_consensus.cc:2468] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:29.858399 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:29.859061 25907 raft_consensus.cc:2468] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:29.859632 25797 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:29.861238 26546 raft_consensus.cc:2804] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.861635 26546 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.861994 26546 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.862112 26519 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.862766 26519 raft_consensus.cc:2804] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.863111 26519 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.863482 26519 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:29.864282 25799 leader_election.cc:336] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.860203 25945 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
W20260709 13:21:29.868343 25947 leader_election.cc:336] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:29.868848 25947 leader_election.cc:336] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.875262 25945 leader_election.cc:304] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.892014 26546 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.893232 26547 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.894914 26546 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:29.860152 26543 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.889330 26544 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.895957 26547 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.896461 26544 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.897521 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:29.898212 25980 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.899639 26548 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:29.900612 25799 leader_election.cc:336] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:29.901150 25799 leader_election.cc:336] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.902333 26548 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:29.902791 26545 raft_consensus.cc:2804] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.904994 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:29.905884 25833 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.908412 25980 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:29.909436 25797 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.911180 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:29.911794 25832 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:29.913201 25946 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:29.915351 26413 raft_consensus.cc:2804] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:29.915843 26413 raft_consensus.cc:697] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:29.916286 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:29.916589 26413 consensus_queue.cc:237] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.916832 25901 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.904991 26520 raft_consensus.cc:2804] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.905928 26544 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:29.923586 25947 leader_election.cc:336] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.910337 26545 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.926293 26545 raft_consensus.cc:3060] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.925246 26520 raft_consensus.cc:493] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.932621 26520 raft_consensus.cc:3060] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.920259 26492 raft_consensus.cc:2804] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:29.933245 26492 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.933602 26492 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:29.937599 25873 leader_election.cc:336] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.938247 25873 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.912891 26581 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
W20260709 13:21:29.940933 25873 leader_election.cc:336] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.913931 26547 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.952149 25833 raft_consensus.cc:2468] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:29.923174 26584 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.956355 25872 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:29.946225 26543 raft_consensus.cc:2749] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:29.963116 26544 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:29.953989 26581 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.965613 25901 raft_consensus.cc:2468] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
W20260709 13:21:29.970614 25873 leader_election.cc:336] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:29.964401 26572 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.974537 25797 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:29.960305 26492 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.976155 26549 raft_consensus.cc:2804] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:29.977051 26549 raft_consensus.cc:697] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:29.977552 26582 raft_consensus.cc:2804] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:29.977725 26520 raft_consensus.cc:515] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.978125 26582 raft_consensus.cc:697] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:29.977854 26549 consensus_queue.cc:237] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.978542 26542 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.979485 26542 tablet_bootstrap.cc:492] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:29.978977 26582 consensus_queue.cc:237] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.979799 26520 leader_election.cc:290] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.980129 26542 ts_tablet_manager.cc:1403] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.192s	user 0.046s	sys 0.029s
I20260709 13:21:29.973428 26544 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.982158 26492 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:29.982671 26542 raft_consensus.cc:359] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.983377 26542 raft_consensus.cc:740] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.984228 26542 consensus_queue.cc:260] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:29.986243 26542 ts_tablet_manager.cc:1434] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:29.982668 26544 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:29.986320 26545 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:29.987052 26542 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:29.991014 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:29.954393 26547 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:29.986433 26581 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:29.992595 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:29.991582 25832 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.993367 25831 raft_consensus.cc:2468] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:29.992679 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:29.993917 26547 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:29.994287 25907 raft_consensus.cc:3060] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.000702 25832 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:30.003901 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:30.004508 25901 raft_consensus.cc:2468] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:30.007180 25797 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:29.973050 26584 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.010439 26584 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:30.013559 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:30.014279 25981 raft_consensus.cc:2468] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
I20260709 13:21:30.016393 26413 raft_consensus.cc:2804] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:30.016845 26413 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:30.017200 26413 raft_consensus.cc:3060] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.019246 25946 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:30.021371 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:30.021981 25904 raft_consensus.cc:3060] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.022153 26587 raft_consensus.cc:2804] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:30.022584 26587 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:30.022917 26587 raft_consensus.cc:3060] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.020134 25946 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:30.025558 26544 raft_consensus.cc:2804] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.026065 26544 raft_consensus.cc:697] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:30.030885 26544 consensus_queue.cc:237] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:30.026021 26545 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:30.032980 25871 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:30.033277 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:30.033900 25980 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
W20260709 13:21:30.033946 25799 leader_election.cc:336] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.029340 26413 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:30.015905 26519 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.042833 25871 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:30.054873 26413 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:30.045727 26582 raft_consensus.cc:2804] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:30.077486 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:30.048388 26545 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:30.049912 26584 raft_consensus.cc:2804] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:30.082330 26584 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:30.082780 26584 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.079428 25901 raft_consensus.cc:3060] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.087173 26572 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:30.087046 26545 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.092931 26519 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:30.086231 25655 catalog_manager.cc:5697] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 2 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:30.098296 25873 leader_election.cc:336] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.077702 26582 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
W20260709 13:21:30.132383 25799 leader_election.cc:336] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.108927 26582 raft_consensus.cc:3060] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.155158 25901 raft_consensus.cc:2468] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
W20260709 13:21:30.156764 25947 leader_election.cc:336] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:30.145421 25873 leader_election.cc:336] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:30.157598 25947 leader_election.cc:336] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:30.158205 25947 leader_election.cc:336] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.167543 26545 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:30.170023 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 66740.5us
I20260709 13:21:30.184832 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:30.185524 25981 raft_consensus.cc:3060] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.185988 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:30.186586 25980 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.186230 25797 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:30.194268 25947 leader_election.cc:336] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.193987 25904 raft_consensus.cc:2468] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
W20260709 13:21:30.206149 25873 leader_election.cc:336] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:30.207019 25873 leader_election.cc:336] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:30.211745 25947 leader_election.cc:336] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.213130 26602 raft_consensus.cc:2804] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.213709 26602 raft_consensus.cc:697] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:30.214597 26602 consensus_queue.cc:237] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:30.214416 26587 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:30.188952 25907 raft_consensus.cc:2468] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:30.222604 25981 raft_consensus.cc:2468] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:30.228255 25980 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:30.230211 26587 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:30.238495 25947 leader_election.cc:336] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.244632 26542 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.246522 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:30.247112 25833 raft_consensus.cc:3060] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.284231 25945 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:30.285445 26544 raft_consensus.cc:2804] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.285933 26544 raft_consensus.cc:697] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:30.286723 26544 consensus_queue.cc:237] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.287420 25833 raft_consensus.cc:2468] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:30.288383 25946 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:30.289496 26520 raft_consensus.cc:2804] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.289682 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:30.290046 26520 raft_consensus.cc:697] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:30.290414 25907 raft_consensus.cc:2468] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:30.290931 26520 consensus_queue.cc:237] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
W20260709 13:21:30.304158 25873 consensus_peers.cc:597] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:30.305191 25945 leader_election.cc:304] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:30.245889 26584 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.309166 26584 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:30.310484 26582 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.313047 26542 tablet_bootstrap.cc:492] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:30.313892 26542 ts_tablet_manager.cc:1403] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.327s	user 0.032s	sys 0.012s
I20260709 13:21:30.315138 26582 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:30.322799 26587 raft_consensus.cc:2804] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.324716 26587 raft_consensus.cc:697] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:30.325915 26587 consensus_queue.cc:237] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:30.336043 25873 leader_election.cc:336] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.389575 26542 raft_consensus.cc:359] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:30.390646 26542 raft_consensus.cc:740] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.391563 26542 consensus_queue.cc:260] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:30.367947 25871 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:30.467180 25871 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 99363.9us
I20260709 13:21:30.468010 25871 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:30.467438 26542 ts_tablet_manager.cc:1434] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.153s	user 0.002s	sys 0.005s
I20260709 13:21:30.470306 26542 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:30.470954 25978 raft_consensus.cc:1275] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.476037 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:30.476786 25978 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.481273 25945 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:30.396217 26582 raft_consensus.cc:2804] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.500043 26545 raft_consensus.cc:2804] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:30.524338 26545 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:30.500636 26581 raft_consensus.cc:2804] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:30.526573 25978 raft_consensus.cc:2468] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 3.
W20260709 13:21:30.555208 26610 log.cc:927] Time spent T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:21:30.528316 26545 raft_consensus.cc:3060] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.565689 26581 raft_consensus.cc:697] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:30.566666 26581 consensus_queue.cc:237] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.527763 26582 raft_consensus.cc:697] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:30.568991 26582 consensus_queue.cc:237] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:30.569852 25873 leader_election.cc:336] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.611946 26545 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:30.617403 25947 consensus_peers.cc:597] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:30.614509 26598 consensus_queue.cc:1048] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:30.620158 25873 consensus_peers.cc:597] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:30.627583 25980 raft_consensus.cc:1275] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.628314 25832 raft_consensus.cc:1275] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.619712 26545 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:30.641158 25871 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:30.645292 26582 raft_consensus.cc:2804] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:30.645143 26586 consensus_queue.cc:1048] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:21:30.646051 26582 raft_consensus.cc:697] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
W20260709 13:21:30.646692 25947 leader_election.cc:336] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:30.647478 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:30.648054 25980 raft_consensus.cc:3060] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.657650 25907 raft_consensus.cc:1275] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:30.659863 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:30.660562 25903 raft_consensus.cc:3060] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.662256 25655 catalog_manager.cc:5697] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.664813 25656 catalog_manager.cc:5697] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.646917 26582 consensus_queue.cc:237] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.682713 25980 raft_consensus.cc:2468] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:30.704617 26623 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.705166 26623 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:30.709040 26623 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:30.689637 26550 consensus_queue.cc:1048] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:21:30.737792 26552 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.738596 26552 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:30.733350 26623 raft_consensus.cc:493] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.887622 26542 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:31.345825 26542 tablet_bootstrap.cc:492] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:31.346711 26542 ts_tablet_manager.cc:1403] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.877s	user 0.013s	sys 0.015s
W20260709 13:21:31.351267 17964 thread.cc:641] rpc worker (service pool kudu.consensus.ConsensusService) Time spent creating pthread: real 0.617s	user 0.006s	sys 0.004s
W20260709 13:21:31.466250 17964 thread.cc:608] rpc worker (service pool kudu.consensus.ConsensusService) Time spent starting thread: real 0.732s	user 0.006s	sys 0.005s
I20260709 13:21:30.824846 26623 raft_consensus.cc:515] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:31.906677 26552 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
W20260709 13:21:32.089067 26627 log.cc:927] Time spent T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: Append to log took a long time: real 0.507s	user 0.001s	sys 0.000s
I20260709 13:21:32.104162 26623 leader_election.cc:290] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.106938 26623 raft_consensus.cc:493] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.109025 26623 raft_consensus.cc:515] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.170965 26623 leader_election.cc:290] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:32.172703 26623 raft_consensus.cc:493] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.174500 26623 raft_consensus.cc:515] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.181218 26623 leader_election.cc:290] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.191279 25904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56626 (request call id 348) took 1502 ms. Trace:
I20260709 13:21:32.191695 25904 rpcz_store.cc:276] 0709 13:21:30.688692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.688978 (+   286us) service_pool.cc:224] Handling call
0709 13:21:32.190887 (+1501909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:32.191034 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:32.191054 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:32.191085 (+    31us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:21:32.191105 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:32.191146 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:32.191223 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:21:32.217803 26536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.486s	user 0.009s	sys 0.009s
W20260709 13:21:32.218178 26536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.489s	user 0.009s	sys 0.009s
I20260709 13:21:32.218750 26629 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.219441 26629 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.222455 26629 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:32.255635 17964 thread.cc:641] rpc worker (service pool kudu.consensus.ConsensusService) Time spent creating pthread: real 0.789s	user 0.032s	sys 0.027s
W20260709 13:21:32.256707 17964 thread.cc:608] rpc worker (service pool kudu.consensus.ConsensusService) Time spent starting thread: real 0.790s	user 0.033s	sys 0.027s
I20260709 13:21:32.300745 26638 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.302126 26638 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.306243 26638 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.306797 26642 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.307049 26638 raft_consensus.cc:493] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.307157 26643 raft_consensus.cc:493] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.307935 26642 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.309163 26643 raft_consensus.cc:515] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.311069 26642 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.311713 26642 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.312522 26642 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.313426 26643 leader_election.cc:290] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.315173 26642 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.308166 26638 raft_consensus.cc:515] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.318145 26638 leader_election.cc:290] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.320029 26638 raft_consensus.cc:493] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.320958 26638 raft_consensus.cc:515] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.321760 26641 raft_consensus.cc:493] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.322703 26641 raft_consensus.cc:515] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.323603 26642 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.324276 26642 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.323179 26638 leader_election.cc:290] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:32.325074 26641 leader_election.cc:290] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.325223 26638 raft_consensus.cc:493] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.325953 26638 raft_consensus.cc:515] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.326174 26642 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:32.328130 26638 leader_election.cc:290] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.333263 26646 raft_consensus.cc:493] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.334262 26646 raft_consensus.cc:515] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.334686 26645 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.335804 26645 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.337432 26646 leader_election.cc:290] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.339025 26645 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:32.345789 26645 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.346498 26646 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.346905 26645 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.347399 26646 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.349957 26646 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:32.350365 26645 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:32.350512 26646 raft_consensus.cc:493] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.351516 26646 raft_consensus.cc:515] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.353690 26647 raft_consensus.cc:493] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.353987 26646 leader_election.cc:290] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.354660 26646 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.354813 26647 raft_consensus.cc:515] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.355512 26646 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.358562 26646 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:32.359266 26647 leader_election.cc:290] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.365373 25871 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:32.366889 26649 raft_consensus.cc:2804] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.371120 26649 raft_consensus.cc:697] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:32.373090 26649 consensus_queue.cc:237] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:32.437071 26619 log.cc:927] Time spent T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 1.799s	user 0.014s	sys 0.007s
I20260709 13:21:32.448854 26638 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.449501 26642 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.449843 26638 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.450489 26642 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.451800 26638 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.453293 26642 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.455470 26643 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.456233 26643 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.458386 26643 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.462368 26641 raft_consensus.cc:493] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.463058 26641 raft_consensus.cc:515] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.464375 26644 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.465659 26644 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:32.466595 26539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.028s	sys 0.028s
W20260709 13:21:32.467160 26539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.028s	sys 0.028s
I20260709 13:21:32.468025 26644 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:32.468714 26538 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.003s	sys 0.006s
W20260709 13:21:32.469331 26538 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.736s	user 0.006s	sys 0.009s
I20260709 13:21:32.470568 26638 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.471395 26638 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.476716 26642 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.474459 26641 leader_election.cc:290] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.468609 26644 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.479840 26638 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.479995 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.480942 25905 raft_consensus.cc:1275] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.480664 26642 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.481079 25904 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:32.482383 26644 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.485554 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.486635 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.485543 26642 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.489925 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.485893 26644 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.490811 25904 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:32.493512 25656 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57608 (request call id 100) took 2293 ms. Trace:
I20260709 13:21:32.495599 25655 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57622 (request call id 103) took 1878 ms. Trace:
I20260709 13:21:32.494155 25656 rpcz_store.cc:276] 0709 13:21:30.200159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.200340 (+   181us) service_pool.cc:224] Handling call
0709 13:21:32.493239 (+2292899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:30.706688 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:30.707257 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:30.707284 (+    27us) write_op.cc:435] Acquired schema lock
0709 13:21:30.707305 (+    21us) tablet.cc:662] Decoding operations
0709 13:21:30.707617 (+   312us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:30.707656 (+    39us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:30.707681 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:30.707881 (+   200us) tablet.cc:701] Row locks acquired
0709 13:21:30.707904 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:21:30.708020 (+   116us) write_op.cc:270] Start()
0709 13:21:30.708111 (+    91us) write_op.cc:276] Timestamp: P: 1783603290707973 usec, L: 0
0709 13:21:30.708133 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:21:30.780525 (+ 72392us) log.cc:844] Serialized 537 byte log entry
0709 13:21:32.190187 (+1409662us) op_driver.cc:464] REPLICATION: finished
0709 13:21:32.212504 (+ 22317us) write_op.cc:301] APPLY: starting
0709 13:21:32.212572 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:32.212673 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:32.212757 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:32.213002 (+   245us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:32.213148 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:21:32.213188 (+    40us) write_op.cc:312] APPLY: finished
0709 13:21:32.213359 (+   171us) log.cc:844] Serialized 22 byte log entry
0709 13:21:32.213480 (+   121us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:32.213547 (+    67us) write_op.cc:454] Released schema lock
0709 13:21:32.213577 (+    30us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:32.213828 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:32.213851 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":22147,"apply.run_cpu_time_us":1297,"apply.run_wall_time_us":1296,"num_ops":1,"prepare.queue_time_us":27859,"prepare.run_cpu_time_us":2948,"prepare.run_wall_time_us":155822,"replication_time_us":1481940,"thread_start_us":20366,"threads_started":1}]]}
I20260709 13:21:32.500129 25945 leader_election.cc:304] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.501000 26642 consensus_queue.cc:1048] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:32.502038 25945 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.502934 26642 raft_consensus.cc:2804] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:32.504284 26642 raft_consensus.cc:493] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.503599 26651 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:32.504961 26651 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.505460 26651 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.509028 26642 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.523371 26646 raft_consensus.cc:493] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.527244 26648 raft_consensus.cc:493] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.524665 26646 raft_consensus.cc:515] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.529748 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.530030 26642 raft_consensus.cc:515] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.531729 26646 leader_election.cc:290] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.523504 26651 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.535068 26651 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.528260 26648 raft_consensus.cc:515] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.536252 26642 leader_election.cc:290] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.537735 26648 leader_election.cc:290] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.540081 25902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56626 (request call id 349) took 1842 ms. Trace:
I20260709 13:21:32.540302 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.541317 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.541330 26645 raft_consensus.cc:493] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.542481 25899 raft_consensus.cc:2468] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:32.542770 26645 raft_consensus.cc:515] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.540515 25902 rpcz_store.cc:276] 0709 13:21:30.697122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.702427 (+  5305us) service_pool.cc:224] Handling call
0709 13:21:30.710942 (+  8515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:30.711124 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.711156 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:32.539379 (+1828223us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:21:32.539514 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:32.539665 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:32.539893 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:32.547263 25907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56614 (request call id 178) took 1855 ms. Trace:
I20260709 13:21:32.547693 25907 rpcz_store.cc:276] 0709 13:21:30.691474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.692720 (+  1246us) service_pool.cc:224] Handling call
0709 13:21:32.546550 (+1853830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:32.546855 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:32.546875 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:32.546928 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:21:32.546984 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:32.547030 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:32.547123 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:32.550680 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.551295 25904 raft_consensus.cc:2468] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:32.556391 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:32.558751 25904 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.533061 25655 rpcz_store.cc:276] 0709 13:21:30.616664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.616824 (+   160us) service_pool.cc:224] Handling call
0709 13:21:32.495330 (+1878506us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:30.704035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:30.704602 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:30.704636 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:21:30.704654 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:30.705016 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:30.705086 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:30.705117 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:30.705289 (+   172us) tablet.cc:701] Row locks acquired
0709 13:21:30.705306 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:21:30.705463 (+   157us) write_op.cc:270] Start()
0709 13:21:30.705571 (+   108us) write_op.cc:276] Timestamp: P: 1783603290705415 usec, L: 0
0709 13:21:30.705592 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:21:30.706215 (+   623us) log.cc:844] Serialized 537 byte log entry
0709 13:21:31.924620 (+1218405us) op_driver.cc:464] REPLICATION: finished
0709 13:21:32.189186 (+264566us) write_op.cc:301] APPLY: starting
0709 13:21:32.189280 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:32.189386 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:32.189505 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:32.189755 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:32.189930 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:21:32.190005 (+    75us) write_op.cc:312] APPLY: finished
0709 13:21:32.190215 (+   210us) log.cc:844] Serialized 22 byte log entry
0709 13:21:32.211662 (+ 21447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:32.211743 (+    81us) write_op.cc:454] Released schema lock
0709 13:21:32.211794 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:32.212148 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:32.212179 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":228768,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":250429,"apply.run_cpu_time_us":13645,"apply.run_wall_time_us":22975,"num_ops":1,"prepare.queue_time_us":27542,"prepare.run_cpu_time_us":2494,"prepare.run_wall_time_us":2495,"replication_time_us":839139,"thread_start_us":196926,"threads_started":3,"wal-append.queue_time_us":26367}]]}
I20260709 13:21:32.560822 25945 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.571319 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.566829 26641 raft_consensus.cc:493] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.571841 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:32.560747 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.613458 25902 raft_consensus.cc:2468] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:32.607465 26641 raft_consensus.cc:515] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.616035 26641 leader_election.cc:290] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.608599 25900 raft_consensus.cc:2468] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:32.618279 25898 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.598083 26642 raft_consensus.cc:2804] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:32.561866 26652 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.623935 25904 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:32.612010 26542 raft_consensus.cc:359] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.627362 26542 raft_consensus.cc:740] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.630697 26643 raft_consensus.cc:493] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.631749 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41746 (request call id 229) took 1937 ms. Trace:
I20260709 13:21:32.631621 26643 raft_consensus.cc:515] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.632169 25832 rpcz_store.cc:276] 0709 13:21:30.693702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.693838 (+   136us) service_pool.cc:224] Handling call
0709 13:21:30.708605 (+ 14767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:30.708773 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.708798 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:30.708839 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:21:30.708867 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:32.631270 (+1922403us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:32.631454 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:32.637300 26542 consensus_queue.cc:260] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.640323 26645 leader_election.cc:290] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.641148 26542 ts_tablet_manager.cc:1434] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 1.294s	user 0.016s	sys 0.001s
I20260709 13:21:32.621914 26642 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.651374 26643 leader_election.cc:290] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:32.629072 25945 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.656765 26656 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.657809 26656 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.621482 26652 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:32.654894 26542 ts_tablet_manager.cc:1467] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373: Tablet startup took 1307ms
W20260709 13:21:32.663228 26537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.009s	sys 0.004s
W20260709 13:21:32.665110 26537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.010s	sys 0.004s
I20260709 13:21:32.670279 26641 raft_consensus.cc:2804] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:32.670769 26641 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.671208 26641 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.668183 26643 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.673959 25901 raft_consensus.cc:1240] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:32.674510 26643 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.680442 26652 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.676122 26656 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.681789 26542 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:32.656381 26642 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.696542 25945 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.697576 26638 raft_consensus.cc:2804] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:32.697937 26638 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.698287 26638 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.715969 25945 leader_election.cc:304] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.729149 25945 leader_election.cc:304] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.736199 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:32.736699 25903 consensus_meta.cc:287] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828: Time spent flushing consensus metadata: real 2.076s	user 0.015s	sys 0.010s
I20260709 13:21:32.737205 25903 raft_consensus.cc:2468] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:32.737424 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:32.737885 25903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56614 (request call id 177) took 2082 ms (client timeout 1882 ms). Trace:
I20260709 13:21:32.738078 25978 raft_consensus.cc:2468] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 1.
W20260709 13:21:32.738293 25903 rpcz_store.cc:269] 0709 13:21:30.655751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.656377 (+   626us) service_pool.cc:224] Handling call
0709 13:21:32.737785 (+2081408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:32.733235 26651 raft_consensus.cc:2804] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:32.740912 26651 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.741310 26651 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.741379 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0689353df4c828d77cdd393901a86" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.742738 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.734038 26641 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.744027 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.755821 25871 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.759498 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.745828 26641 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.761886 25977 raft_consensus.cc:1275] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.762141 26641 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.762758 26641 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.736284 26656 raft_consensus.cc:2804] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.721822 25898 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:32.784904 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:32.785547 26656 raft_consensus.cc:697] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:32.785737 25906 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:32.772889 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.763411 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:32.773873 25975 raft_consensus.cc:1275] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:32.796192 25981 raft_consensus.cc:2393] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 2: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:32.766637 26643 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:32.769007 26607 raft_consensus.cc:493] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.803453 26581 raft_consensus.cc:2804] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:32.798840 26646 consensus_queue.cc:1048] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:21:32.804641 26413 raft_consensus.cc:493] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.805267 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.775705 26550 raft_consensus.cc:493] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:32.777311 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:32.769076 26642 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.776068 26615 raft_consensus.cc:493] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:32.790627 26645 consensus_queue.cc:1048] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:21:32.815812 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.816025 26615 raft_consensus.cc:515] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.817490 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.818152 26629 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.820276 26550 raft_consensus.cc:515] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.808291 26581 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:32.821810 25980 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53002 (request call id 140) took 2105 ms. Trace:
I20260709 13:21:32.808293 26656 consensus_queue.cc:237] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.822134 26607 raft_consensus.cc:515] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:31.908836 26552 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.826514 26651 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.814314 25945 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.821163 26413 raft_consensus.cc:515] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.812528 26638 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:32.845234 25980 rpcz_store.cc:276] 0709 13:21:30.716611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.716783 (+   172us) service_pool.cc:224] Handling call
0709 13:21:30.717208 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:30.717638 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.717677 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:30.718218 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:21:30.743019 (+ 24801us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:21:30.743061 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:30.743131 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:32.821402 (+2078271us) raft_consensus.cc:1685] finished
0709 13:21:32.821439 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:32.821618 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3480,"raft.queue_time_us":2127,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6715,"thread_start_us":24472,"threads_started":1,"wal-append.queue_time_us":630092}
I20260709 13:21:32.856986 25831 raft_consensus.cc:2468] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:32.857432 26638 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.858081 26651 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.854691 26629 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.858927 26552 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:32.862656 25906 raft_consensus.cc:2468] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:32.867785 26629 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:32.868433 26629 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.869035 26629 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.869747 26641 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:32.851812 26581 raft_consensus.cc:3060] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:32.868456 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 51043.1us
I20260709 13:21:32.875243 26629 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.875435 26550 leader_election.cc:290] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:32.865797 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 51529.7us
I20260709 13:21:32.878413 25945 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:32.870862 26638 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.886953 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:32.887107 26638 raft_consensus.cc:697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:32.887670 26413 leader_election.cc:290] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.886991 25976 raft_consensus.cc:2393] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 2: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:32.888238 26638 consensus_queue.cc:237] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:32.888770 25947 consensus_peers.cc:597] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:32.890986 26615 leader_election.cc:290] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:32.891574 25905 raft_consensus.cc:1275] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.887614 25906 raft_consensus.cc:1275] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.893116 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:32.893428 25977 raft_consensus.cc:1240] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:32.892530 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:32.907105 26615 raft_consensus.cc:493] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:32.907753 26615 raft_consensus.cc:515] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:32.920852 26615 leader_election.cc:290] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.921433 26615 raft_consensus.cc:493] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:32.922015 26615 raft_consensus.cc:515] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:32.894786 26644 raft_consensus.cc:2804] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:32.925014 25833 raft_consensus.cc:1275] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.904675 26641 consensus_queue.cc:1048] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:21:32.934758 25980 raft_consensus.cc:1240] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:32.935784 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:32.936460 25904 raft_consensus.cc:2376] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2. Re-sending same reply.
I20260709 13:21:32.930546 26644 raft_consensus.cc:697] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:32.940478 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.954291 26642 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.957755 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.958534 25831 raft_consensus.cc:2468] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:32.959280 26607 leader_election.cc:290] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:32.959352 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.960603 26602 consensus_queue.cc:1048] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:21:32.962255 26552 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:32.964675 25978 raft_consensus.cc:1275] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:32.973448 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.947906 26615 leader_election.cc:290] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:32.940416 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.960645 26542 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:32.983434 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:32.984253 26548 consensus_queue.cc:1048] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:21:32.986645 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.986959 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:32.990590 25945 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:32.969203 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.005999 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.007140 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.007578 26542 tablet_bootstrap.cc:492] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:33.008455 26542 ts_tablet_manager.cc:1403] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.327s	user 0.022s	sys 0.018s
I20260709 13:21:33.008285 26546 raft_consensus.cc:493] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:33.008988 26546 raft_consensus.cc:515] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:33.009675 26644 consensus_queue.cc:237] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.011103 26542 raft_consensus.cc:359] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:33.011847 26542 raft_consensus.cc:740] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.012647 26542 consensus_queue.cc:260] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:33.006322 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:33.017709 26627 log.cc:927] Time spent T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:21:33.018280 26542 ts_tablet_manager.cc:1434] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:33.018525 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.019305 26542 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:33.022356 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.022855 25901 raft_consensus.cc:2468] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:33.024562 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.005614 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.033340 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.033542 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.034241 25898 raft_consensus.cc:2468] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:33.034435 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.035907 26671 raft_consensus.cc:493] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:33.004244 26646 raft_consensus.cc:493] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:33.040280 26671 raft_consensus.cc:515] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:33.041038 26641 raft_consensus.cc:2804] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:33.041587 26641 raft_consensus.cc:697] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:33.042822 26671 leader_election.cc:290] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:33.042644 26641 consensus_queue.cc:237] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:33.011164 26546 leader_election.cc:290] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:33.049225 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.051035 26646 raft_consensus.cc:515] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:33.051894 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.053061 26537 leader_election.cc:304] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:33.053469 25827 raft_consensus.cc:1275] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:33.066520 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 99388.8us
I20260709 13:21:33.066574 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.067883 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.068640 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.069092 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.070096 25824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.070355 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.071089 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.035940 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.071614 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.072925 26552 raft_consensus.cc:2804] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:33.073385 26552 raft_consensus.cc:493] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.073729 26552 raft_consensus.cc:3060] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.073853 26537 leader_election.cc:304] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:33.079921 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.057356 26550 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.074834 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.081426 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.083436 25655 catalog_manager.cc:5697] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 2 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:33.093567 26678 log.cc:927] Time spent T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:21:33.085013 26629 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.094996 26629 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:33.093616 26550 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:33.105983 25974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.110502 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.096606 25981 raft_consensus.cc:1275] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.120033 26537 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.091239 25832 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:33.109143 26672 raft_consensus.cc:2804] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:33.108454 25976 raft_consensus.cc:1240] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.163015 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.193301 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.193514 25655 catalog_manager.cc:5697] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 2 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.194451 25973 raft_consensus.cc:2468] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
I20260709 13:21:33.195503 25946 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.202368 25980 raft_consensus.cc:1240] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.203610 26664 raft_consensus.cc:2804] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:33.204047 26664 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:33.204388 26664 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.204706 26629 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:33.205322 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 73329us
I20260709 13:21:33.207830 26413 consensus_queue.cc:1059] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.208986 26546 raft_consensus.cc:3055] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.209332 26546 raft_consensus.cc:740] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:33.210415 26546 consensus_queue.cc:260] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.211445 26546 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.172164 26643 consensus_queue.cc:1048] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:21:33.214705 26552 raft_consensus.cc:515] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:33.186069 26672 raft_consensus.cc:493] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.230094 26615 consensus_queue.cc:1048] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:21:33.233421 26629 raft_consensus.cc:2749] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.232535 26581 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:33.235249 25947 leader_election.cc:336] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.235742 25947 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.239864 26652 raft_consensus.cc:2749] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:33.223942 26672 raft_consensus.cc:3060] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:33.239245 25947 consensus_peers.cc:597] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.245574 26688 log.cc:927] Time spent T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828: Append to log took a long time: real 0.107s	user 0.005s	sys 0.000s
W20260709 13:21:33.242844 25947 consensus_peers.cc:597] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.248380 26646 leader_election.cc:290] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:33.252732 25947 consensus_peers.cc:597] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.259336 25947 consensus_peers.cc:597] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.257939 25687 debug-util.cc:398] Leaking SignalData structure 0x7b080018f7a0 after lost signal to thread 17967
W20260709 13:21:33.259775 25947 consensus_peers.cc:597] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.261869 25947 leader_election.cc:336] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.262249 25947 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:33.263188 25947 leader_election.cc:336] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.263414 26656 raft_consensus.cc:2749] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.263590 25947 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:33.261023 25687 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0680 after lost signal to thread 25690
W20260709 13:21:33.265924 25687 debug-util.cc:398] Leaking SignalData structure 0x7b0800395b40 after lost signal to thread 25857
I20260709 13:21:33.266999 26581 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:33.258322 26687 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.268090 26550 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:33.268628 26537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 182550us
I20260709 13:21:33.269914 25946 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.270889 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:33.274210 25906 raft_consensus.cc:3060] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:33.276016 25873 leader_election.cc:336] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.276604 25873 leader_election.cc:336] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.277141 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9adacf3baa64bbc9f77334887ac19bd" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:33.277989 25873 leader_election.cc:336] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.278517 25873 leader_election.cc:336] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.279096 25873 consensus_peers.cc:597] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.279633 25873 consensus_peers.cc:597] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.268567 26687 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
W20260709 13:21:33.280256 25873 leader_election.cc:336] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.280821 25873 leader_election.cc:336] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.280987 26685 log.cc:927] Time spent T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:21:33.281404 25873 leader_election.cc:336] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.281940 25873 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111) [suppressed 228 similar messages]
I20260709 13:21:33.281989 26687 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:33.272328 26642 raft_consensus.cc:2749] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:33.283252 25873 consensus_peers.cc:597] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.268283 25687 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7380 after lost signal to thread 25931
W20260709 13:21:33.285667 25687 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5f60 after lost signal to thread 26005
W20260709 13:21:33.286305 25687 debug-util.cc:398] Leaking SignalData structure 0x7b080034b2c0 after lost signal to thread 26525
I20260709 13:21:33.286881 25906 raft_consensus.cc:2468] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
W20260709 13:21:33.287118 25687 debug-util.cc:398] Leaking SignalData structure 0x7b080012ec80 after lost signal to thread 26572
W20260709 13:21:33.273342 25947 leader_election.cc:336] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.291320 25947 leader_election.cc:336] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.291472 25873 consensus_peers.cc:597] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.292150 25873 consensus_peers.cc:597] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.292269 26537 leader_election.cc:304] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
W20260709 13:21:33.292934 25873 consensus_peers.cc:597] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.293188 26629 raft_consensus.cc:2804] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:21:33.293406 25873 consensus_peers.cc:597] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.291891 25947 leader_election.cc:304] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.271502 26664 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:33.294342 25873 leader_election.cc:336] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.294744 25947 leader_election.cc:336] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.279229 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.301057 25947 leader_election.cc:304] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.302045 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.301517 26641 raft_consensus.cc:2749] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:33.304702 25947 leader_election.cc:336] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.305590 25947 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.296294 26642 raft_consensus.cc:2749] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.306453 26656 raft_consensus.cc:2749] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.307777 26643 raft_consensus.cc:2749] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.242048 26552 leader_election.cc:290] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:33.310024 25873 leader_election.cc:336] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.307320 25947 leader_election.cc:336] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.306318 25946 leader_election.cc:304] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.312988 25947 leader_election.cc:304] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.314083 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.319736 26664 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:33.320758 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:33.322242 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.322633 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.312677 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.324960 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.327294 25656 catalog_manager.cc:5697] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:33.328994 25947 leader_election.cc:336] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.329458 25947 leader_election.cc:304] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:33.330540 25947 consensus_peers.cc:597] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.330925 25947 leader_election.cc:336] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.331298 25947 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:33.332928 25947 consensus_peers.cc:597] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.333930 25946 leader_election.cc:304] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.334960 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.332193 26643 raft_consensus.cc:2749] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.331454 25656 catalog_manager.cc:5697] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.325256 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d400a9f48b4625b8af26e86e19461d" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.332811 26656 raft_consensus.cc:2749] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:33.337759 25946 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.330309 26642 raft_consensus.cc:2749] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.338757 26651 raft_consensus.cc:2749] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.341028 26656 raft_consensus.cc:2749] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.342514 26694 raft_consensus.cc:2749] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.344722 25946 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.332428 26664 consensus_queue.cc:1048] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:21:33.329124 26629 raft_consensus.cc:697] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:33.343488 25656 catalog_manager.cc:5697] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } }
W20260709 13:21:33.348479 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 102502us
I20260709 13:21:33.355558 26694 raft_consensus.cc:2749] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.348359 25946 leader_election.cc:304] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.360898 25946 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.361750 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.363027 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.363225 26538 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:33.364338 26698 raft_consensus.cc:2804] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:33.356549 25656 catalog_manager.cc:5697] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 2 to 3, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:33.365296 25799 consensus_peers.cc:597] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.366055 26664 raft_consensus.cc:2749] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.367208 26694 raft_consensus.cc:2749] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:33.365865 25946 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.369796 26656 raft_consensus.cc:2804] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:33.370409 26656 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:33.370813 26656 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.371332 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.367846 25656 catalog_manager.cc:5697] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.365342 26698 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.377136 26698 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.378459 26672 raft_consensus.cc:515] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:33.380852 26542 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.383327 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.385671 26537 leader_election.cc:304] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
W20260709 13:21:33.388447 25947 consensus_peers.cc:597] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.389057 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 55631.9us
W20260709 13:21:33.389711 25947 leader_election.cc:336] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.390177 25947 leader_election.cc:304] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:33.391839 25947 leader_election.cc:336] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:33.392378 25947 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.396447 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.400233 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.393570 26651 raft_consensus.cc:2749] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.364425 26629 consensus_queue.cc:237] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:33.407105 25977 raft_consensus.cc:1240] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Rejecting Update request from peer e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.408107 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.408154 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.409397 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.395372 26537 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.413290 26672 leader_election.cc:290] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:33.413846 26542 tablet_bootstrap.cc:492] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:33.421849 26542 ts_tablet_manager.cc:1403] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.403s	user 0.026s	sys 0.013s
I20260709 13:21:33.396512 26552 raft_consensus.cc:2749] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.396415 26642 raft_consensus.cc:2749] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:33.394253 26548 consensus_queue.cc:1048] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:21:33.404199 25656 catalog_manager.cc:5697] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } }
I20260709 13:21:33.428256 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:33.430730 25977 raft_consensus.cc:3060] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.433089 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926bedb86c194b7787f058066b3abbb7" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.435346 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:33.443192 25975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.446519 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a2398487364fe5b17151c707da3d38" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.438553 26552 raft_consensus.cc:2749] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.448133 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771eedb34a9845bb876bb0217d55cb4f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:33.450522 25873 consensus_peers.cc:597] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.464233 25979 raft_consensus.cc:1240] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.464421 25906 raft_consensus.cc:1275] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.465039 26542 raft_consensus.cc:359] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:33.465740 26542 raft_consensus.cc:740] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.466449 26542 consensus_queue.cc:260] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:33.466995 26641 consensus_queue.cc:1048] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.467816 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b847d9971e4cc59c55d60bca9bd6fa" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:33.437389 26698 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:33.461807 26550 consensus_queue.cc:1059] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:21:33.469941 25903 raft_consensus.cc:1240] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.476104 26602 consensus_queue.cc:1059] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:21:33.483939 26602 raft_consensus.cc:3055] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.484256 26602 raft_consensus.cc:740] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:33.485144 26602 consensus_queue.cc:260] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.486366 26602 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.489138 25872 leader_election.cc:304] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.468851 26542 ts_tablet_manager.cc:1434] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 13:21:33.478775 26698 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:33.479868 26550 raft_consensus.cc:3055] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.491582 26550 raft_consensus.cc:740] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
W20260709 13:21:33.489364 25947 consensus_peers.cc:597] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.492529 26550 consensus_queue.cc:260] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.493886 26550 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.495167 26542 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
W20260709 13:21:33.500799 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 63735.9us
I20260709 13:21:33.501443 25872 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.503122 26548 raft_consensus.cc:2749] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.504383 25872 leader_election.cc:304] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.504936 26646 raft_consensus.cc:2749] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.505355 26645 raft_consensus.cc:2749] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.505602 26649 consensus_queue.cc:1059] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:33.506738 26649 raft_consensus.cc:3055] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.507061 26649 raft_consensus.cc:740] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:33.505146 25824 raft_consensus.cc:1275] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.508989 25871 leader_election.cc:304] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.509909 25872 leader_election.cc:304] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.510327 26645 raft_consensus.cc:2749] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:33.512065 26645 raft_consensus.cc:2749] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.510492 26649 consensus_queue.cc:260] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.516196 26649 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:33.520987 25873 consensus_peers.cc:597] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.525808 25799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:33.534663 25904 raft_consensus.cc:1275] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.538224 25872 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:33.539254 25872 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:33.539752 25977 raft_consensus.cc:2468] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:33.540333 25981 raft_consensus.cc:1240] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.541932 25872 leader_election.cc:304] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.536761 26641 consensus_queue.cc:1048] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:33.549002 25947 consensus_peers.cc:597] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.546851 25799 consensus_peers.cc:597] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.601712 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 52787.8us
W20260709 13:21:33.601806 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 54999.9us
W20260709 13:21:33.602387 25799 consensus_peers.cc:597] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.602820 25799 consensus_peers.cc:597] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.603207 25799 consensus_peers.cc:597] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.603603 25799 leader_election.cc:336] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.603938 25946 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 54154.9us
W20260709 13:21:33.604038 25799 leader_election.cc:336] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.604580 25799 leader_election.cc:336] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.605598 25799 leader_election.cc:336] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.606032 25799 leader_election.cc:336] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.606434 25799 leader_election.cc:336] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.606843 25799 leader_election.cc:336] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.607625 25799 leader_election.cc:336] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
W20260709 13:21:33.602401 25947 consensus_peers.cc:597] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.604602 25946 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.600600 25872 leader_election.cc:304] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.576833 26687 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.604990 26645 raft_consensus.cc:2749] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.621387 26413 consensus_queue.cc:1059] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:21:33.610709 26548 raft_consensus.cc:2749] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:33.621142 26537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 227793us
I20260709 13:21:33.653683 26413 consensus_queue.cc:1243] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer 33e3240923e54438a22da49413055ab3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:21:33.618935 26615 consensus_queue.cc:1059] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:21:33.619166 26651 consensus_queue.cc:1048] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:21:33.670830 26645 raft_consensus.cc:2749] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.689693 26587 raft_consensus.cc:2749] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:21:33.691255 26705 log.cc:927] Time spent T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:21:33.699393 26673 raft_consensus.cc:3055] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.699880 26673 raft_consensus.cc:740] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:33.691969 26615 consensus_queue.cc:1243] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer 33e3240923e54438a22da49413055ab3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:21:33.664366 26656 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.687917 26537 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
W20260709 13:21:33.723135 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 122616us
I20260709 13:21:33.700850 26673 consensus_queue.cc:260] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.725579 25906 raft_consensus.cc:1275] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.731531 25871 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
W20260709 13:21:33.736320 26537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 54539.7us
W20260709 13:21:33.736992 25947 consensus_peers.cc:597] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.738611 26710 log.cc:927] Time spent T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:21:33.735391 25872 leader_election.cc:304] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.758538 25872 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.760069 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
W20260709 13:21:33.767735 25799 consensus_peers.cc:597] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.769182 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:33.769907 25906 raft_consensus.cc:3060] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.756714 26673 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.759714 26548 raft_consensus.cc:2804] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:33.768359 26646 raft_consensus.cc:2749] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:33.773180 26645 raft_consensus.cc:2749] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:33.792392 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 161613us
I20260709 13:21:33.796204 26542 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.797027 26542 tablet_bootstrap.cc:492] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:33.797891 26542 ts_tablet_manager.cc:1403] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.305s	user 0.026s	sys 0.011s
I20260709 13:21:33.802212 25797 leader_election.cc:304] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.807507 26731 raft_consensus.cc:2749] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.806843 25797 leader_election.cc:304] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.809116 26615 raft_consensus.cc:2749] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.808113 26709 raft_consensus.cc:2804] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:33.810380 25799 consensus_peers.cc:597] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.830752 25797 leader_election.cc:304] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.829783 25973 raft_consensus.cc:1240] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Rejecting Update request from peer e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.832181 26548 raft_consensus.cc:697] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
W20260709 13:21:33.840421 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 57917.7us
I20260709 13:21:33.831143 26709 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.844830 25906 raft_consensus.cc:2468] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:33.835131 26607 raft_consensus.cc:2749] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.848531 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.851411 25797 leader_election.cc:304] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:33.852577 25906 raft_consensus.cc:1275] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:33.853123 25797 leader_election.cc:304] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:33.843812 26656 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:33.856346 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:33.847718 26709 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.861171 26413 raft_consensus.cc:2749] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.850991 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.853610 26602 raft_consensus.cc:3055] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.867043 26602 raft_consensus.cc:740] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:33.867686 26722 raft_consensus.cc:493] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:33.867841 26602 consensus_queue.cc:260] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.868268 26722 raft_consensus.cc:515] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.869104 26602 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:33.870632 26722 leader_election.cc:290] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:33.842088 26671 consensus_queue.cc:1059] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:21:33.871475 26548 consensus_queue.cc:237] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.872165 26671 raft_consensus.cc:3055] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:33.872556 26671 raft_consensus.cc:740] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:33.873323 26671 consensus_queue.cc:260] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:33.874465 26671 raft_consensus.cc:3060] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:33.875717 25799 consensus_peers.cc:597] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:33.850728 26651 consensus_queue.cc:1048] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:21:33.890321 26542 raft_consensus.cc:359] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:33.891158 26542 raft_consensus.cc:740] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.890480 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.892794 26687 raft_consensus.cc:2749] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.876820 26607 raft_consensus.cc:2749] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:33.948568 26542 consensus_queue.cc:260] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:33.966958 25898 raft_consensus.cc:1240] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.968201 25900 raft_consensus.cc:1240] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.974406 25977 raft_consensus.cc:1240] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
W20260709 13:21:33.980957 25799 consensus_peers.cc:597] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:33.985637 25796 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:33.989125 25905 raft_consensus.cc:1240] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:33.989374 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98535bc4fa014421a709e3c207ea43f0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:33.990774 26648 consensus_queue.cc:1059] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:33.990924 25824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:33.998925 26709 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:34.001916 26709 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:34.002116 26648 raft_consensus.cc:3055] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:34.002552 26648 raft_consensus.cc:740] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
W20260709 13:21:34.007681 25799 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:34.009552 26542 ts_tablet_manager.cc:1434] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.211s	user 0.007s	sys 0.000s
I20260709 13:21:34.003299 26648 consensus_queue.cc:260] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.026628 26648 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.013242 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
W20260709 13:21:34.029234 25796 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:34.029803 25873 consensus_peers.cc:597] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:34.033885 25796 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:34.034618 26542 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:34.046609 25903 raft_consensus.cc:1240] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
W20260709 13:21:34.059686 25799 consensus_peers.cc:597] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:34.063974 25799 consensus_peers.cc:597] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:34.063990 26537 leader_election.cc:304] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:34.065068 26709 raft_consensus.cc:2804] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.065560 26709 raft_consensus.cc:697] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:34.066375 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:34.068675 26709 consensus_queue.cc:237] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:34.073498 26643 consensus_queue.cc:1048] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:34.080971 25798 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:34.091862 25799 consensus_peers.cc:597] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:34.097425 25947 consensus_peers.cc:597] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:34.105523 25873 consensus_peers.cc:597] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:34.109817 25905 raft_consensus.cc:1240] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
W20260709 13:21:34.112273 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 259204us
I20260709 13:21:34.107766 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:34.052578 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:34.123777 25797 leader_election.cc:304] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:34.127521 25797 leader_election.cc:304] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:34.128659 26740 raft_consensus.cc:2749] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.129966 25903 raft_consensus.cc:1275] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.130463 25797 leader_election.cc:304] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:34.131507 26740 raft_consensus.cc:2749] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.134600 25797 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:34.135581 26740 raft_consensus.cc:2749] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:34.139338 26740 consensus_queue.cc:1059] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:34.140836 26550 raft_consensus.cc:3055] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:34.141372 26550 raft_consensus.cc:740] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:34.142454 26550 consensus_queue.cc:260] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:34.136993 26671 raft_consensus.cc:2749] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.154759 25831 raft_consensus.cc:1275] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.167937 26413 consensus_queue.cc:1059] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:34.186313 25873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 63083.6us
W20260709 13:21:34.188326 25873 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:34.191764 26538 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:34.193938 25946 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:34.194553 26629 raft_consensus.cc:2749] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.195186 26709 consensus_queue.cc:1048] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:34.197562 26641 raft_consensus.cc:2749] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.199945 25828 raft_consensus.cc:1275] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.200148 26664 consensus_queue.cc:1048] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:34.206207 26538 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:34.206840 26550 raft_consensus.cc:3060] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.219205 26709 raft_consensus.cc:2749] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.222699 26538 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:34.225433 26538 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:34.231011 26413 consensus_queue.cc:1059] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:34.236671 26715 consensus_queue.cc:1048] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:21:34.242964 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:34.243177 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf81e1b5def481d86abc1ca4750ff7e" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:34.251577 26413 raft_consensus.cc:3055] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:34.252162 26413 raft_consensus.cc:740] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:34.253216 26413 consensus_queue.cc:260] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.254979 26413 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.258751 25655 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57606 (request call id 97) took 1218 ms. Trace:
I20260709 13:21:34.229837 26709 raft_consensus.cc:2749] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.259714 25655 rpcz_store.cc:276] 0709 13:21:33.040832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:33.048831 (+  7999us) service_pool.cc:224] Handling call
0709 13:21:34.258689 (+1209858us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:33.302175 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:33.310701 (+  8526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:33.314146 (+  3445us) write_op.cc:435] Acquired schema lock
0709 13:21:33.317209 (+  3063us) tablet.cc:662] Decoding operations
0709 13:21:33.317745 (+   536us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:33.317843 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:33.317872 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:21:33.318327 (+   455us) tablet.cc:701] Row locks acquired
0709 13:21:33.318363 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:21:33.318555 (+   192us) write_op.cc:270] Start()
0709 13:21:33.318722 (+   167us) write_op.cc:276] Timestamp: P: 1783603293318484 usec, L: 0
0709 13:21:33.318766 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:21:33.325454 (+  6688us) log.cc:844] Serialized 922 byte log entry
0709 13:21:33.878404 (+552950us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18003ff7c0. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f6109365de1 00007f61093725b1 00007f610049d3f3 00007f610049f7c1 00007f610049f779 00007f610049f709 00007f610049f6d1 00007f610049e9cd 000000000038f354 000000000038f199 00007f610048083a
0709 13:21:33.878745 (+   341us) op_driver.cc:464] REPLICATION: finished
0709 13:21:34.108674 (+229929us) write_op.cc:301] APPLY: starting
0709 13:21:34.108783 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:34.119423 (+ 10640us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:34.126365 (+  6942us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:34.127650 (+  1285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:34.127862 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:21:34.127924 (+    62us) write_op.cc:312] APPLY: finished
0709 13:21:34.128179 (+   255us) log.cc:844] Serialized 28 byte log entry
0709 13:21:34.128381 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:34.128495 (+   114us) write_op.cc:454] Released schema lock
0709 13:21:34.128574 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:34.129031 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:34.129066 (+    35us) write_op.cc:454] Released schema lock
0709 13:21:34.164706 (+ 35640us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:34.165495 (+   789us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62,"reported_tablets":3,"spinlock_wait_cycles":345216,"child_traces":[["op",{"apply.queue_time_us":228753,"apply.run_cpu_time_us":2235,"apply.run_wall_time_us":21190,"mutex_wait_us":9565,"num_ops":2,"prepare.queue_time_us":67519,"prepare.run_cpu_time_us":26959,"prepare.run_wall_time_us":129086,"raft.queue_time_us":574541,"raft.run_cpu_time_us":50359,"raft.run_wall_time_us":285244,"replication_time_us":559796,"spinlock_wait_cycles":5644032,"thread_start_us":465088,"threads_started":4,"wal-append.queue_time_us":95085}]]}
I20260709 13:21:34.266605 26629 raft_consensus.cc:2749] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.298444 25872 leader_election.cc:304] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
W20260709 13:21:34.304457 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 46134.1us
W20260709 13:21:34.288097 26538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 62903us
I20260709 13:21:34.308056 26581 raft_consensus.cc:2749] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:34.328111 26538 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:34.329986 26629 raft_consensus.cc:2749] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.331671 26615 raft_consensus.cc:3055] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:34.332168 26615 raft_consensus.cc:740] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
W20260709 13:21:34.341778 25799 consensus_peers.cc:597] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:34.357272 25653 catalog_manager.cc:5697] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.358554 25826 raft_consensus.cc:1275] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.359575 25653 catalog_manager.cc:5697] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:34.355415 26615 consensus_queue.cc:260] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:34.369468 25653 catalog_manager.cc:5697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:34.376503 25653 catalog_manager.cc:5697] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:34.379743 25653 catalog_manager.cc:5697] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 1 to 2, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 2 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.409301 26542 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.420455 26542 tablet_bootstrap.cc:492] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:34.421253 26542 ts_tablet_manager.cc:1403] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.396s	user 0.019s	sys 0.012s
I20260709 13:21:34.430241 26615 raft_consensus.cc:3060] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.432024 26709 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.432317 26542 raft_consensus.cc:359] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:34.432641 26709 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:34.433106 26542 raft_consensus.cc:740] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.449661 26542 consensus_queue.cc:260] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:34.455654 26772 consensus_queue.cc:1048] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:34.461369 26542 ts_tablet_manager.cc:1434] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.004s
I20260709 13:21:34.470562 26542 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:34.479086 26709 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:34.486994 25981 raft_consensus.cc:1275] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.496608 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:34.516598 25833 raft_consensus.cc:1275] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:34.520224 25799 consensus_peers.cc:597] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:34.524214 25799 consensus_peers.cc:597] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:34.515427 26729 consensus_queue.cc:1048] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:21:34.530879 26739 consensus_queue.cc:1048] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:34.533279 26629 raft_consensus.cc:493] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.533824 26629 raft_consensus.cc:515] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:34.536310 26629 leader_election.cc:290] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:34.538113 25799 consensus_peers.cc:597] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:34.539094 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:34.566172 26538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 112232us
I20260709 13:21:34.600371 25653 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57622 (request call id 104) took 1239 ms. Trace:
I20260709 13:21:34.606768 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:34.599709 25655 catalog_manager.cc:5697] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.609584 25655 catalog_manager.cc:5697] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } }
I20260709 13:21:34.600843 25653 rpcz_store.cc:276] 0709 13:21:33.360587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:33.360851 (+   264us) service_pool.cc:224] Handling call
0709 13:21:33.470269 (+109418us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b5400930654. stack: 00007f610046b343 00007f610046b240 00007f60ffdfa1d4 00007f6109b38304 00007f6109b38299 00007f61034f4090 00007f6103592f3a 00007f61093491cc 00007f610944737e 00007f61079082a4 00007f6107908232 00007f6107908161 00007f61079080dc 00007f6107907392 00007f61018c548c 00007f61018c48c6
0709 13:21:34.600301 (+1130032us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:34.503080 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:34.535203 (+ 32123us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:34.535252 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:21:34.535271 (+    19us) tablet.cc:662] Decoding operations
0709 13:21:34.535982 (+   711us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:34.536045 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:34.536075 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:21:34.536634 (+   559us) tablet.cc:701] Row locks acquired
0709 13:21:34.536660 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:21:34.536799 (+   139us) write_op.cc:270] Start()
0709 13:21:34.536919 (+   120us) write_op.cc:276] Timestamp: P: 1783603294536753 usec, L: 0
0709 13:21:34.536941 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:21:34.537572 (+   631us) log.cc:844] Serialized 2078 byte log entry
0709 13:21:34.540343 (+  2771us) op_driver.cc:464] REPLICATION: finished
0709 13:21:34.540832 (+   489us) write_op.cc:301] APPLY: starting
0709 13:21:34.540926 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:34.541090 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:34.541209 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:34.541870 (+   661us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:34.542048 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:21:34.542090 (+    42us) write_op.cc:312] APPLY: finished
0709 13:21:34.542298 (+   208us) log.cc:844] Serialized 46 byte log entry
0709 13:21:34.542482 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:34.542582 (+   100us) write_op.cc:454] Released schema lock
0709 13:21:34.542621 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:34.542967 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:34.542999 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"spinlock_wait_cycles":157585280,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":2122,"apply.run_wall_time_us":2123,"num_ops":5,"prepare.queue_time_us":100340,"prepare.run_cpu_time_us":3587,"prepare.run_wall_time_us":54519,"replication_time_us":3242,"spinlock_wait_cycles":51584,"thread_start_us":81005,"threads_started":1}]]}
I20260709 13:21:34.613591 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:34.642078 26729 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.642661 26729 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.644135 26542 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.647379 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:34.627969 26538 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:34.652200 26772 raft_consensus.cc:2749] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.653719 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:34.654366 25977 raft_consensus.cc:2468] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:34.656522 26542 tablet_bootstrap.cc:492] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:34.658010 25871 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:34.658775 26538 leader_election.cc:304] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:34.659243 26542 ts_tablet_manager.cc:1403] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.191s	user 0.045s	sys 0.012s
I20260709 13:21:34.661978 26542 raft_consensus.cc:359] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:34.662628 26542 raft_consensus.cc:740] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.663373 26725 raft_consensus.cc:2804] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:34.663854 26725 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:34.664201 26725 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.671682 26772 raft_consensus.cc:2749] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.644778 26729 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:34.680321 25905 raft_consensus.cc:1275] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.683382 26772 consensus_queue.cc:1048] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:34.692440 25826 raft_consensus.cc:1275] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.706321 26774 consensus_queue.cc:1048] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:34.712404 25799 consensus_peers.cc:597] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:34.741003 26542 consensus_queue.cc:260] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:34.744011 26542 ts_tablet_manager.cc:1434] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.084s	user 0.001s	sys 0.003s
I20260709 13:21:34.686079 26725 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.764477 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:34.779556 26725 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:34.801291 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:34.802119 25977 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.858989 26731 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.859571 26731 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.861930 26731 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:34.865254 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:34.866087 25903 raft_consensus.cc:2468] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:34.868566 26542 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:34.870980 25797 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:34.871793 26731 raft_consensus.cc:2804] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:34.872232 26731 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:34.872659 26731 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:34.875025 25652 catalog_manager.cc:5697] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } }
I20260709 13:21:34.869701 25977 raft_consensus.cc:2468] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 3.
I20260709 13:21:34.878379 25871 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:34.879347 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:34.880198 25977 raft_consensus.cc:2468] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:34.889585 26725 raft_consensus.cc:2804] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:34.890515 26607 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:34.908682 26725 raft_consensus.cc:697] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:34.932220 26725 consensus_queue.cc:237] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.908603 26607 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.937155 26607 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:34.946768 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:34.971206 26607 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.971930 26607 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:34.976770 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:34.978847 26607 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:34.992544 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:34.993346 25981 raft_consensus.cc:2368] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c for earlier term 2. Current term is 3.
I20260709 13:21:34.993399 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:34.994130 25978 raft_consensus.cc:2468] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:35.001298 25797 leader_election.cc:400] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321) with higher term. Message: Invalid argument: T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c for earlier term 2. Current term is 3.
I20260709 13:21:35.001726 25797 leader_election.cc:403] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:35.002434 26740 raft_consensus.cc:3060] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:35.003191 25797 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:35.004324 26766 raft_consensus.cc:2804] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:35.004807 26766 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.005359 26766 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:35.010568 26740 raft_consensus.cc:2749] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321) with higher term. Message: Invalid argument: T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c for earlier term 2. Current term is 3.
I20260709 13:21:35.024655 26731 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.035599 26731 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.036558 26796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:43003 every 8 connection(s)
I20260709 13:21:35.037112 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:35.036839 26766 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.052695 25903 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:35.054265 26766 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.037055 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:43003
I20260709 13:21:35.057715 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:35.059243 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:35.060060 25972 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:35.038658 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:35.062021 25977 raft_consensus.cc:3060] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:35.083724 25947 consensus_peers.cc:597] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.055706 25651 catalog_manager.cc:5697] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.088199 25903 raft_consensus.cc:2468] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:35.089720 25797 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:35.090583 26731 raft_consensus.cc:2804] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:35.091054 26731 raft_consensus.cc:697] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:35.083817 26542 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:35.094331 26542 tablet_bootstrap.cc:492] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:35.095021 26542 ts_tablet_manager.cc:1403] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.350s	user 0.011s	sys 0.014s
I20260709 13:21:35.095337 25972 raft_consensus.cc:2468] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:35.100700 25797 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:35.108148 26676 raft_consensus.cc:1240] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:35.108665 25977 raft_consensus.cc:2468] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:35.113703 26766 raft_consensus.cc:2804] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:35.114301 26766 raft_consensus.cc:697] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:35.115278 26766 consensus_queue.cc:237] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.117239 26607 consensus_queue.cc:1059] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.118310 26607 raft_consensus.cc:3055] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:35.118654 26607 raft_consensus.cc:740] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:35.119587 26607 consensus_queue.cc:260] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:35.120678 26542 raft_consensus.cc:359] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:35.121425 26542 raft_consensus.cc:740] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.121089 26607 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.122099 26542 consensus_queue.cc:260] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:35.131898 26542 ts_tablet_manager.cc:1434] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:21:35.132762 26542 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:35.091926 26731 consensus_queue.cc:237] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.160096 26679 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.179102 26691 raft_consensus.cc:3060] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.179776 26676 raft_consensus.cc:1240] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Rejecting Update request from peer 33e3240923e54438a22da49413055ab3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:35.182314 26720 consensus_queue.cc:1059] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.183460 26656 raft_consensus.cc:3055] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:35.183849 26656 raft_consensus.cc:740] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:35.189597 26656 consensus_queue.cc:260] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:35.194301 26542 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:35.191296 26656 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.196658 26542 tablet_bootstrap.cc:492] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:35.198746 26542 ts_tablet_manager.cc:1403] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.005s
I20260709 13:21:35.201959 26542 raft_consensus.cc:359] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:35.202733 26542 raft_consensus.cc:740] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.203677 26542 consensus_queue.cc:260] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:35.195631 26772 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.214160 26772 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:35.231144 26676 raft_consensus.cc:3060] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.232090 26542 ts_tablet_manager.cc:1434] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:21:35.251885 26542 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
W20260709 13:21:35.252255 25947 consensus_peers.cc:597] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:35.247632 26735 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.255483 26735 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.261430 26772 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.261794 26735 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:35.262986 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:35.263600 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:35.265396 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:35.265992 25828 raft_consensus.cc:2468] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:35.267298 25946 leader_election.cc:304] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:35.268906 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:35.270787 26664 raft_consensus.cc:2804] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:35.274204 26664 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.274559 26664 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:35.283329 26664 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.284386 26537 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
W20260709 13:21:35.288071 25947 consensus_peers.cc:597] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.291064 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:35.291854 25828 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:35.292801 25651 catalog_manager.cc:5697] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.331243 26664 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
W20260709 13:21:35.340126 25947 consensus_peers.cc:597] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:35.341070 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:35.391039 25828 raft_consensus.cc:2468] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 3.
I20260709 13:21:35.392475 25946 leader_election.cc:304] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:35.393615 26656 raft_consensus.cc:2804] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:35.394130 26656 raft_consensus.cc:697] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 3 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:35.395074 26656 consensus_queue.cc:237] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.380682 26766 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:35.396770 26766 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.398097 26649 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:35.398613 26649 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.398849 26766 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.401607 25828 raft_consensus.cc:1275] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:35.402945 26649 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.395939 25651 catalog_manager.cc:5697] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.407819 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:35.408617 25977 raft_consensus.cc:2393] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 2: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:35.407935 26798 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35925
I20260709 13:21:35.408998 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:35.409281 26798 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:35.410669 26798 heartbeater.cc:507] Master 127.17.139.62:35925 requested a full tablet report, sending...
I20260709 13:21:35.414853 26629 raft_consensus.cc:2749] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:35.415294 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:35.418481 26772 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.415979 25903 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:35.425702 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:35.432165 25977 raft_consensus.cc:2368] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3.
I20260709 13:21:35.413365 26649 consensus_queue.cc:1048] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:21:35.440035 25871 leader_election.cc:400] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321) with higher term. Message: Invalid argument: T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3.
I20260709 13:21:35.440495 25871 leader_election.cc:403] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:35.434911 26772 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:35.444144 26772 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.456072 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:35.466526 25873 consensus_peers.cc:597] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.468525 25797 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:35.470285 26766 raft_consensus.cc:2804] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:35.470788 26766 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:35.471248 26766 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.478020 26665 raft_consensus.cc:3060] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:35.485411 25871 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 50654.5us
W20260709 13:21:35.503465 26808 log.cc:927] Time spent T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:21:35.499781 26725 raft_consensus.cc:3060] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:35.517185 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:35.518831 25972 raft_consensus.cc:1275] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:35.501259 26766 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.521128 26649 raft_consensus.cc:493] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:35.521658 26649 raft_consensus.cc:515] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.522033 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:35.523814 26649 leader_election.cc:290] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.527338 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:35.531780 25833 raft_consensus.cc:2368] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3.
I20260709 13:21:35.536079 26542 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:35.542512 25872 leader_election.cc:400] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007) with higher term. Message: Invalid argument: T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3.
I20260709 13:21:35.542972 25872 leader_election.cc:403] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:21:35.545212 25871 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 45883.2us
I20260709 13:21:35.547542 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7e69d55ce14023b50cedeb5feae2cf" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:35.531000 26766 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:35.549753 26542 tablet_bootstrap.cc:492] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:35.550796 26542 ts_tablet_manager.cc:1403] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.299s	user 0.024s	sys 0.000s
I20260709 13:21:35.554535 26821 raft_consensus.cc:3060] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:21:35.550122 26538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 141496us
I20260709 13:21:35.553115 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:35.597282 25972 raft_consensus.cc:2393] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c in current term 2: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:35.598097 26658 raft_consensus.cc:3060] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.557283 26537 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:35.611212 26542 raft_consensus.cc:359] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:35.612335 26542 raft_consensus.cc:740] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.584692 26649 consensus_queue.cc:1048] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:21:35.619911 25873 consensus_peers.cc:597] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:35.615413 26537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 63895.4us
I20260709 13:21:35.622411 26542 consensus_queue.cc:260] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:35.636804 26542 ts_tablet_manager.cc:1434] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 13:21:35.637737 26542 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:35.689746 25977 raft_consensus.cc:1275] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:35.652002 25651 catalog_manager.cc:5697] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 1 to 3, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 3 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.719520 25898 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:35.725492 26731 consensus_queue.cc:1048] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:35.766734 25946 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 57947.5us
I20260709 13:21:35.781332 25797 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3
W20260709 13:21:35.783154 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 74927.1us
I20260709 13:21:35.801164 26731 raft_consensus.cc:2804] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:21:35.859066 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 81133us
W20260709 13:21:35.862303 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 79476.9us
I20260709 13:21:35.911506 26731 raft_consensus.cc:697] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:35.912801 26731 consensus_queue.cc:237] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:35.929529 26819 raft_consensus.cc:2749] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:35.970510 25873 consensus_peers.cc:597] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:35.971342 25873 consensus_peers.cc:597] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:35.856504 26725 raft_consensus.cc:2749] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321) with higher term. Message: Invalid argument: T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3.
I20260709 13:21:35.984651 26821 raft_consensus.cc:2749] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007) with higher term. Message: Invalid argument: T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3.
I20260709 13:21:35.995548 25906 raft_consensus.cc:1275] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:21:36.007086 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 142968us
I20260709 13:21:36.016076 25978 raft_consensus.cc:1275] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.021004 26827 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.021539 26827 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:36.023617 26827 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:36.028254 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:36.028903 25905 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 2.
I20260709 13:21:36.032748 25945 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:36.019721 26629 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:36.040640 25947 consensus_peers.cc:597] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.038300 26644 raft_consensus.cc:2804] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:36.047819 26644 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.043313 26629 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.048190 26644 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:36.060122 25947 consensus_peers.cc:597] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.064625 26774 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.065161 26774 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.065661 25900 raft_consensus.cc:1275] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.067263 26774 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:36.067760 26629 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:36.069334 26837 consensus_queue.cc:1048] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:36.071625 25873 consensus_peers.cc:597] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:36.075867 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:36.086163 25799 consensus_peers.cc:597] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:36.086830 25799 consensus_peers.cc:597] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.091957 26615 consensus_queue.cc:1048] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.095700 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:36.096903 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:36.097564 25827 raft_consensus.cc:2468] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
W20260709 13:21:36.101131 25947 consensus_peers.cc:597] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.103130 25906 raft_consensus.cc:1275] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.103946 26766 consensus_queue.cc:1048] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.104526 26644 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:36.119434 26644 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:36.125037 26538 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:36.126497 26629 raft_consensus.cc:2804] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:36.126893 26629 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.127267 26629 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.130263 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:36.130877 25904 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.134406 26835 consensus_queue.cc:1048] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:36.137540 25947 consensus_peers.cc:597] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.138324 26816 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:36.138939 26816 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.140033 25904 raft_consensus.cc:2468] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 3.
I20260709 13:21:36.143000 26816 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:36.143817 25945 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:36.144707 26735 raft_consensus.cc:2804] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:36.145220 26735 raft_consensus.cc:697] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 3 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:36.146103 26735 consensus_queue.cc:237] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:36.150462 26629 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.181051 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:36.208329 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:36.208963 25978 raft_consensus.cc:2468] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:36.212193 25831 raft_consensus.cc:1275] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.218336 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:36.221231 25799 consensus_peers.cc:597] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:36.223959 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:36.229775 25651 catalog_manager.cc:5697] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 2, leader changed from e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 2 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:36.229769 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:36.235598 26542 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.236639 26542 tablet_bootstrap.cc:492] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:36.237597 26542 ts_tablet_manager.cc:1403] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.600s	user 0.024s	sys 0.000s
I20260709 13:21:36.249037 26542 raft_consensus.cc:359] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:36.249724 26542 raft_consensus.cc:740] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.250285 26629 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:36.254916 25799 consensus_peers.cc:597] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:36.255441 25873 consensus_peers.cc:597] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:36.256440 26542 consensus_queue.cc:260] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:36.258919 25873 consensus_peers.cc:597] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.251152 25652 ts_manager.cc:194] Re-registered known tserver with Master: ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:36.260254 26842 consensus_queue.cc:1048] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:36.268761 25873 consensus_peers.cc:597] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.277514 26537 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:36.278857 26537 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:36.279651 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:36.279676 26816 raft_consensus.cc:2804] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:36.280289 25826 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.280369 26816 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.281008 26816 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.284447 26629 raft_consensus.cc:2749] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:36.291500 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:36.316126 25981 raft_consensus.cc:1240] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 3 LEADER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:36.317826 26766 consensus_queue.cc:1059] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.318603 26766 consensus_queue.cc:1243] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer 33e3240923e54438a22da49413055ab3 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:21:36.318986 26731 raft_consensus.cc:3055] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:36.319340 26731 raft_consensus.cc:740] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:36.320115 26731 consensus_queue.cc:260] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:36.321245 26731 raft_consensus.cc:3060] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.328800 25826 raft_consensus.cc:2468] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:36.332033 26538 leader_election.cc:304] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:36.333026 26629 raft_consensus.cc:2804] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:36.334059 26629 raft_consensus.cc:697] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:36.334985 26629 consensus_queue.cc:237] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.333510 26542 ts_tablet_manager.cc:1434] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 13:21:36.341073 26542 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:36.365995 26816 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.372753 26542 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.374148 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:36.382822 25981 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.374979 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:36.390643 25981 raft_consensus.cc:2468] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:36.390872 26542 tablet_bootstrap.cc:492] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:36.375479 26816 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:36.393602 25947 consensus_peers.cc:597] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:36.394174 26537 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:36.395418 26816 raft_consensus.cc:2804] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:36.395924 26816 raft_consensus.cc:697] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:36.391690 26542 ts_tablet_manager.cc:1403] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.004s
I20260709 13:21:36.399636 26542 raft_consensus.cc:359] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:36.400337 26542 raft_consensus.cc:740] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.400941 26816 consensus_queue.cc:237] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.402240 26542 consensus_queue.cc:260] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:36.411648 26542 ts_tablet_manager.cc:1434] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:21:36.413019 26542 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:36.422061 25654 catalog_manager.cc:5697] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 2 to 3, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 3 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:36.432560 26840 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:36.433125 26840 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.437565 25981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:36.438305 25981 raft_consensus.cc:2368] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c for earlier term 2. Current term is 3.
I20260709 13:21:36.446915 25797 leader_election.cc:400] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321) with higher term. Message: Invalid argument: T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c for earlier term 2. Current term is 3.
I20260709 13:21:36.447214 25797 leader_election.cc:403] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:36.448822 26731 raft_consensus.cc:3060] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.457926 26840 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:36.458951 26691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f919e905134e49be8c590c4ee5e3b2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:36.478114 26731 raft_consensus.cc:2749] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321) with higher term. Message: Invalid argument: T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07f41f48d6b44bbb8d23868f1366476c for earlier term 2. Current term is 3.
W20260709 13:21:36.490248 25799 consensus_peers.cc:597] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.498749 26735 raft_consensus.cc:493] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:36.499353 26735 raft_consensus.cc:515] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.504824 26735 leader_election.cc:290] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:36.505823 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:36.506271 26691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8364a08fda04ddca37f7a62c780bf6b" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:36.506618 25831 raft_consensus.cc:2368] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 for earlier term 2. Current term is 3.
I20260709 13:21:36.508275 25946 leader_election.cc:400] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007) with higher term. Message: Invalid argument: T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 for earlier term 2. Current term is 3.
I20260709 13:21:36.508579 25946 leader_election.cc:403] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:36.509317 26735 raft_consensus.cc:3060] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.512836 26542 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.513823 26542 tablet_bootstrap.cc:492] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:36.514462 26542 ts_tablet_manager.cc:1403] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.102s	user 0.037s	sys 0.038s
I20260709 13:21:36.517148 26542 raft_consensus.cc:359] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:36.517748 26542 raft_consensus.cc:740] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
W20260709 13:21:36.548398 25873 consensus_peers.cc:597] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.595360 25900 raft_consensus.cc:1275] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.600975 26644 consensus_queue.cc:1048] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:36.614354 25831 raft_consensus.cc:1275] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:21:36.614802 25831 pending_rounds.cc:85] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: Aborting all ops after (but not including) 1
I20260709 13:21:36.615078 25831 pending_rounds.cc:107] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:21:36.615419 25831 raft_consensus.cc:2889] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:36.617424 26849 consensus_queue.cc:1048] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:36.661351 25652 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58072
I20260709 13:21:36.610292 26691 raft_consensus.cc:3060] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.662480 26542 consensus_queue.cc:260] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:36.696262 26798 heartbeater.cc:499] Master 127.17.139.62:35925 was elected leader, sending a full tablet report...
I20260709 13:21:36.698110 26542 ts_tablet_manager.cc:1434] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.183s	user 0.012s	sys 0.009s
I20260709 13:21:36.699084 26542 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:36.708525 26735 raft_consensus.cc:2749] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007) with higher term. Message: Invalid argument: T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 for earlier term 2. Current term is 3.
I20260709 13:21:36.801863 25833 raft_consensus.cc:1275] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.803193 26816 consensus_queue.cc:1048] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.821554 25652 catalog_manager.cc:5697] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 3, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } }
I20260709 13:21:36.829568 25973 raft_consensus.cc:1275] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.831815 26774 consensus_queue.cc:1048] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:36.872391 26542 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.873564 26542 tablet_bootstrap.cc:492] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
W20260709 13:21:36.874963 25799 consensus_peers.cc:597] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:36.876317 25799 consensus_peers.cc:597] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.879927 26542 ts_tablet_manager.cc:1403] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.181s	user 0.035s	sys 0.007s
I20260709 13:21:36.892405 26542 raft_consensus.cc:359] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.896202 26542 raft_consensus.cc:740] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.896981 26542 consensus_queue.cc:260] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:36.903362 26542 ts_tablet_manager.cc:1434] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:21:36.904279 26542 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
W20260709 13:21:36.919548 25799 consensus_peers.cc:597] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:36.933527 25981 raft_consensus.cc:1275] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.936342 26774 consensus_queue.cc:1048] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.940603 26542 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.941519 26542 tablet_bootstrap.cc:492] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:36.942135 26542 ts_tablet_manager.cc:1403] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 13:21:36.950471 26542 raft_consensus.cc:359] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:36.948024 25654 catalog_manager.cc:5697] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 3, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:36.955457 26542 raft_consensus.cc:740] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.956321 26542 consensus_queue.cc:260] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:36.958724 26542 ts_tablet_manager.cc:1434] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:21:36.959522 26542 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:36.962944 25831 raft_consensus.cc:1275] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.969111 26629 consensus_queue.cc:1048] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.991178 26630 raft_consensus.cc:3060] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.005544 26542 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.006543 26542 tablet_bootstrap.cc:492] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.008862 26542 ts_tablet_manager.cc:1403] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.011s
I20260709 13:21:37.014585 26542 raft_consensus.cc:359] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.015358 26542 raft_consensus.cc:740] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.018095 26542 consensus_queue.cc:260] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.020282 26542 ts_tablet_manager.cc:1434] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:21:37.021116 26542 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.054380 26542 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.055440 26542 tablet_bootstrap.cc:492] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.056133 26542 ts_tablet_manager.cc:1403] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.008s
I20260709 13:21:37.079118 26542 raft_consensus.cc:359] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.080010 26542 raft_consensus.cc:740] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.080713 26542 consensus_queue.cc:260] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.083304 26542 ts_tablet_manager.cc:1434] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:21:37.102403 26542 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.156735 26542 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.157719 26542 tablet_bootstrap.cc:492] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.158411 26542 ts_tablet_manager.cc:1403] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.004s
I20260709 13:21:37.161049 26542 raft_consensus.cc:359] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.161702 26542 raft_consensus.cc:740] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.162345 26542 consensus_queue.cc:260] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.168521 26542 ts_tablet_manager.cc:1434] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:37.169330 26542 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.214998 26542 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.215986 26542 tablet_bootstrap.cc:492] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.216619 26542 ts_tablet_manager.cc:1403] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.007s
I20260709 13:21:37.219319 26542 raft_consensus.cc:359] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.220013 26542 raft_consensus.cc:740] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.233179 26542 consensus_queue.cc:260] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.238019 26542 ts_tablet_manager.cc:1434] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:21:37.238925 26542 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.263300 26542 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.264652 26542 tablet_bootstrap.cc:492] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.265405 26542 ts_tablet_manager.cc:1403] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.004s
I20260709 13:21:37.269446 26542 raft_consensus.cc:359] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.270215 26542 raft_consensus.cc:740] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.272061 26542 consensus_queue.cc:260] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:37.274451 26542 ts_tablet_manager.cc:1434] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:37.285454 26542 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.316694 26542 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.317751 26542 tablet_bootstrap.cc:492] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.318502 26542 ts_tablet_manager.cc:1403] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.013s
I20260709 13:21:37.321174 26542 raft_consensus.cc:359] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:37.322254 26542 raft_consensus.cc:740] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.323416 26542 consensus_queue.cc:260] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:37.325870 26542 ts_tablet_manager.cc:1434] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:37.331447 26542 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.366070 26691 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.380018 26542 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.381023 26542 tablet_bootstrap.cc:492] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.381632 26542 ts_tablet_manager.cc:1403] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.026s
I20260709 13:21:37.384187 26542 raft_consensus.cc:359] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.384835 26542 raft_consensus.cc:740] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.385499 26542 consensus_queue.cc:260] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.387027 26542 ts_tablet_manager.cc:1434] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:37.387773 26542 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.406599 26640 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:37.541006 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 57169.9us
I20260709 13:21:37.698655 26542 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.699563 26542 tablet_bootstrap.cc:492] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.700138 26542 ts_tablet_manager.cc:1403] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.313s	user 0.069s	sys 0.152s
I20260709 13:21:37.706073 26542 raft_consensus.cc:359] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.706699 26542 raft_consensus.cc:740] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.707358 26542 consensus_queue.cc:260] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.709300 26542 ts_tablet_manager.cc:1434] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:37.710047 26542 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.747022 26542 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.747920 26542 tablet_bootstrap.cc:492] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.748687 26542 ts_tablet_manager.cc:1403] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.016s
I20260709 13:21:37.759519 26542 raft_consensus.cc:359] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.760210 26542 raft_consensus.cc:740] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.760901 26542 consensus_queue.cc:260] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.762887 26542 ts_tablet_manager.cc:1434] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:37.763712 26542 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.816911 26542 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.817879 26542 tablet_bootstrap.cc:492] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.818745 26542 ts_tablet_manager.cc:1403] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.032s
I20260709 13:21:37.821108 26542 raft_consensus.cc:359] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:37.821729 26542 raft_consensus.cc:740] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.822440 26542 consensus_queue.cc:260] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:37.830885 26542 ts_tablet_manager.cc:1434] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:21:37.831708 26542 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:37.869766 26542 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:37.870711 26542 tablet_bootstrap.cc:492] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:37.871364 26542 ts_tablet_manager.cc:1403] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.011s
I20260709 13:21:37.873705 26542 raft_consensus.cc:359] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.874316 26542 raft_consensus.cc:740] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.875013 26542 consensus_queue.cc:260] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:37.877084 26542 ts_tablet_manager.cc:1434] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:21:37.880553 26542 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.054144 26542 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.055174 26542 tablet_bootstrap.cc:492] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.055837 26542 ts_tablet_manager.cc:1403] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.175s	user 0.044s	sys 0.099s
I20260709 13:21:38.058429 26542 raft_consensus.cc:359] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.059079 26542 raft_consensus.cc:740] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.059716 26542 consensus_queue.cc:260] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.061753 26542 ts_tablet_manager.cc:1434] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:21:38.062463 26542 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.086234 26542 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.087175 26542 tablet_bootstrap.cc:492] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.087785 26542 ts_tablet_manager.cc:1403] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:21:38.090369 26542 raft_consensus.cc:359] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:38.091009 26542 raft_consensus.cc:740] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.091611 26542 consensus_queue.cc:260] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:38.093638 26542 ts_tablet_manager.cc:1434] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:38.094426 26542 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
W20260709 13:21:38.108361 25947 consensus_peers.cc:597] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:38.119248 26542 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.120262 26542 tablet_bootstrap.cc:492] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.120862 26542 ts_tablet_manager.cc:1403] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.003s
I20260709 13:21:38.123389 26542 raft_consensus.cc:359] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:38.124027 26542 raft_consensus.cc:740] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.124624 26542 consensus_queue.cc:260] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:38.128516 26542 ts_tablet_manager.cc:1434] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:21:38.129259 26542 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.205222 26542 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.206175 26542 tablet_bootstrap.cc:492] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.206775 26542 ts_tablet_manager.cc:1403] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.024s
I20260709 13:21:38.209303 26542 raft_consensus.cc:359] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.209970 26542 raft_consensus.cc:740] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.210608 26542 consensus_queue.cc:260] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.212065 26542 ts_tablet_manager.cc:1434] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:21:38.213223 26542 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.250046 26542 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.250958 26542 tablet_bootstrap.cc:492] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.251586 26542 ts_tablet_manager.cc:1403] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.010s
I20260709 13:21:38.254119 26542 raft_consensus.cc:359] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.254761 26542 raft_consensus.cc:740] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.255697 26542 consensus_queue.cc:260] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.257694 26542 ts_tablet_manager.cc:1434] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:38.265925 26542 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.293699 26691 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.309170 26658 raft_consensus.cc:3060] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.311766 26542 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.312716 26542 tablet_bootstrap.cc:492] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.313333 26542 ts_tablet_manager.cc:1403] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.003s
I20260709 13:21:38.315977 26542 raft_consensus.cc:359] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:38.316607 26542 raft_consensus.cc:740] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.317296 26542 consensus_queue.cc:260] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:38.319205 26542 ts_tablet_manager.cc:1434] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:38.319952 26542 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.418130 26542 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.419087 26542 tablet_bootstrap.cc:492] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.421501 26542 ts_tablet_manager.cc:1403] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.041s
I20260709 13:21:38.425189 26542 raft_consensus.cc:359] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:38.425957 26542 raft_consensus.cc:740] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.433557 26542 consensus_queue.cc:260] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:38.435951 26542 ts_tablet_manager.cc:1434] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:21:38.440750 26542 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.494553 26542 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.495570 26542 tablet_bootstrap.cc:492] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.496464 26542 ts_tablet_manager.cc:1403] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.056s	user 0.030s	sys 0.005s
I20260709 13:21:38.501551 26542 raft_consensus.cc:359] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.502238 26542 raft_consensus.cc:740] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.502942 26542 consensus_queue.cc:260] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.505774 26542 ts_tablet_manager.cc:1434] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:38.507551 26542 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.538625 26542 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.539906 26542 tablet_bootstrap.cc:492] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.540611 26542 ts_tablet_manager.cc:1403] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.003s
I20260709 13:21:38.541211 26691 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.543054 26542 raft_consensus.cc:359] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:38.543761 26542 raft_consensus.cc:740] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.544413 26542 consensus_queue.cc:260] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:38.546212 26542 ts_tablet_manager.cc:1434] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:38.551880 26542 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap starting.
I20260709 13:21:38.579710 26542 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:38.580704 26542 tablet_bootstrap.cc:492] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Bootstrap complete.
I20260709 13:21:38.581445 26542 ts_tablet_manager.cc:1403] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 13:21:38.585150 26542 raft_consensus.cc:359] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.585887 26542 raft_consensus.cc:740] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Initialized, Role: FOLLOWER
I20260709 13:21:38.586604 26542 consensus_queue.cc:260] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:38.588641 26542 ts_tablet_manager.cc:1434] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:38.654400 26691 raft_consensus.cc:3060] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.760773 26691 raft_consensus.cc:3060] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:38.875226 26538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 48599.5us
I20260709 13:21:45.114506 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:45.186082 25825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:53628
I20260709 13:21:45.187121 25825 raft_consensus.cc:606] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:45.221455 25972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e4fed752c59430787a6456b056a9791"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:45.231635 25972 raft_consensus.cc:606] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:45.235183 25972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:45.238802 25972 raft_consensus.cc:606] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Received request to transfer leadership to TS 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:45.244074 25825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:53628
I20260709 13:21:45.244629 25825 raft_consensus.cc:606] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:45.247093 25825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:53628
I20260709 13:21:45.247539 25825 raft_consensus.cc:606] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:45.248514 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:45.249709 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:45.328850 26938 raft_consensus.cc:993] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3: : Instructing follower 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:45.329573 26849 raft_consensus.cc:1081] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Signalling peer 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:45.331157 25825 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:41746
I20260709 13:21:45.331647 25825 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.331982 25825 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.341724 25825 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:45.343743 25825 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:45.345832 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:45.346549 25905 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.350724 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:45.351550 25972 raft_consensus.cc:3055] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:45.351927 25972 raft_consensus.cc:740] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:45.353008 25972 consensus_queue.cc:260] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:45.353660 25905 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:45.354676 25972 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.354938 25797 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:45.355908 26932 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:45.356534 26932 raft_consensus.cc:697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:45.357450 26932 consensus_queue.cc:237] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:45.373572 25651 catalog_manager.cc:5697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 2 to 3, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 3 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.373359 25972 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:45.608717 26912 raft_consensus.cc:993] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.609372 26934 raft_consensus.cc:1081] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.611130 26640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44604
I20260709 13:21:45.611740 26640 raft_consensus.cc:493] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.612097 26640 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.636013 26640 raft_consensus.cc:515] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:45.646149 26930 raft_consensus.cc:993] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.649972 26849 raft_consensus.cc:1081] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.651531 26691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e4fed752c59430787a6456b056a9791"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44590
I20260709 13:21:45.652066 26691 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.652383 26691 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.663131 26691 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.668407 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:45.669009 25972 raft_consensus.cc:3055] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:45.669356 25972 raft_consensus.cc:740] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:45.671412 26932 raft_consensus.cc:993] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.671973 26912 raft_consensus.cc:1081] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.671183 25972 consensus_queue.cc:260] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.672962 25972 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.674553 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:45.675180 25825 raft_consensus.cc:3060] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.675542 26662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44604
I20260709 13:21:45.676151 26662 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.676467 26662 raft_consensus.cc:3060] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.669580 26691 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:45.684410 25825 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:45.686609 25972 raft_consensus.cc:2468] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:45.686982 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:45.687541 25905 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.689435 26640 leader_election.cc:290] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:45.686517 26538 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:45.690135 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:45.691713 25826 raft_consensus.cc:3055] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.692034 25826 raft_consensus.cc:740] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:45.694324 26931 raft_consensus.cc:2804] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:45.695581 25826 consensus_queue.cc:260] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:45.690119 26662 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.698830 25905 raft_consensus.cc:2468] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:45.699198 25826 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.700084 26931 raft_consensus.cc:697] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:45.701939 26662 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:45.702309 26537 leader_election.cc:304] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:45.703974 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:45.704977 26931 consensus_queue.cc:237] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.707116 25972 raft_consensus.cc:3060] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.707540 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:45.709581 25826 raft_consensus.cc:2468] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:45.710512 25825 raft_consensus.cc:3055] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.710876 25825 raft_consensus.cc:740] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:45.714238 25825 consensus_queue.cc:260] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.717314 25825 raft_consensus.cc:3060] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.718969 26950 raft_consensus.cc:2804] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.719558 26950 raft_consensus.cc:697] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:45.720665 26950 consensus_queue.cc:237] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:45.735540 25972 raft_consensus.cc:2468] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:45.736809 26537 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:45.737782 25651 catalog_manager.cc:5697] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 2 to 3, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.746569 26949 raft_consensus.cc:993] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.758356 26949 raft_consensus.cc:1081] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:45.737828 26931 raft_consensus.cc:2804] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.769989 25972 raft_consensus.cc:1275] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:45.800016 26662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44604
I20260709 13:21:45.801671 26662 raft_consensus.cc:493] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.802095 26662 raft_consensus.cc:3060] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.802014 26934 consensus_queue.cc:1048] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:45.801697 26931 raft_consensus.cc:697] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:45.844849 25825 raft_consensus.cc:2468] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:45.807312 26931 consensus_queue.cc:237] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.863238 25898 raft_consensus.cc:1275] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:45.867798 26946 consensus_queue.cc:1048] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:45.886914 26662 raft_consensus.cc:515] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.907075 26662 leader_election.cc:290] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:45.908794 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:45.909561 25826 raft_consensus.cc:3055] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.909849 25826 raft_consensus.cc:740] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:45.910900 25826 consensus_queue.cc:260] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.918478 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816921c4c524ae7a5976325662d4c03" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:45.919176 25978 raft_consensus.cc:3060] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.912428 25826 raft_consensus.cc:3060] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.926829 25978 raft_consensus.cc:2468] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:45.928459 26537 leader_election.cc:304] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:45.929280 26931 raft_consensus.cc:2804] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.930176 26931 raft_consensus.cc:697] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:45.931182 26931 consensus_queue.cc:237] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:45.934909 25826 raft_consensus.cc:2468] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:45.945643 25656 catalog_manager.cc:5697] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.948448 25656 catalog_manager.cc:5697] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.968708 25656 catalog_manager.cc:5697] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.205812 25972 raft_consensus.cc:1275] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.207335 26931 consensus_queue.cc:1048] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:46.211550 25898 raft_consensus.cc:1275] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.213014 26931 consensus_queue.cc:1048] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.250715 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:46.252712 25826 raft_consensus.cc:1275] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.254487 26931 consensus_queue.cc:1048] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:46.261792 25825 raft_consensus.cc:1275] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.263412 26950 consensus_queue.cc:1048] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:46.280618 25833 raft_consensus.cc:1275] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.281972 26931 consensus_queue.cc:1048] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.305581 25978 raft_consensus.cc:1275] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.307065 26966 consensus_queue.cc:1048] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.375052 25825 raft_consensus.cc:1275] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.376250 26954 consensus_queue.cc:1048] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.379137 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:46.410131 25978 raft_consensus.cc:1275] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.411549 26954 consensus_queue.cc:1048] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.462553 25981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:46.463125 25981 raft_consensus.cc:606] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:46.468600 25981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:46.469127 25981 raft_consensus.cc:606] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:46.481150 25978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:46.481750 25978 raft_consensus.cc:606] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:46.486610 25978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:46.487176 25978 raft_consensus.cc:606] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:46.489423 25826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:53628
I20260709 13:21:46.489939 25826 raft_consensus.cc:606] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:46.491034 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:46.492260 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:46.494666 26947 raft_consensus.cc:993] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.495258 26948 raft_consensus.cc:1081] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.496752 26662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44590
I20260709 13:21:46.497290 26662 raft_consensus.cc:493] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.497625 26662 raft_consensus.cc:3060] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.505425 26662 raft_consensus.cc:515] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:46.507879 26662 leader_election.cc:290] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:46.507985 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:46.509014 25978 raft_consensus.cc:3055] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.509122 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:46.509374 25978 raft_consensus.cc:740] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:46.509768 25826 raft_consensus.cc:3060] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.510221 25978 consensus_queue.cc:260] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:46.511641 25978 raft_consensus.cc:3060] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.514420 25826 raft_consensus.cc:2468] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:46.515666 26538 leader_election.cc:304] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:46.516527 26954 raft_consensus.cc:2804] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.516994 26954 raft_consensus.cc:697] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:46.517841 26954 consensus_queue.cc:237] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:46.519359 25978 raft_consensus.cc:2468] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:46.525884 26948 raft_consensus.cc:993] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.527887 26849 raft_consensus.cc:1081] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.529572 26640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44590
I20260709 13:21:46.530098 26640 raft_consensus.cc:493] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.530431 26640 raft_consensus.cc:3060] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.548216 26640 raft_consensus.cc:515] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:46.551699 26640 leader_election.cc:290] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:46.552847 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:46.553146 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:46.553503 25905 raft_consensus.cc:3060] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.553664 25972 raft_consensus.cc:3055] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.554019 25972 raft_consensus.cc:740] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:46.555644 25972 consensus_queue.cc:260] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:46.556834 25972 raft_consensus.cc:3060] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.561560 25905 raft_consensus.cc:2468] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:46.562618 26537 leader_election.cc:304] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:46.564955 25654 catalog_manager.cc:5697] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.567224 26954 raft_consensus.cc:2804] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.567951 26954 raft_consensus.cc:697] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:46.568837 26954 consensus_queue.cc:237] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:46.572531 26946 raft_consensus.cc:993] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.573127 26934 raft_consensus.cc:1081] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.575661 26662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44604
I20260709 13:21:46.576218 26662 raft_consensus.cc:493] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.576601 26662 raft_consensus.cc:3060] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.576730 25972 raft_consensus.cc:2468] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:46.594847 26662 raft_consensus.cc:515] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:46.598448 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:46.599119 25972 raft_consensus.cc:3060] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.609664 26662 leader_election.cc:290] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:46.611898 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:46.612695 25826 raft_consensus.cc:3055] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.613009 25826 raft_consensus.cc:740] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:46.613772 25826 consensus_queue.cc:260] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:46.614863 25826 raft_consensus.cc:3060] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.626524 25826 raft_consensus.cc:2468] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:46.611987 25972 raft_consensus.cc:2468] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:46.627892 26538 leader_election.cc:304] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:46.628979 26950 raft_consensus.cc:2804] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.629477 26950 raft_consensus.cc:697] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:46.630401 26950 consensus_queue.cc:237] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:46.638271 25654 catalog_manager.cc:5697] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.659004 25654 catalog_manager.cc:5697] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.803649 26947 raft_consensus.cc:993] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.804289 26947 raft_consensus.cc:1081] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:46.806886 26640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44590
I20260709 13:21:46.807600 26640 raft_consensus.cc:493] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.808023 26640 raft_consensus.cc:3060] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.021164 25981 raft_consensus.cc:1275] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.035373 26954 consensus_queue.cc:1048] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:47.073426 25978 raft_consensus.cc:1275] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.110488 26931 consensus_queue.cc:1048] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:47.114735 26640 raft_consensus.cc:515] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:47.117406 26640 leader_election.cc:290] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:47.517098 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:47.708544 26640 raft_consensus.cc:1240] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Rejecting Update request from peer 33e3240923e54438a22da49413055ab3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:47.664202 26951 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
W20260709 13:21:47.667409 25981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.003s	sys 0.007s
W20260709 13:21:47.714092 25981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.004s	sys 0.007s
I20260709 13:21:47.680089 26985 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.720561 26951 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:47.722836 26985 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:47.725180 26985 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:47.726356 26951 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:47.767794 26951 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.768325 26951 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:47.770359 26951 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:47.778861 26948 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.779470 26948 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:47.785751 26849 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.786540 26849 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:47.786830 26986 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:47.805779 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:47.806617 25978 raft_consensus.cc:3055] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:47.807015 25978 raft_consensus.cc:740] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:47.812074 25978 consensus_queue.cc:260] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:47.803686 25654 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58072 (request call id 62) took 1075 ms. Trace:
I20260709 13:21:47.818846 25654 rpcz_store.cc:276] 0709 13:21:46.718956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:46.723210 (+  4254us) service_pool.cc:224] Handling call
0709 13:21:47.794482 (+1071272us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:21:47.823107 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:47.823689 25977 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:47.828469 26994 raft_consensus.cc:493] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:47.829296 26994 raft_consensus.cc:515] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:47.830978 26982 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:47.831447 26984 raft_consensus.cc:493] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:47.831569 26982 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:47.832056 26984 raft_consensus.cc:515] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:47.833811 26982 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:47.834170 26984 leader_election.cc:290] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:47.834981 26994 leader_election.cc:290] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:47.841322 26537 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:47.842595 25828 raft_consensus.cc:1275] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.842758 26931 raft_consensus.cc:2804] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:47.843281 26931 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.843683 26931 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:47.843997 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:47.845113 25973 raft_consensus.cc:1275] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.841341 25826 raft_consensus.cc:1275] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.846939 26992 raft_consensus.cc:493] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:47.847445 26992 raft_consensus.cc:515] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:47.804327 26986 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:47.850466 25972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49944 (request call id 75) took 1090 ms. Trace:
I20260709 13:21:47.850983 26986 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:47.810869 26983 raft_consensus.cc:493] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:47.850808 25972 rpcz_store.cc:276] 0709 13:21:46.759652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:47.849754 (+1090102us) service_pool.cc:224] Handling call
0709 13:21:47.850012 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:47.850175 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:47.850202 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:47.850239 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:21:47.850267 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:47.850323 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:47.850414 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:47.926622 26849 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:47.934688 26975 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.935554 26992 leader_election.cc:290] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:47.942616 27001 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:47.943570 26849 raft_consensus.cc:993] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:47.944028 26849 raft_consensus.cc:1081] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:47.943207 27001 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:47.950656 27001 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:47.955013 27008 raft_consensus.cc:493] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:47.956627 26630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:47.956048 27008 raft_consensus.cc:515] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:47.959077 26640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:47.959996 27008 leader_election.cc:290] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:47.961913 26691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:47.963766 26691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44590
I20260709 13:21:47.964236 26691 raft_consensus.cc:493] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:47.964529 26691 raft_consensus.cc:3060] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.965716 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:47.969318 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:47.970650 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:47.935497 26975 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:47.974321 26994 raft_consensus.cc:493] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.974821 26994 raft_consensus.cc:515] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:47.975346 26975 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:47.939443 26948 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:47.978240 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:47.921926 26950 consensus_queue.cc:1048] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:21:47.979106 26987 raft_consensus.cc:493] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:47.979676 26987 raft_consensus.cc:515] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:47.981966 26987 leader_election.cc:290] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:47.984386 26691 raft_consensus.cc:515] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:47.921159 26983 raft_consensus.cc:515] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:47.986264 26691 leader_election.cc:290] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:47.987811 26983 leader_election.cc:290] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:47.989050 26999 raft_consensus.cc:493] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:47.989566 26999 raft_consensus.cc:515] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:47.979107 26991 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:47.991192 26991 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:47.991602 26999 leader_election.cc:290] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:47.980579 26950 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.006727 26991 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.006937 26999 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.007300 26950 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.007691 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771eedb34a9845bb876bb0217d55cb4f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.007555 26999 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.008940 26640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.009356 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.009486 26950 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.009531 26640 raft_consensus.cc:2468] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:48.009652 26999 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.020524 26691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.024405 26999 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.026845 26999 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.030225 26975 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.030821 27005 raft_consensus.cc:493] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.022241 26983 raft_consensus.cc:493] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.031679 26983 raft_consensus.cc:515] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.031038 26975 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.036455 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.041203 26987 raft_consensus.cc:493] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.042923 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.028728 26999 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.054147 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:48.030162 26931 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.041822 26987 raft_consensus.cc:515] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.085466 27012 raft_consensus.cc:493] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.033517 26983 leader_election.cc:290] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.038491 26982 raft_consensus.cc:493] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.098400 26982 raft_consensus.cc:515] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.098870 26985 raft_consensus.cc:493] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.099002 26987 leader_election.cc:290] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.099195 26989 raft_consensus.cc:493] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.099649 26987 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.099762 26989 raft_consensus.cc:515] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.100463 26982 leader_election.cc:290] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.096478 26931 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.101624 27004 raft_consensus.cc:493] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.101961 26989 leader_election.cc:290] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.102474 26989 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.074172 26986 raft_consensus.cc:493] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.102586 26931 raft_consensus.cc:493] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.035390 27005 raft_consensus.cc:515] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.097302 26630 raft_consensus.cc:2393] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 33e3240923e54438a22da49413055ab3 in current term 3: Already voted for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in this term.
I20260709 13:21:48.097223 27003 raft_consensus.cc:493] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.099452 26985 raft_consensus.cc:515] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:48.100255 26987 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.102164 27004 raft_consensus.cc:515] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.095367 27007 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.094604 26983 raft_consensus.cc:493] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.094914 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.052567 26954 raft_consensus.cc:493] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.050668 26994 leader_election.cc:290] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.086287 26996 raft_consensus.cc:493] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.111750 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.122678 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113a9ca6eaed4ac3881ea23e2261267b" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.116735 25825 raft_consensus.cc:2468] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:48.103040 26986 raft_consensus.cc:515] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
W20260709 13:21:48.127102 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 91298.3us
W20260709 13:21:48.107096 26537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 180467us
I20260709 13:21:48.132719 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.107506 26989 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.105412 27012 raft_consensus.cc:515] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.147564 27013 raft_consensus.cc:493] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.136734 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4fed752c59430787a6456b056a9791" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.137099 26985 leader_election.cc:290] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:48.127718 27018 raft_consensus.cc:493] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.151780 27013 raft_consensus.cc:515] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.131922 27007 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.152535 27018 raft_consensus.cc:515] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.153066 26989 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:48.130509 26983 raft_consensus.cc:515] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:48.136951 25944 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:48.103173 26931 raft_consensus.cc:515] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.142683 26996 raft_consensus.cc:515] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.167877 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771eedb34a9845bb876bb0217d55cb4f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.169381 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c3a77378814f77b6d0614228a63ee7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.169993 25898 raft_consensus.cc:3060] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.170465 26983 leader_election.cc:290] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.179302 27021 raft_consensus.cc:493] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.179860 27021 raft_consensus.cc:515] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.137224 26987 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.141726 27016 raft_consensus.cc:493] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.138531 26975 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.193709 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670569c4b0454f0e9605999e38e23e7f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.139285 27014 raft_consensus.cc:493] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.137392 27010 raft_consensus.cc:493] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:48.150858 27004 leader_election.cc:290] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.130645 26954 raft_consensus.cc:515] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.137144 27009 raft_consensus.cc:493] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.138636 27005 leader_election.cc:290] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:48.232293 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 56930us
W20260709 13:21:48.174268 26538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 70615.2us
I20260709 13:21:48.128397 27003 raft_consensus.cc:515] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.197963 26987 raft_consensus.cc:493] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.200837 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.195719 26989 raft_consensus.cc:493] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.242950 25906 raft_consensus.cc:1275] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:48.200024 27016 raft_consensus.cc:515] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.243479 27012 leader_election.cc:290] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.244738 27021 leader_election.cc:290] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.245157 27016 leader_election.cc:290] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.235239 27004 raft_consensus.cc:493] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.245729 27004 raft_consensus.cc:515] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.246173 26993 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.246855 26993 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.247805 27004 leader_election.cc:290] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:48.248432 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.249624 26993 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.250115 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.250957 26679 raft_consensus.cc:2468] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 1.
I20260709 13:21:48.252189 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.253194 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.254230 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.254562 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.255405 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.256925 27011 raft_consensus.cc:493] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.257707 27011 raft_consensus.cc:515] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.258320 26931 leader_election.cc:290] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.232561 27014 raft_consensus.cc:515] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.260752 27014 leader_election.cc:290] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.261299 27002 raft_consensus.cc:493] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.262699 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.263962 27017 raft_consensus.cc:493] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.257167 27013 leader_election.cc:290] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.248250 26987 raft_consensus.cc:515] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.260522 27011 leader_election.cc:290] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.264567 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13463f4cd4314c158c50a0151f456a8b" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.273134 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.242031 27010 raft_consensus.cc:515] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.276736 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.278911 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.279834 26996 leader_election.cc:290] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.280673 25974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:48.265908 27005 raft_consensus.cc:493] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.282081 26989 raft_consensus.cc:515] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.236374 27009 raft_consensus.cc:515] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.272691 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.358271 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:48.360462 26537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 126110us
I20260709 13:21:48.242887 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.361228 25901 raft_consensus.cc:3060] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.242875 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.256639 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.313619 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b11e0680366494cbe324cb81aa88f6c" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:48.273506 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.318372 27018 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.318291 25947 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.326493 25898 raft_consensus.cc:2468] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:48.356832 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.366494 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
W20260709 13:21:48.358431 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 166515us
I20260709 13:21:48.243046 26665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.316102 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.365108 25972 raft_consensus.cc:3055] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.377498 25972 raft_consensus.cc:740] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:48.362155 25903 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 1.
W20260709 13:21:48.374087 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 197347us
I20260709 13:21:48.373922 26849 raft_consensus.cc:2749] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.380961 27011 consensus_queue.cc:1048] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.331899 27013 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 33e3240923e54438a22da49413055ab3)
I20260709 13:21:48.357990 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.386758 25972 consensus_queue.cc:260] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.388130 25972 raft_consensus.cc:3060] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.388357 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.388633 25974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.389014 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.389649 25899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.389849 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.390291 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.390988 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.391424 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.391810 26989 leader_election.cc:290] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.392050 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.365276 27004 raft_consensus.cc:493] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.393343 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.393198 27004 raft_consensus.cc:515] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.394397 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.395226 27004 leader_election.cc:290] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.377179 25907 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 3.
I20260709 13:21:48.397147 25902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.398703 27013 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.399997 27010 leader_election.cc:290] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:48.400372 27009 leader_election.cc:290] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.359022 27005 raft_consensus.cc:515] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.315730 27017 raft_consensus.cc:515] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.401783 25904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
W20260709 13:21:48.402935 17969 debug-util.cc:398] Leaking SignalData structure 0x7b080000f9a0 after lost signal to thread 25981
I20260709 13:21:48.403129 27017 leader_election.cc:290] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.401173 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.404068 25904 raft_consensus.cc:1240] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Rejecting Update request from peer 33e3240923e54438a22da49413055ab3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:48.392678 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.404573 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7de3cff2ff4888914ce16cee616fe3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.389896 25974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668c03bad1284f0c81f6a7a445fce935" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.405350 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0689353df4c828d77cdd393901a86" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.406452 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.407359 26954 leader_election.cc:290] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.407469 25980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.408960 26987 leader_election.cc:290] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.400801 27013 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.406224 25974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.410784 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7def423740049449c29a407ce4a2855" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.457846 25901 raft_consensus.cc:2468] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
W20260709 13:21:48.488890 25944 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:48.414932 27003 leader_election.cc:290] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:48.380012 26538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 96089.4us
I20260709 13:21:48.415427 26679 raft_consensus.cc:1240] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Rejecting Update request from peer 33e3240923e54438a22da49413055ab3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:21:48.508580 25799 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 275042us
I20260709 13:21:48.511482 26665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.512738 26946 raft_consensus.cc:493] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.513275 26946 raft_consensus.cc:515] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:48.333155 27002 raft_consensus.cc:515] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.515589 26946 leader_election.cc:290] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.517091 27002 leader_election.cc:290] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.518422 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.520539 26665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.471370 27007 leader_election.cc:290] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.527311 25972 raft_consensus.cc:2468] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:48.509624 25799 leader_election.cc:304] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.538090 25799 leader_election.cc:304] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.538673 25972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:48.539291 25972 raft_consensus.cc:606] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Received request to transfer leadership to TS 07f41f48d6b44bbb8d23868f1366476c
W20260709 13:21:48.540637 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 161913us
I20260709 13:21:48.543890 25978 raft_consensus.cc:3060] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.544332 27025 raft_consensus.cc:2749] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.535455 27002 consensus_queue.cc:1048] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:21:48.545267 25687 debug-util.cc:398] Leaking SignalData structure 0x7b080037b4a0 after lost signal to thread 17967
W20260709 13:21:48.544796 25945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 157462us
W20260709 13:21:48.553076 25687 debug-util.cc:398] Leaking SignalData structure 0x7b08001ccbc0 after lost signal to thread 25690
W20260709 13:21:48.554461 25687 debug-util.cc:398] Leaking SignalData structure 0x7b0800328380 after lost signal to thread 25857
I20260709 13:21:48.554482 25972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f981b3562f647568da5155558fdb832"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:48.555370 25972 raft_consensus.cc:606] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Received request to transfer leadership to TS 07f41f48d6b44bbb8d23868f1366476c
W20260709 13:21:48.555653 25687 debug-util.cc:398] Leaking SignalData structure 0x7b08002c51c0 after lost signal to thread 25931
I20260709 13:21:48.541473 25799 leader_election.cc:304] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
W20260709 13:21:48.557843 25687 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1ec0 after lost signal to thread 26005
I20260709 13:21:48.556664 25799 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.545171 27034 raft_consensus.cc:2749] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.545195 26986 leader_election.cc:290] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.560196 27023 raft_consensus.cc:2804] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:48.560782 27023 raft_consensus.cc:493] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.561178 27023 raft_consensus.cc:3060] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:48.562731 25797 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:37623, user_credentials={real_user=slave}} blocked reactor thread for 184765us
I20260709 13:21:48.564064 27021 consensus_queue.cc:1048] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.566781 25978 raft_consensus.cc:2468] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:48.568912 25947 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:48.568992 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5799d4780d40e9904c5edb4a579b03" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.570550 25978 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a"
dest_uuid: "33e3240923e54438a22da49413055ab3"
mode: GRACEFUL
new_leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
 from {username='slave'} at 127.0.0.1:57014
I20260709 13:21:48.570653 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.571094 25978 raft_consensus.cc:606] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Received request to transfer leadership to TS e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.573050 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7a29df0a84d00b36c4968d6162f09" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.568699 27025 raft_consensus.cc:2749] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:21:48.574375 25946 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 151122us
I20260709 13:21:48.577756 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca0442774474ae1b1ff15ebe55623e6" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.571823 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481ec3c460694b6d83ec94f2b784a4d3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
W20260709 13:21:48.578899 25871 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.4:38321, user_credentials={real_user=slave}} blocked reactor thread for 191459us
I20260709 13:21:48.579149 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:48.579928 26982 raft_consensus.cc:493] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.580394 26982 raft_consensus.cc:515] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:48.582417 26982 leader_election.cc:290] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.584668 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586bf3736da64db09924ed1a59a2d4ba" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.575222 26537 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.585985 25871 leader_election.cc:304] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.586774 26996 raft_consensus.cc:2749] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.588431 25824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.589403 27005 leader_election.cc:290] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.589812 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.590588 25871 leader_election.cc:304] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.591116 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.591686 27005 raft_consensus.cc:2749] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.587783 27002 raft_consensus.cc:2749] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:21:48.577859 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 163369us
I20260709 13:21:48.592450 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611842cf4d6647579e69a91305193c72" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.594123 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.610824 26658 raft_consensus.cc:1240] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Rejecting Update request from peer e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:48.593242 26537 leader_election.cc:304] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:48.611317 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:48.594691 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8a0733adf424224946e6d7af7c0857f" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.597482 26639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.598891 26679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.599072 26665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.600805 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
W20260709 13:21:48.601069 25687 debug-util.cc:398] Leaking SignalData structure 0x7b08002ceba0 after lost signal to thread 26796
I20260709 13:21:48.599326 27023 raft_consensus.cc:515] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.602126 26538 leader_election.cc:304] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.634891 26948 raft_consensus.cc:993] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: : Instructing follower 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:48.635272 26950 raft_consensus.cc:2749] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:48.635433 26538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 63217.8us
I20260709 13:21:48.635398 26948 raft_consensus.cc:1081] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Signalling peer 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:48.636319 26538 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:48.637089 26950 raft_consensus.cc:2804] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:48.637439 26950 raft_consensus.cc:493] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.637777 26950 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.638971 26948 raft_consensus.cc:993] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3: : Instructing follower 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:48.639438 26948 raft_consensus.cc:1081] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Signalling peer 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:48.640406 25831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:41746
I20260709 13:21:48.640967 25831 raft_consensus.cc:493] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.641278 25831 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.643778 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f981b3562f647568da5155558fdb832"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:41746
I20260709 13:21:48.644328 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd8f222eaf04b4c8ab0dfc37a470592" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.644381 25828 raft_consensus.cc:493] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.644457 27014 consensus_queue.cc:1059] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:48.645031 25828 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.605429 25947 leader_election.cc:304] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.606312 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.609691 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.645613 27014 raft_consensus.cc:3055] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:48.594587 27030 raft_consensus.cc:2804] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:48.645977 27014 raft_consensus.cc:740] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:48.646186 27030 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:48.646394 26990 raft_consensus.cc:2749] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.646692 27030 raft_consensus.cc:3060] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.646952 27014 consensus_queue.cc:260] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.648351 27014 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.649659 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.650635 25947 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.651618 25824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.613989 27002 raft_consensus.cc:2804] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:48.653203 27002 raft_consensus.cc:697] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:48.654162 27002 consensus_queue.cc:237] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.655491 25945 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.614332 26537 leader_election.cc:304] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:48.656175 26985 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.656630 26990 raft_consensus.cc:2749] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.657127 27026 raft_consensus.cc:2804] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:48.657575 26537 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:48.657626 27026 raft_consensus.cc:697] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:48.658245 25826 raft_consensus.cc:1240] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Rejecting Update request from peer e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:48.659086 27026 consensus_queue.cc:237] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.617820 25872 leader_election.cc:304] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.620625 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de5011c14844d60875c562efc487b1f" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.657779 25945 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.661497 26990 raft_consensus.cc:2749] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.662448 26993 raft_consensus.cc:2749] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.662616 25945 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:48.663473 25872 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.2:45007, user_credentials={real_user=slave}} blocked reactor thread for 45729.9us
I20260709 13:21:48.663990 25945 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.664316 25872 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.666096 25872 leader_election.cc:304] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.667520 25945 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:48.668648 26849 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:48.669121 26849 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.669525 26849 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:48.670843 25973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.672132 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.673130 25945 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.674921 26691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3dd40d38541089c7e684f78dc69b3" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.673838 26993 raft_consensus.cc:2749] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.652830 26950 raft_consensus.cc:515] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.677415 26986 raft_consensus.cc:2749] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.678695 26950 leader_election.cc:290] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.679636 25824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.663386 26990 raft_consensus.cc:2749] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.680441 25979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7950a85af94b4e019cbd26c1d87687eb" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.681896 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d83abde02ee5491eba5ed2e17bed1602" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.673844 26951 raft_consensus.cc:2804] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:48.683120 26951 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:48.683499 26951 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.683564 26985 raft_consensus.cc:2749] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.685582 27030 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.687099 25828 raft_consensus.cc:515] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.694684 26691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.696208 26665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:48.702638 25872 leader_election.cc:304] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.688352 25978 raft_consensus.cc:1240] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Rejecting Update request from peer e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:48.689046 26948 raft_consensus.cc:2749] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.689792 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:48.689318 27023 leader_election.cc:290] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.690604 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.712476 25872 leader_election.cc:304] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.698033 25828 leader_election.cc:290] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.698457 27029 raft_consensus.cc:2749] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.705960 26849 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.715523 26658 raft_consensus.cc:1240] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Rejecting Update request from peer e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:48.716532 26988 raft_consensus.cc:2749] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.718816 26849 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.698065 25831 raft_consensus.cc:515] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.687654 27030 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:48.713802 27005 raft_consensus.cc:2749] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.719509 25872 leader_election.cc:304] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.721386 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:48.726908 25831 leader_election.cc:290] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:48.727074 27005 raft_consensus.cc:2749] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.724557 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.723992 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.725994 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e0689353df4c828d77cdd393901a86" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.722281 26993 consensus_queue.cc:1059] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:48.729662 25872 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.730430 27029 raft_consensus.cc:2749] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.729722 26993 raft_consensus.cc:3055] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:48.731662 26993 raft_consensus.cc:740] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:48.731843 25872 leader_election.cc:304] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.732668 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:48.732776 27029 raft_consensus.cc:2749] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.733310 25825 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.731671 26951 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.734159 25872 leader_election.cc:304] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.734887 27029 raft_consensus.cc:2749] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.735973 25872 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.736657 27029 raft_consensus.cc:2749] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.738163 25872 leader_election.cc:304] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.744350 25825 raft_consensus.cc:2468] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:48.745225 25797 leader_election.cc:304] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.747743 25872 leader_election.cc:304] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.748569 25978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c147093b5240b8b481ac54e516aeab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.752785 25797 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.753489 25975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f6007c3cb04bd59b7caf8214c65927" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.754191 27029 raft_consensus.cc:2749] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.754676 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e86e384892614e74903bbfff46ab5bab" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:48.756382 27023 raft_consensus.cc:2749] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.759011 26996 raft_consensus.cc:2749] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.759750 27014 consensus_queue.cc:1059] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.760684 25825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:48.759799 26993 consensus_queue.cc:260] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.762372 26993 raft_consensus.cc:3060] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.764294 25824 raft_consensus.cc:1240] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Rejecting Update request from peer 33e3240923e54438a22da49413055ab3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:48.767333 25797 leader_election.cc:304] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.764298 25654 catalog_manager.cc:5697] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.769498 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6ccd3ac7a54d1bb09a0561e78a565c" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.769969 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc96524b1d7040a8b84b00484dc7aef9" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.770445 26994 raft_consensus.cc:2749] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.760861 27014 raft_consensus.cc:3055] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.767920 27023 raft_consensus.cc:2749] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.770848 25654 catalog_manager.cc:5697] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.771322 27014 raft_consensus.cc:740] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:48.772985 25977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:48.773674 25977 raft_consensus.cc:3055] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:48.773962 25977 raft_consensus.cc:740] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:48.774590 25975 raft_consensus.cc:1240] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 3. Current term is 4. Ops: []
I20260709 13:21:48.774781 25977 consensus_queue.cc:260] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
W20260709 13:21:48.775949 25872 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:48.776072 25977 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.777160 27030 consensus_queue.cc:1059] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:48.778131 27030 raft_consensus.cc:3055] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:48.778431 27030 raft_consensus.cc:740] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:48.779389 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "298853b845e64b97bccea766389bcc3f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.779239 27030 consensus_queue.cc:260] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.779645 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981b3562f647568da5155558fdb832" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.780239 25907 raft_consensus.cc:3060] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.781607 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.782151 25901 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.782691 25898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049578b5413b48c796dc1da162f42a17" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.774704 27014 consensus_queue.cc:260] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.780566 27030 raft_consensus.cc:3060] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:48.789263 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:48.790848 25947 leader_election.cc:304] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.796795 26849 raft_consensus.cc:2749] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.793344 25977 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:48.794445 26676 raft_consensus.cc:1240] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Rejecting Update request from peer 07f41f48d6b44bbb8d23868f1366476c for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:48.797498 27014 raft_consensus.cc:3060] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.795017 25901 raft_consensus.cc:2468] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:48.800930 25947 leader_election.cc:304] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.801645 26849 raft_consensus.cc:2749] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.801901 26951 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:48.803233 27015 consensus_queue.cc:1059] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:48.804224 27015 raft_consensus.cc:3055] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.804569 27015 raft_consensus.cc:740] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:48.804627 25947 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.805277 25797 leader_election.cc:304] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.805536 26849 raft_consensus.cc:2749] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.805658 27015 consensus_queue.cc:260] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.807116 27015 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.807336 27023 raft_consensus.cc:2749] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.808260 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:48.809725 25907 raft_consensus.cc:2468] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:48.781469 26538 leader_election.cc:304] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:48.811242 26951 raft_consensus.cc:2804] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:48.811714 26951 raft_consensus.cc:697] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:48.812573 26951 consensus_queue.cc:237] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.813531 25903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9bb5fa0d5842dfb3508b23e0a4a3a7" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.810289 25797 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:48.814706 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081438f330e54faf854a05dda77dc8a3" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.815337 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440b1e80c1624e4c90ca0a9d1470da28" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.821887 25797 leader_election.cc:304] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.823987 25901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a5b70f7ceb4599ae0da4cec23f7963" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.822449 27023 raft_consensus.cc:2804] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:48.825135 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a6930862024730845f5f504c1e0116" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:48.826998 27023 raft_consensus.cc:697] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:48.827471 25797 leader_election.cc:304] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.827893 27023 consensus_queue.cc:237] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.828296 27025 raft_consensus.cc:2749] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.828670 25797 leader_election.cc:304] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.833705 27034 consensus_queue.cc:1059] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:48.834012 25797 leader_election.cc:304] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3; no voters: 
I20260709 13:21:48.834669 26994 raft_consensus.cc:3055] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:48.834815 27034 raft_consensus.cc:2804] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:48.836304 27034 raft_consensus.cc:697] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:48.836489 25827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4a10888f634b928b16da286c94e1c3" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.837180 27034 consensus_queue.cc:237] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.838001 25824 raft_consensus.cc:1240] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Rejecting Update request from peer e0f5cbbd64e14739bd096bf5d7b85828 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:48.838517 25872 leader_election.cc:304] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.839808 27005 raft_consensus.cc:2749] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.836519 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219a9df4cc90493a8b2d7ec008f83019" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:48.839840 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8eea0b353e94457bf93ed589f60eaa2" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.835042 26994 raft_consensus.cc:740] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:48.843634 26994 consensus_queue.cc:260] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:48.844890 26994 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:48.851771 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.859051 25945 leader_election.cc:304] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.860093 26849 raft_consensus.cc:2749] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.859215 26537 leader_election.cc:304] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.861759 26537 leader_election.cc:304] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.863022 26537 leader_election.cc:304] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.863715 27002 raft_consensus.cc:2749] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.864116 27026 raft_consensus.cc:2749] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.864625 26931 raft_consensus.cc:2749] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.867249 26537 leader_election.cc:304] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.869254 26931 raft_consensus.cc:2749] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.872802 26537 leader_election.cc:304] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.874171 27026 raft_consensus.cc:2749] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.875562 26537 leader_election.cc:304] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.876698 27026 raft_consensus.cc:2749] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.877552 26537 leader_election.cc:304] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.878180 25871 leader_election.cc:304] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.878347 27026 raft_consensus.cc:2749] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.879333 26537 leader_election.cc:304] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.882170 26537 leader_election.cc:304] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.882670 27026 raft_consensus.cc:2749] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.882921 26931 raft_consensus.cc:2749] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.884363 25906 raft_consensus.cc:2468] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:48.884934 27014 raft_consensus.cc:2749] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.885989 25871 leader_election.cc:304] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.889422 25871 leader_election.cc:304] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 07f41f48d6b44bbb8d23868f1366476c, 33e3240923e54438a22da49413055ab3
I20260709 13:21:48.890350 25871 leader_election.cc:304] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.889029 27005 raft_consensus.cc:2749] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:48.891105 27029 raft_consensus.cc:2749] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.898013 25871 leader_election.cc:304] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.910291 25797 leader_election.cc:304] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.913228 27023 raft_consensus.cc:2804] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:48.913865 27023 raft_consensus.cc:697] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:48.914702 27023 consensus_queue.cc:237] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:48.892800 26996 raft_consensus.cc:2749] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.916846 25907 raft_consensus.cc:2468] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:48.926429 27014 raft_consensus.cc:2749] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.927444 27014 consensus_queue.cc:1059] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.927645 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.932229 25906 raft_consensus.cc:1240] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Rejecting Update request from peer 33e3240923e54438a22da49413055ab3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:21:48.933251 27036 raft_consensus.cc:2749] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.955624 26849 raft_consensus.cc:993] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3: : Instructing follower e0f5cbbd64e14739bd096bf5d7b85828 to start an election
I20260709 13:21:48.961560 27025 raft_consensus.cc:2749] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:48.959568 26849 raft_consensus.cc:1081] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Signalling peer e0f5cbbd64e14739bd096bf5d7b85828 to start an election
I20260709 13:21:48.963270 27029 raft_consensus.cc:3055] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:48.967748 27029 raft_consensus.cc:740] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:48.968938 27029 consensus_queue.cc:260] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:48.934779 25900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:48.935546 26537 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.975409 27026 raft_consensus.cc:2749] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.973420 27029 raft_consensus.cc:3060] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.982249 25945 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:48.983319 27030 raft_consensus.cc:2749] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:48.985176 25945 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:48.916729 25976 raft_consensus.cc:2468] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:48.988539 25906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a"
dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
 from {username='slave'} at 127.0.0.1:56614
I20260709 13:21:48.989159 25906 raft_consensus.cc:493] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:48.989485 25906 raft_consensus.cc:3060] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:48.986377 27030 raft_consensus.cc:2749] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:49.004325 25654 catalog_manager.cc:5697] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 2 to 3, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 3 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.005928 25654 catalog_manager.cc:5697] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 2 to 3, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 3 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.009920 25654 catalog_manager.cc:5697] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 2, leader changed from e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 2 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.006965 25651 catalog_manager.cc:5697] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 2 to 3, leader changed from e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.025532 25906 raft_consensus.cc:515] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:49.027606 25906 leader_election.cc:290] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:49.028244 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:49.028892 25828 raft_consensus.cc:3060] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.029141 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cdf5467ff214d0290c6ef81639ed01a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:49.029819 25976 raft_consensus.cc:3055] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:49.030169 25976 raft_consensus.cc:740] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:49.031114 25976 consensus_queue.cc:260] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:49.032478 25976 raft_consensus.cc:3060] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.038331 25828 raft_consensus.cc:2468] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:49.039575 25872 leader_election.cc:304] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:49.040271 27029 raft_consensus.cc:2804] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:49.040766 27029 raft_consensus.cc:697] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:49.041669 27029 consensus_queue.cc:237] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:49.052539 25976 raft_consensus.cc:2468] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:49.059628 25654 catalog_manager.cc:5697] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from 33e3240923e54438a22da49413055ab3 (127.17.139.4) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.172329 25905 raft_consensus.cc:1275] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.173547 26951 consensus_queue.cc:1048] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.203377 25976 raft_consensus.cc:1275] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.209299 27026 consensus_queue.cc:1048] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.223902 25976 raft_consensus.cc:1275] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.225410 26931 consensus_queue.cc:1048] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.242837 25905 raft_consensus.cc:1275] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.244151 26951 consensus_queue.cc:1048] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.280398 25905 raft_consensus.cc:1275] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.281620 27023 consensus_queue.cc:1048] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.295591 25828 raft_consensus.cc:1275] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.297462 26951 consensus_queue.cc:1048] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.302042 25976 raft_consensus.cc:1275] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.304539 27034 consensus_queue.cc:1048] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.309866 25977 raft_consensus.cc:1275] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.311192 27024 consensus_queue.cc:1048] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.312513 25907 raft_consensus.cc:1275] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.313928 26951 consensus_queue.cc:1048] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.373746 25907 raft_consensus.cc:1275] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.375536 27036 consensus_queue.cc:1048] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.452970 25905 raft_consensus.cc:1275] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.454414 27034 consensus_queue.cc:1048] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.457027 26658 raft_consensus.cc:3060] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.465948 26658 raft_consensus.cc:1275] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.467203 27036 consensus_queue.cc:1048] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.612365 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:49.641681 25826 raft_consensus.cc:1275] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.643327 27028 consensus_queue.cc:1048] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:49.668807 25977 raft_consensus.cc:1275] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:49.670262 27028 consensus_queue.cc:1048] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:49.686025 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:49.765779 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
mode: GRACEFUL
new_leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
 from {username='slave'} at 127.0.0.1:53628
I20260709 13:21:49.766366 25828 raft_consensus.cc:606] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Received request to transfer leadership to TS e0f5cbbd64e14739bd096bf5d7b85828
I20260709 13:21:49.769448 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
mode: GRACEFUL
new_leader_uuid: "33e3240923e54438a22da49413055ab3"
 from {username='slave'} at 127.0.0.1:53628
I20260709 13:21:49.770364 25828 raft_consensus.cc:606] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Received request to transfer leadership to TS 33e3240923e54438a22da49413055ab3
I20260709 13:21:49.775321 25826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
mode: GRACEFUL
new_leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:53628
I20260709 13:21:49.775938 25826 raft_consensus.cc:606] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Received request to transfer leadership to TS ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:49.777024 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:21:49.778152 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:49.785073 27036 raft_consensus.cc:993] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c: : Instructing follower e0f5cbbd64e14739bd096bf5d7b85828 to start an election
I20260709 13:21:49.785586 27036 raft_consensus.cc:1081] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Signalling peer e0f5cbbd64e14739bd096bf5d7b85828 to start an election
I20260709 13:21:49.789541 25905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b"
dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
 from {username='slave'} at 127.0.0.1:56626
I20260709 13:21:49.790055 25905 raft_consensus.cc:493] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:49.790350 25905 raft_consensus.cc:3060] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.809487 25905 raft_consensus.cc:515] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:49.812971 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:49.813614 25826 raft_consensus.cc:3055] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:49.813956 25826 raft_consensus.cc:740] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:49.814708 25826 consensus_queue.cc:260] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:49.815860 25826 raft_consensus.cc:3060] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.816774 25905 leader_election.cc:290] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:49.816989 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d01f627682fd449e9ee01ba8a323ab4b" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:49.817539 26658 raft_consensus.cc:3060] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.826432 25826 raft_consensus.cc:2468] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:49.827903 25872 leader_election.cc:304] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:49.828650 27029 raft_consensus.cc:2804] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:49.829205 27029 raft_consensus.cc:697] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:49.830214 27029 consensus_queue.cc:237] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:49.834295 26658 raft_consensus.cc:2468] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 2.
I20260709 13:21:49.849408 25655 catalog_manager.cc:5697] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 1 to 2, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.047904 27029 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.048408 27029 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:50.050444 27029 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:50.051153 25975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:50.051417 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:50.051968 26658 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 3.
I20260709 13:21:50.051908 25975 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 3.
I20260709 13:21:50.053364 25873 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:50.054136 27029 raft_consensus.cc:2804] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:50.054538 27029 raft_consensus.cc:493] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:50.054828 27029 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:50.057969 27036 raft_consensus.cc:993] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c: : Instructing follower 33e3240923e54438a22da49413055ab3 to start an election
I20260709 13:21:50.058518 27024 raft_consensus.cc:1081] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Signalling peer 33e3240923e54438a22da49413055ab3 to start an election
I20260709 13:21:50.060146 25975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd"
dest_uuid: "33e3240923e54438a22da49413055ab3"
 from {username='slave'} at 127.0.0.1:52992
I20260709 13:21:50.060704 25975 raft_consensus.cc:493] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.061108 25975 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.061626 27029 raft_consensus.cc:515] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:50.063906 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:50.064205 27029 leader_election.cc:290] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 election: Requested vote from peers 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
I20260709 13:21:50.064507 25976 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:50.069264 26658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb0405f6455d423cbefdabe29f4ea09a" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:50.069811 26658 raft_consensus.cc:3060] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:50.070288 25975 raft_consensus.cc:515] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:50.073550 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:50.074112 26676 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.074007 25975 leader_election.cc:290] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:50.075117 25976 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 4.
I20260709 13:21:50.078035 25871 leader_election.cc:304] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:50.078954 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5739b15c8ac4954a459dbcb444924dd" candidate_uuid: "33e3240923e54438a22da49413055ab3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:50.079530 25828 raft_consensus.cc:3055] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:50.079821 25828 raft_consensus.cc:740] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:50.080534 26658 raft_consensus.cc:2468] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 4.
I20260709 13:21:50.080591 25828 consensus_queue.cc:260] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:50.081701 27028 raft_consensus.cc:2804] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:50.081862 25828 raft_consensus.cc:3060] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.082227 27028 raft_consensus.cc:697] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:50.083076 27028 consensus_queue.cc:237] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:50.101609 26676 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 3.
I20260709 13:21:50.102540 26951 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:50.102852 25947 leader_election.cc:304] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e3240923e54438a22da49413055ab3, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:50.103128 26951 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:50.103870 26990 raft_consensus.cc:2804] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:50.104359 26990 raft_consensus.cc:697] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 3 LEADER]: Becoming Leader. State: Replica: 33e3240923e54438a22da49413055ab3, State: Running, Role: LEADER
I20260709 13:21:50.105293 26951 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:50.105245 26990 consensus_queue.cc:237] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:50.105928 25828 raft_consensus.cc:2468] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33e3240923e54438a22da49413055ab3 in term 3.
I20260709 13:21:50.107132 25975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:50.107937 25975 raft_consensus.cc:2393] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 2: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:50.108016 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:50.108685 25907 raft_consensus.cc:2468] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:50.113670 26537 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:50.114799 26951 raft_consensus.cc:2804] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:50.115339 26951 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e0f5cbbd64e14739bd096bf5d7b85828)
I20260709 13:21:50.115820 26951 raft_consensus.cc:3060] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.115825 27024 raft_consensus.cc:993] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c: : Instructing follower ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:50.121942 27024 raft_consensus.cc:1081] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Signalling peer ed3d8ccf509b4a698ed5a016cc5c2373 to start an election
I20260709 13:21:50.123773 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
 from {username='slave'} at 127.0.0.1:44604
I20260709 13:21:50.124310 26676 raft_consensus.cc:493] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.124738 26676 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.124058 25655 catalog_manager.cc:5697] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.131671 26676 raft_consensus.cc:515] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.134271 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:50.134851 25828 raft_consensus.cc:3055] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:50.135203 25828 raft_consensus.cc:740] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:50.135985 25828 consensus_queue.cc:260] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.137100 25828 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.139904 26951 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:50.146179 25975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:50.146365 25828 raft_consensus.cc:2468] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:50.147014 25975 raft_consensus.cc:2393] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ed3d8ccf509b4a698ed5a016cc5c2373 in current term 2: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:50.145656 26951 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Requested vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:50.148587 26538 leader_election.cc:304] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:50.149365 26951 raft_consensus.cc:2804] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:50.150455 26951 raft_consensus.cc:697] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:50.150517 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefde71331ca4e0a87cdf6dc7639b9b0" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:50.151311 26951 consensus_queue.cc:237] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.155655 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefea1f5b064445b792836db4d27b94" candidate_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:50.156287 25905 raft_consensus.cc:3060] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.157284 25655 catalog_manager.cc:5697] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 reported cstate change: term changed from 2 to 3, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to 33e3240923e54438a22da49413055ab3 (127.17.139.4). New cstate: current_term: 3 leader_uuid: "33e3240923e54438a22da49413055ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.164981 25905 raft_consensus.cc:2468] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 3.
I20260709 13:21:50.165879 25907 raft_consensus.cc:2468] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed3d8ccf509b4a698ed5a016cc5c2373 in term 2.
I20260709 13:21:50.166282 26676 leader_election.cc:290] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 3 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:50.167203 26537 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:50.168268 27002 raft_consensus.cc:2804] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:50.168741 27002 raft_consensus.cc:697] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Leader. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:50.169572 27002 consensus_queue.cc:237] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:50.175444 25651 catalog_manager.cc:5697] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 2 to 3, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 3 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.201347 25651 catalog_manager.cc:5697] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 reported cstate change: term changed from 1 to 2, leader changed from e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3) to ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:50.273846 25828 raft_consensus.cc:1275] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:50.275518 27029 consensus_queue.cc:1048] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:50.283809 27036 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.284282 27036 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.286566 27036 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:50.289137 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" is_pre_election: true
I20260709 13:21:50.289883 26634 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 2.
I20260709 13:21:50.290859 25799 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:50.291249 25905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" is_pre_election: true
I20260709 13:21:50.291818 25905 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 1.
I20260709 13:21:50.293339 27036 raft_consensus.cc:2804] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:50.293733 27036 raft_consensus.cc:493] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:50.294059 27036 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.309799 26634 raft_consensus.cc:1275] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:50.313050 27028 consensus_queue.cc:1048] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:50.350251 25947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:43003, user_credentials={real_user=slave}} blocked reactor thread for 49524.8us
I20260709 13:21:50.419927 27036 raft_consensus.cc:515] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.427896 27071 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:50.428465 27071 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:50.430920 27071 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:50.447069 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c" is_pre_election: true
I20260709 13:21:50.447712 25828 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 4.
I20260709 13:21:50.451334 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3" is_pre_election: true
I20260709 13:21:50.452701 25976 raft_consensus.cc:2393] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 4: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:50.449980 25872 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:50.459432 27085 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:50.460644 27085 raft_consensus.cc:493] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 07f41f48d6b44bbb8d23868f1366476c)
I20260709 13:21:50.461035 27085 raft_consensus.cc:3060] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:50.462541 27036 leader_election.cc:290] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:50.463619 25907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:50.464146 25907 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.469367 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b15472c834bf5bed1d6c0e209037f" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:50.469997 26676 raft_consensus.cc:3060] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.473807 25907 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:50.475100 25797 leader_election.cc:304] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 
I20260709 13:21:50.479650 26676 raft_consensus.cc:2468] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:50.476030 27094 raft_consensus.cc:2804] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:50.486701 27094 raft_consensus.cc:697] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:50.487645 27094 consensus_queue.cc:237] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.500753 27085 raft_consensus.cc:515] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:50.502985 27085 leader_election.cc:290] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 election: Requested vote from peers 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007), 33e3240923e54438a22da49413055ab3 (127.17.139.4:38321)
I20260709 13:21:50.503257 25826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
I20260709 13:21:50.503693 25976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d86df3820ac4e96b1c6bcbe7c9c9593" candidate_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "33e3240923e54438a22da49413055ab3"
I20260709 13:21:50.504549 25976 raft_consensus.cc:2393] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e0f5cbbd64e14739bd096bf5d7b85828 in current term 4: Already voted for candidate 33e3240923e54438a22da49413055ab3 in this term.
I20260709 13:21:50.510470 26676 raft_consensus.cc:1275] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.511453 25826 raft_consensus.cc:2468] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0f5cbbd64e14739bd096bf5d7b85828 in term 4.
I20260709 13:21:50.511771 26990 consensus_queue.cc:1048] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.512707 25872 leader_election.cc:304] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, e0f5cbbd64e14739bd096bf5d7b85828; no voters: 33e3240923e54438a22da49413055ab3
I20260709 13:21:50.513661 27092 raft_consensus.cc:2804] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:50.514207 27092 raft_consensus.cc:697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 LEADER]: Becoming Leader. State: Replica: e0f5cbbd64e14739bd096bf5d7b85828, State: Running, Role: LEADER
I20260709 13:21:50.515161 27092 consensus_queue.cc:237] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } }
I20260709 13:21:50.516696 25651 catalog_manager.cc:5697] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.534726 25652 catalog_manager.cc:5697] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 reported cstate change: term changed from 3 to 4, leader changed from 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2) to e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3). New cstate: current_term: 4 leader_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.564941 25826 raft_consensus.cc:1275] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer 33e3240923e54438a22da49413055ab3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.564970 26676 raft_consensus.cc:1275] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 4 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:50.566320 26948 consensus_queue.cc:1048] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.566470 27085 consensus_queue.cc:1048] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:50.595794 25976 raft_consensus.cc:1275] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:50.603814 27008 consensus_queue.cc:1048] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:50.608507 25975 raft_consensus.cc:1275] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:50.610095 27085 consensus_queue.cc:1048] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:50.634759 25907 raft_consensus.cc:1275] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:50.636453 27087 consensus_queue.cc:1048] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:50.677565 25907 raft_consensus.cc:1275] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.678966 27087 consensus_queue.cc:1048] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.711681 25826 raft_consensus.cc:1275] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Refusing update from remote peer ed3d8ccf509b4a698ed5a016cc5c2373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:50.713267 27002 consensus_queue.cc:1048] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:50.779039 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:50.827589 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:50.884085 26676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece"
dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
mode: GRACEFUL
new_leader_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:37492
I20260709 13:21:50.884815 26676 raft_consensus.cc:606] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Received request to transfer leadership to TS 07f41f48d6b44bbb8d23868f1366476c
I20260709 13:21:50.885993 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:21:50.887247 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:50.916370 25905 raft_consensus.cc:1275] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:50.918111 27024 consensus_queue.cc:1048] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:50.926476 27002 raft_consensus.cc:993] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373: : Instructing follower 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:50.926963 27002 raft_consensus.cc:1081] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Signalling peer 07f41f48d6b44bbb8d23868f1366476c to start an election
I20260709 13:21:50.929183 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece"
dest_uuid: "07f41f48d6b44bbb8d23868f1366476c"
 from {username='slave'} at 127.0.0.1:33298
I20260709 13:21:50.929701 25828 raft_consensus.cc:493] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.930018 25828 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.930919 26676 raft_consensus.cc:1275] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:50.933553 27036 consensus_queue.cc:1048] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:50.941586 25828 raft_consensus.cc:515] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.943562 25828 leader_election.cc:290] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Requested vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623)
I20260709 13:21:50.945356 26634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373"
I20260709 13:21:50.945976 26634 raft_consensus.cc:3055] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:50.946313 26634 raft_consensus.cc:740] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed3d8ccf509b4a698ed5a016cc5c2373, State: Running, Role: LEADER
I20260709 13:21:50.945976 25906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdeb29833f3c4de88695f421ea891ece" candidate_uuid: "07f41f48d6b44bbb8d23868f1366476c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0f5cbbd64e14739bd096bf5d7b85828"
I20260709 13:21:50.947077 26634 consensus_queue.cc:260] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.947767 25906 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.948377 26634 raft_consensus.cc:3060] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.952896 25975 raft_consensus.cc:1275] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:50.955127 26634 raft_consensus.cc:2468] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:50.955345 27085 consensus_queue.cc:1048] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:50.956808 25799 leader_election.cc:304] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373; no voters: 
I20260709 13:21:50.957546 27036 raft_consensus.cc:2804] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:50.958010 27036 raft_consensus.cc:697] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Becoming Leader. State: Replica: 07f41f48d6b44bbb8d23868f1366476c, State: Running, Role: LEADER
I20260709 13:21:50.958839 27036 consensus_queue.cc:237] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } }
I20260709 13:21:50.961234 25906 raft_consensus.cc:2468] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07f41f48d6b44bbb8d23868f1366476c in term 3.
I20260709 13:21:50.972736 25826 raft_consensus.cc:1275] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 4 FOLLOWER]: Refusing update from remote peer e0f5cbbd64e14739bd096bf5d7b85828: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:50.976217 27092 consensus_queue.cc:1048] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:51.002307 25652 catalog_manager.cc:5697] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c reported cstate change: term changed from 2 to 3, leader changed from ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1) to 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2). New cstate: current_term: 3 leader_uuid: "07f41f48d6b44bbb8d23868f1366476c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.375566 26634 raft_consensus.cc:1275] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:51.376801 27036 consensus_queue.cc:1048] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:51.405524 25906 raft_consensus.cc:1275] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Refusing update from remote peer 07f41f48d6b44bbb8d23868f1366476c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:51.415119 27024 consensus_queue.cc:1048] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:51.888146 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:51.926383 17964 tablet_server.cc:179] TabletServer@127.17.139.1:43003 shutting down...
W20260709 13:21:51.931525 25947 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 153 similar messages]
W20260709 13:21:51.936290 25947 consensus_peers.cc:597] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:51.944051 25799 consensus_peers.cc:597] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:51.952167 25873 consensus_peers.cc:597] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:51.960031 25799 consensus_peers.cc:597] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.969456 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:51.970726 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.971925 17964 raft_consensus.cc:2243] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.972983 17964 raft_consensus.cc:2272] T 4816921c4c524ae7a5976325662d4c03 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.975459 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.976074 17964 raft_consensus.cc:2243] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.977039 17964 raft_consensus.cc:2272] T fefde71331ca4e0a87cdf6dc7639b9b0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.979315 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.979983 17964 raft_consensus.cc:2243] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.980470 17964 raft_consensus.cc:2272] T a8a0733adf424224946e6d7af7c0857f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.983239 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.984025 17964 raft_consensus.cc:2243] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:51.984180 25873 consensus_peers.cc:597] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.984599 17964 raft_consensus.cc:2272] T bb0405f6455d423cbefdabe29f4ea09a P ed3d8ccf509b4a698ed5a016cc5c2373 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.987130 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.987766 17964 raft_consensus.cc:2243] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.988279 17964 raft_consensus.cc:2272] T 1d6ccd3ac7a54d1bb09a0561e78a565c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.990409 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.991005 17964 raft_consensus.cc:2243] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.991374 17964 raft_consensus.cc:2272] T 8ca0442774474ae1b1ff15ebe55623e6 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.993919 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.994822 17964 raft_consensus.cc:2243] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.995306 17964 raft_consensus.cc:2272] T 5cd8f222eaf04b4c8ab0dfc37a470592 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.996750 25873 consensus_peers.cc:597] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.997589 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:51.998211 17964 raft_consensus.cc:2243] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.998617 17964 raft_consensus.cc:2272] T 22d400a9f48b4625b8af26e86e19461d P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.000681 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.001466 17964 raft_consensus.cc:2243] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.002277 17964 raft_consensus.cc:2272] T 7950a85af94b4e019cbd26c1d87687eb P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.005002 17964 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:52.004973 25947 consensus_peers.cc:597] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.005877 17964 raft_consensus.cc:2243] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.006400 17964 raft_consensus.cc:2272] T 771eedb34a9845bb876bb0217d55cb4f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.008448 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.009058 17964 raft_consensus.cc:2243] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.009424 17964 raft_consensus.cc:2272] T fb7de3cff2ff4888914ce16cee616fe3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.011780 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.012382 17964 raft_consensus.cc:2243] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.012895 17964 raft_consensus.cc:2272] T 049578b5413b48c796dc1da162f42a17 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.015154 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.016089 17964 raft_consensus.cc:2243] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.016850 17964 raft_consensus.cc:2272] T 670569c4b0454f0e9605999e38e23e7f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.018761 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.019266 17964 raft_consensus.cc:2243] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.019630 17964 raft_consensus.cc:2272] T c8a2398487364fe5b17151c707da3d38 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.021564 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.022050 17964 raft_consensus.cc:2243] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.022403 17964 raft_consensus.cc:2272] T 82e0689353df4c828d77cdd393901a86 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.024156 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.024681 17964 raft_consensus.cc:2243] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.025061 17964 raft_consensus.cc:2272] T c9adacf3baa64bbc9f77334887ac19bd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.026791 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.027318 17964 raft_consensus.cc:2243] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.027732 17964 raft_consensus.cc:2272] T 440b1e80c1624e4c90ca0a9d1470da28 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.029758 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.030272 17964 raft_consensus.cc:2243] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.030647 17964 raft_consensus.cc:2272] T d6a5b70f7ceb4599ae0da4cec23f7963 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.032539 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.033093 17964 raft_consensus.cc:2243] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.033490 17964 raft_consensus.cc:2272] T 926bedb86c194b7787f058066b3abbb7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.035470 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.035988 17964 raft_consensus.cc:2243] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.036441 17964 raft_consensus.cc:2272] T 88a3dd40d38541089c7e684f78dc69b3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.038923 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.039773 17964 raft_consensus.cc:2243] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.040279 17964 raft_consensus.cc:2272] T e5739b15c8ac4954a459dbcb444924dd P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.040324 25873 consensus_peers.cc:597] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.042514 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.043171 17964 raft_consensus.cc:2243] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.043587 17964 raft_consensus.cc:2272] T 298853b845e64b97bccea766389bcc3f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.045912 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.046468 17964 raft_consensus.cc:2243] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.047295 17964 raft_consensus.cc:2272] T 40c147093b5240b8b481ac54e516aeab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.049636 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.050354 17964 raft_consensus.cc:2243] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.051203 17964 raft_consensus.cc:2272] T b8eea0b353e94457bf93ed589f60eaa2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.054859 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.055593 17964 raft_consensus.cc:2243] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.055984 17964 raft_consensus.cc:2272] T 113a9ca6eaed4ac3881ea23e2261267b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.058243 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.058790 17964 raft_consensus.cc:2243] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.059461 17964 raft_consensus.cc:2272] T 6b11e0680366494cbe324cb81aa88f6c P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.061278 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.061782 17964 raft_consensus.cc:2243] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.062192 17964 raft_consensus.cc:2272] T d83abde02ee5491eba5ed2e17bed1602 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.064036 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.064610 17964 raft_consensus.cc:2243] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.065337 17964 raft_consensus.cc:2272] T ebefea1f5b064445b792836db4d27b94 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.067286 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.067870 17964 raft_consensus.cc:2243] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.068333 17964 raft_consensus.cc:2272] T fdeb29833f3c4de88695f421ea891ece P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.071030 17964 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:52.071197 25947 consensus_peers.cc:597] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.071727 17964 raft_consensus.cc:2243] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:21:52.072477 25947 consensus_peers.cc:597] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.072515 17964 raft_consensus.cc:2272] T e86e384892614e74903bbfff46ab5bab P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.074621 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.075205 17964 raft_consensus.cc:2243] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.075587 17964 raft_consensus.cc:2272] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.077577 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.078209 17964 raft_consensus.cc:2243] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.078713 17964 raft_consensus.cc:2272] T d01f627682fd449e9ee01ba8a323ab4b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.079838 25873 consensus_peers.cc:597] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.081445 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.082267 17964 raft_consensus.cc:2243] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.083290 17964 raft_consensus.cc:2272] T 90f919e905134e49be8c590c4ee5e3b2 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.086056 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.086807 17964 raft_consensus.cc:2243] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.087241 17964 raft_consensus.cc:2272] T 13463f4cd4314c158c50a0151f456a8b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.089385 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.089888 17964 raft_consensus.cc:2243] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.090624 17964 raft_consensus.cc:2272] T 98535bc4fa014421a709e3c207ea43f0 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.092564 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.093147 17964 raft_consensus.cc:2243] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.093616 17964 raft_consensus.cc:2272] T 75b847d9971e4cc59c55d60bca9bd6fa P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.095902 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.096565 17964 raft_consensus.cc:2243] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.097044 17964 raft_consensus.cc:2272] T 254b15472c834bf5bed1d6c0e209037f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.097067 25947 consensus_peers.cc:597] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.098968 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.099503 17964 raft_consensus.cc:2243] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.099985 17964 raft_consensus.cc:2272] T 668c03bad1284f0c81f6a7a445fce935 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.102916 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.103628 17964 raft_consensus.cc:2243] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.104066 17964 raft_consensus.cc:2272] T c4a6930862024730845f5f504c1e0116 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.105965 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.106503 17964 raft_consensus.cc:2243] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.107136 17964 raft_consensus.cc:2272] T 75c3a77378814f77b6d0614228a63ee7 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.108801 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.109268 17964 raft_consensus.cc:2243] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.109593 17964 raft_consensus.cc:2272] T 6de5011c14844d60875c562efc487b1f P ed3d8ccf509b4a698ed5a016cc5c2373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.111340 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.111781 17964 raft_consensus.cc:2243] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.112499 17964 raft_consensus.cc:2272] T 4e4fed752c59430787a6456b056a9791 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.114253 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.114683 17964 raft_consensus.cc:2243] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.115341 17964 raft_consensus.cc:2272] T f8364a08fda04ddca37f7a62c780bf6b P ed3d8ccf509b4a698ed5a016cc5c2373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.117304 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.117849 17964 raft_consensus.cc:2243] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.118758 17964 raft_consensus.cc:2272] T 4e4a10888f634b928b16da286c94e1c3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.121008 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:52.121407 17964 raft_consensus.cc:2243] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.121750 17964 raft_consensus.cc:2272] T 081438f330e54faf854a05dda77dc8a3 P ed3d8ccf509b4a698ed5a016cc5c2373 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.135051 25873 consensus_peers.cc:597] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.139282 25799 consensus_peers.cc:597] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.150053 25799 consensus_peers.cc:597] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.173053 25799 consensus_peers.cc:597] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.179330 17964 connection.cc:466] server connection from 127.0.0.1:44616 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44616 (request call id 412) could send its response
W20260709 13:21:52.181304 25873 consensus_peers.cc:597] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.181762 25873 consensus_peers.cc:597] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.194020 17964 tablet_server.cc:196] TabletServer@127.17.139.1:43003 shutdown complete.
W20260709 13:21:52.242010 25799 consensus_peers.cc:597] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.246800 25873 consensus_peers.cc:597] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.257736 25873 consensus_peers.cc:597] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.260550 25799 consensus_peers.cc:597] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.276948 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
W20260709 13:21:52.286137 25946 consensus_peers.cc:597] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.290520 25872 consensus_peers.cc:597] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.316111 25947 consensus_peers.cc:597] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.325562 25799 consensus_peers.cc:597] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.326468 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:52.327215 17964 tablet_replica.cc:333] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.327891 17964 raft_consensus.cc:2243] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.328706 17964 raft_consensus.cc:2272] T c9adacf3baa64bbc9f77334887ac19bd P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.330652 17964 tablet_replica.cc:333] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.331212 17964 raft_consensus.cc:2243] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.331673 17964 raft_consensus.cc:2272] T e86e384892614e74903bbfff46ab5bab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.334056 17964 tablet_replica.cc:333] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.334787 17964 raft_consensus.cc:2243] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.335294 17964 raft_consensus.cc:2272] T 611842cf4d6647579e69a91305193c72 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.335850 25946 consensus_peers.cc:597] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.337278 17964 tablet_replica.cc:333] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.337934 17964 raft_consensus.cc:2243] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.338346 17964 raft_consensus.cc:2272] T 75b847d9971e4cc59c55d60bca9bd6fa P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.340273 17964 tablet_replica.cc:333] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.340816 17964 raft_consensus.cc:2243] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.341825 17964 raft_consensus.cc:2272] T 254b15472c834bf5bed1d6c0e209037f P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.344228 17964 tablet_replica.cc:333] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.344975 17964 raft_consensus.cc:2243] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.345907 17964 raft_consensus.cc:2272] T a8a0733adf424224946e6d7af7c0857f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.349653 17964 tablet_replica.cc:333] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.350481 17964 raft_consensus.cc:2243] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:21:52.350898 25872 consensus_peers.cc:597] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.351399 17964 raft_consensus.cc:2272] T 219a9df4cc90493a8b2d7ec008f83019 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.353776 17964 tablet_replica.cc:333] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.354530 17964 raft_consensus.cc:2243] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.355036 17964 raft_consensus.cc:2272] T 670569c4b0454f0e9605999e38e23e7f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.355098 25873 consensus_peers.cc:597] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.357610 17964 tablet_replica.cc:333] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.358361 17964 raft_consensus.cc:2243] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.358743 17964 raft_consensus.cc:2272] T c8a2398487364fe5b17151c707da3d38 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.360541 17964 tablet_replica.cc:333] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.361073 17964 raft_consensus.cc:2243] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.361919 17964 raft_consensus.cc:2272] T 7f981b3562f647568da5155558fdb832 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.363621 17964 tablet_replica.cc:333] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.364110 17964 raft_consensus.cc:2243] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.364782 17964 raft_consensus.cc:2272] T 6cf81e1b5def481d86abc1ca4750ff7e P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.372846 25947 consensus_peers.cc:597] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.366964 17964 tablet_replica.cc:333] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.410638 17964 raft_consensus.cc:2243] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.416270 17964 raft_consensus.cc:2272] T 4e4a10888f634b928b16da286c94e1c3 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.420573 25947 consensus_peers.cc:597] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.421904 17964 tablet_replica.cc:333] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
W20260709 13:21:52.422794 25946 consensus_peers.cc:597] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.423429 17964 raft_consensus.cc:2243] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.426132 17964 raft_consensus.cc:2272] T 481ec3c460694b6d83ec94f2b784a4d3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.431442 17964 tablet_replica.cc:333] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.436995 17964 raft_consensus.cc:2243] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.438089 17964 raft_consensus.cc:2272] T c4a6930862024730845f5f504c1e0116 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.443288 17964 tablet_replica.cc:333] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.445333 17964 raft_consensus.cc:2243] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.446290 17964 raft_consensus.cc:2272] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 07f41f48d6b44bbb8d23868f1366476c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.450628 17964 tablet_replica.cc:333] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.451800 17964 raft_consensus.cc:2243] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.452700 17964 raft_consensus.cc:2272] T b8eea0b353e94457bf93ed589f60eaa2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.455605 17964 tablet_replica.cc:333] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.456700 17964 raft_consensus.cc:2243] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.457468 17964 raft_consensus.cc:2272] T 40c147093b5240b8b481ac54e516aeab P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.460501 17964 tablet_replica.cc:333] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.461269 17964 raft_consensus.cc:2243] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.462393 17964 raft_consensus.cc:2272] T 2a5799d4780d40e9904c5edb4a579b03 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.466379 17964 tablet_replica.cc:333] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.467303 17964 raft_consensus.cc:2243] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.469296 17964 raft_consensus.cc:2272] T dc96524b1d7040a8b84b00484dc7aef9 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.474272 17964 tablet_replica.cc:333] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.475917 17964 raft_consensus.cc:2243] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:52.476056 25947 consensus_peers.cc:597] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.476774 17964 raft_consensus.cc:2272] T f7b7a29df0a84d00b36c4968d6162f09 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.480646 17964 tablet_replica.cc:333] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.481853 17964 raft_consensus.cc:2243] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.484328 17964 raft_consensus.cc:2272] T 8ca0442774474ae1b1ff15ebe55623e6 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.487812 17964 tablet_replica.cc:333] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.489764 17964 raft_consensus.cc:2243] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.490655 17964 raft_consensus.cc:2272] T 1d6ccd3ac7a54d1bb09a0561e78a565c P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.494915 17964 tablet_replica.cc:333] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.496145 17964 raft_consensus.cc:2243] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.498602 17964 raft_consensus.cc:2272] T 6de5011c14844d60875c562efc487b1f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.501009 25947 consensus_peers.cc:597] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 -> Peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Couldn't send request to peer ed3d8ccf509b4a698ed5a016cc5c2373. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.502640 17964 tablet_replica.cc:333] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.503808 17964 raft_consensus.cc:2243] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.504782 17964 raft_consensus.cc:2272] T 98535bc4fa014421a709e3c207ea43f0 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.508728 17964 tablet_replica.cc:333] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.509655 17964 raft_consensus.cc:2243] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.510591 17964 raft_consensus.cc:2272] T 2f7e69d55ce14023b50cedeb5feae2cf P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.514904 17964 tablet_replica.cc:333] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.515762 17964 raft_consensus.cc:2243] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.516526 17964 raft_consensus.cc:2272] T 771eedb34a9845bb876bb0217d55cb4f P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.520138 17964 tablet_replica.cc:333] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.521245 17964 raft_consensus.cc:2243] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.522187 17964 raft_consensus.cc:2272] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.526098 17964 tablet_replica.cc:333] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.527144 17964 raft_consensus.cc:2243] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.529282 17964 raft_consensus.cc:2272] T 586bf3736da64db09924ed1a59a2d4ba P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.533692 17964 tablet_replica.cc:333] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
W20260709 13:21:52.534063 25946 consensus_peers.cc:597] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.534463 17964 raft_consensus.cc:2243] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.535535 17964 raft_consensus.cc:2272] T d01f627682fd449e9ee01ba8a323ab4b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.539181 17964 tablet_replica.cc:333] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.540119 17964 raft_consensus.cc:2243] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.540953 17964 raft_consensus.cc:2272] T 113a9ca6eaed4ac3881ea23e2261267b P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.544144 17964 tablet_replica.cc:333] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.545020 17964 raft_consensus.cc:2243] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.547034 17964 raft_consensus.cc:2272] T 22d400a9f48b4625b8af26e86e19461d P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.550330 17964 tablet_replica.cc:333] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.551185 17964 raft_consensus.cc:2243] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.552587 17964 raft_consensus.cc:2272] T fdeb29833f3c4de88695f421ea891ece P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.556206 17964 tablet_replica.cc:333] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.557310 17964 raft_consensus.cc:2243] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.558180 17964 raft_consensus.cc:2272] T ebefea1f5b064445b792836db4d27b94 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.561264 25872 consensus_peers.cc:597] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.561637 17964 tablet_replica.cc:333] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.562541 17964 raft_consensus.cc:2243] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.563381 17964 raft_consensus.cc:2272] T e5739b15c8ac4954a459dbcb444924dd P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.567293 17964 tablet_replica.cc:333] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.568040 17964 raft_consensus.cc:2243] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.569940 17964 raft_consensus.cc:2272] T 298853b845e64b97bccea766389bcc3f P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.574385 17964 tablet_replica.cc:333] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.575482 17964 raft_consensus.cc:2243] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.576351 17964 raft_consensus.cc:2272] T 13463f4cd4314c158c50a0151f456a8b P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.579905 17964 tablet_replica.cc:333] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.580837 17964 raft_consensus.cc:2243] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.581766 17964 raft_consensus.cc:2272] T 90f919e905134e49be8c590c4ee5e3b2 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.585856 17964 tablet_replica.cc:333] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.586789 17964 raft_consensus.cc:2243] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:52.587425 25946 consensus_peers.cc:597] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.587720 17964 raft_consensus.cc:2272] T f8364a08fda04ddca37f7a62c780bf6b P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.589720 25872 consensus_peers.cc:597] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.592017 17964 tablet_replica.cc:333] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.593142 17964 raft_consensus.cc:2243] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.593998 17964 raft_consensus.cc:2272] T 4e4fed752c59430787a6456b056a9791 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.597955 17964 tablet_replica.cc:333] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.598804 17964 raft_consensus.cc:2243] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.599493 17964 raft_consensus.cc:2272] T 9cdf5467ff214d0290c6ef81639ed01a P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.603462 17964 tablet_replica.cc:333] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.604452 17964 raft_consensus.cc:2243] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.605372 17964 raft_consensus.cc:2272] T 97f6007c3cb04bd59b7caf8214c65927 P 07f41f48d6b44bbb8d23868f1366476c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.609472 17964 tablet_replica.cc:333] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.610481 17964 raft_consensus.cc:2243] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.611564 17964 raft_consensus.cc:2272] T 4816921c4c524ae7a5976325662d4c03 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.615427 17964 tablet_replica.cc:333] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.616179 17964 raft_consensus.cc:2243] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.616858 17964 raft_consensus.cc:2272] T d7def423740049449c29a407ce4a2855 P 07f41f48d6b44bbb8d23868f1366476c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.620471 17964 tablet_replica.cc:333] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c: stopping tablet replica
I20260709 13:21:52.621176 17964 raft_consensus.cc:2243] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.622470 17964 raft_consensus.cc:2272] T fb7de3cff2ff4888914ce16cee616fe3 P 07f41f48d6b44bbb8d23868f1366476c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.639952 25872 consensus_peers.cc:597] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.655920 25946 consensus_peers.cc:597] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.662683 25946 consensus_peers.cc:597] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.666242 25872 consensus_peers.cc:597] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.721763 25872 consensus_peers.cc:597] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.748004 25946 consensus_peers.cc:597] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.769461 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
W20260709 13:21:52.807828 25946 consensus_peers.cc:597] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.811056 25946 consensus_peers.cc:597] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:52.846230 25872 consensus_peers.cc:597] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 -> Peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Couldn't send request to peer 07f41f48d6b44bbb8d23868f1366476c. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:52.878991 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
I20260709 13:21:52.927347 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:52.928261 17964 tablet_replica.cc:333] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.929365 17964 raft_consensus.cc:2243] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.930167 17964 raft_consensus.cc:2272] T 2f7e69d55ce14023b50cedeb5feae2cf P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.933372 17964 tablet_replica.cc:333] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.934412 17964 raft_consensus.cc:2243] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.935541 17964 raft_consensus.cc:2272] T 049578b5413b48c796dc1da162f42a17 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.938032 17964 tablet_replica.cc:333] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.938740 17964 raft_consensus.cc:2243] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.939271 17964 raft_consensus.cc:2272] T a8a0733adf424224946e6d7af7c0857f P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.941715 17964 tablet_replica.cc:333] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.942298 17964 raft_consensus.cc:2243] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.943092 17964 raft_consensus.cc:2272] T bb0405f6455d423cbefdabe29f4ea09a P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.945211 17964 tablet_replica.cc:333] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.945748 17964 raft_consensus.cc:2243] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.946198 17964 raft_consensus.cc:2272] T 219a9df4cc90493a8b2d7ec008f83019 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.948066 17964 tablet_replica.cc:333] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.948583 17964 raft_consensus.cc:2243] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.949419 17964 raft_consensus.cc:2272] T 081438f330e54faf854a05dda77dc8a3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.951337 17964 tablet_replica.cc:333] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.951941 17964 raft_consensus.cc:2243] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.952486 17964 raft_consensus.cc:2272] T 611842cf4d6647579e69a91305193c72 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.954538 17964 tablet_replica.cc:333] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.955072 17964 raft_consensus.cc:2243] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.955560 17964 raft_consensus.cc:2272] T 254b15472c834bf5bed1d6c0e209037f P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.957731 17964 tablet_replica.cc:333] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.958604 17964 raft_consensus.cc:2243] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.959331 17964 raft_consensus.cc:2272] T 7f981b3562f647568da5155558fdb832 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.962131 17964 tablet_replica.cc:333] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.962916 17964 raft_consensus.cc:2243] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.963519 17964 raft_consensus.cc:2272] T 6cf81e1b5def481d86abc1ca4750ff7e P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.965816 17964 tablet_replica.cc:333] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.966585 17964 raft_consensus.cc:2243] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.967233 17964 raft_consensus.cc:2272] T 4e4a10888f634b928b16da286c94e1c3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.969209 17964 tablet_replica.cc:333] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.969805 17964 raft_consensus.cc:2243] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.970247 17964 raft_consensus.cc:2272] T b8eea0b353e94457bf93ed589f60eaa2 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.972457 17964 tablet_replica.cc:333] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.973119 17964 raft_consensus.cc:2243] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.973649 17964 raft_consensus.cc:2272] T 6b11e0680366494cbe324cb81aa88f6c P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.976058 17964 tablet_replica.cc:333] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.976814 17964 raft_consensus.cc:2243] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.977440 17964 raft_consensus.cc:2272] T 75c3a77378814f77b6d0614228a63ee7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.980391 17964 tablet_replica.cc:333] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.981187 17964 raft_consensus.cc:2243] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.981813 17964 raft_consensus.cc:2272] T 481ec3c460694b6d83ec94f2b784a4d3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.984432 17964 tablet_replica.cc:333] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.985150 17964 raft_consensus.cc:2243] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.985953 17964 raft_consensus.cc:2272] T d6a5b70f7ceb4599ae0da4cec23f7963 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.988206 17964 tablet_replica.cc:333] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.988796 17964 raft_consensus.cc:2243] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:52.989296 17964 raft_consensus.cc:2272] T c9adacf3baa64bbc9f77334887ac19bd P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.991096 17964 tablet_replica.cc:333] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.991588 17964 raft_consensus.cc:2243] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.992274 17964 raft_consensus.cc:2272] T 82e0689353df4c828d77cdd393901a86 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.994225 17964 tablet_replica.cc:333] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.994709 17964 raft_consensus.cc:2243] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.995419 17964 raft_consensus.cc:2272] T 440b1e80c1624e4c90ca0a9d1470da28 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:52.997460 17964 tablet_replica.cc:333] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:52.997905 17964 raft_consensus.cc:2243] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:52.998649 17964 raft_consensus.cc:2272] T d7def423740049449c29a407ce4a2855 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.001209 17964 tablet_replica.cc:333] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.001888 17964 raft_consensus.cc:2243] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.002951 17964 raft_consensus.cc:2272] T c4a6930862024730845f5f504c1e0116 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.006018 17964 tablet_replica.cc:333] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.006834 17964 raft_consensus.cc:2243] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.007488 17964 raft_consensus.cc:2272] T 668c03bad1284f0c81f6a7a445fce935 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.010185 17964 tablet_replica.cc:333] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.010733 17964 raft_consensus.cc:2243] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.011473 17964 raft_consensus.cc:2272] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P e0f5cbbd64e14739bd096bf5d7b85828 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.013419 17964 tablet_replica.cc:333] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.013931 17964 raft_consensus.cc:2243] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.014362 17964 raft_consensus.cc:2272] T fefde71331ca4e0a87cdf6dc7639b9b0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.016327 17964 tablet_replica.cc:333] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.016839 17964 raft_consensus.cc:2243] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.017613 17964 raft_consensus.cc:2272] T 1d6ccd3ac7a54d1bb09a0561e78a565c P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.019742 17964 tablet_replica.cc:333] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.020507 17964 raft_consensus.cc:2243] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.021076 17964 raft_consensus.cc:2272] T 8ca0442774474ae1b1ff15ebe55623e6 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.023531 17964 tablet_replica.cc:333] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.024071 17964 raft_consensus.cc:2243] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.024441 17964 raft_consensus.cc:2272] T 926bedb86c194b7787f058066b3abbb7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.026352 17964 tablet_replica.cc:333] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.026827 17964 raft_consensus.cc:2243] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.027225 17964 raft_consensus.cc:2272] T 2a5799d4780d40e9904c5edb4a579b03 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.029203 17964 tablet_replica.cc:333] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.029714 17964 raft_consensus.cc:2243] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.030146 17964 raft_consensus.cc:2272] T 7950a85af94b4e019cbd26c1d87687eb P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.031996 17964 tablet_replica.cc:333] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.032559 17964 raft_consensus.cc:2243] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.033354 17964 raft_consensus.cc:2272] T 9cdf5467ff214d0290c6ef81639ed01a P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.035312 17964 tablet_replica.cc:333] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.035825 17964 raft_consensus.cc:2243] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.036692 17964 raft_consensus.cc:2272] T 97f6007c3cb04bd59b7caf8214c65927 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.038585 17964 tablet_replica.cc:333] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.039098 17964 raft_consensus.cc:2243] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.039553 17964 raft_consensus.cc:2272] T dc96524b1d7040a8b84b00484dc7aef9 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.041527 17964 tablet_replica.cc:333] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.042037 17964 raft_consensus.cc:2243] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.042649 17964 raft_consensus.cc:2272] T ebefea1f5b064445b792836db4d27b94 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.045048 17964 tablet_replica.cc:333] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.045758 17964 raft_consensus.cc:2243] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.046273 17964 raft_consensus.cc:2272] T fdeb29833f3c4de88695f421ea891ece P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.048559 17964 tablet_replica.cc:333] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.049129 17964 raft_consensus.cc:2243] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.049715 17964 raft_consensus.cc:2272] T d83abde02ee5491eba5ed2e17bed1602 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.052189 17964 tablet_replica.cc:333] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.052827 17964 raft_consensus.cc:2243] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.053287 17964 raft_consensus.cc:2272] T 298853b845e64b97bccea766389bcc3f P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.055051 17964 tablet_replica.cc:333] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.055536 17964 raft_consensus.cc:2243] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.056198 17964 raft_consensus.cc:2272] T 88a3dd40d38541089c7e684f78dc69b3 P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.058605 17964 tablet_replica.cc:333] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.059170 17964 raft_consensus.cc:2243] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.059762 17964 raft_consensus.cc:2272] T 586bf3736da64db09924ed1a59a2d4ba P e0f5cbbd64e14739bd096bf5d7b85828 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.062335 17964 tablet_replica.cc:333] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.063104 17964 raft_consensus.cc:2243] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.063875 17964 raft_consensus.cc:2272] T ed9bb5fa0d5842dfb3508b23e0a4a3a7 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.065764 17964 tablet_replica.cc:333] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.066262 17964 raft_consensus.cc:2243] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.067260 17964 raft_consensus.cc:2272] T d01f627682fd449e9ee01ba8a323ab4b P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.069362 17964 tablet_replica.cc:333] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.069820 17964 raft_consensus.cc:2243] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.070182 17964 raft_consensus.cc:2272] T 98535bc4fa014421a709e3c207ea43f0 P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.072012 17964 tablet_replica.cc:333] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.072430 17964 raft_consensus.cc:2243] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.072789 17964 raft_consensus.cc:2272] T f7b7a29df0a84d00b36c4968d6162f09 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.074507 17964 tablet_replica.cc:333] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.074934 17964 raft_consensus.cc:2243] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.075359 17964 raft_consensus.cc:2272] T 5cd8f222eaf04b4c8ab0dfc37a470592 P e0f5cbbd64e14739bd096bf5d7b85828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.077323 17964 tablet_replica.cc:333] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828: stopping tablet replica
I20260709 13:21:53.077776 17964 raft_consensus.cc:2243] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.078192 17964 raft_consensus.cc:2272] T 22d400a9f48b4625b8af26e86e19461d P e0f5cbbd64e14739bd096bf5d7b85828 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:53.112370 25945 consensus_peers.cc:597] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:53.115540 27126 raft_consensus.cc:493] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:53.116181 27126 raft_consensus.cc:515] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:53.118348 27126 leader_election.cc:290] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:53.122471 25946 leader_election.cc:336] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111)
W20260709 13:21:53.122952 25947 leader_election.cc:336] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:53.123330 25947 leader_election.cc:304] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:53.123884 27126 raft_consensus.cc:2749] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:53.141759 27126 raft_consensus.cc:493] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:53.142215 27126 raft_consensus.cc:515] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0f5cbbd64e14739bd096bf5d7b85828" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 37623 } } peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } }
I20260709 13:21:53.143755 27126 leader_election.cc:290] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623), ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003)
W20260709 13:21:53.147212 25945 leader_election.cc:336] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Network error: Client connection negotiation failed: client connection to 127.17.139.3:37623: connect: Connection refused (error 111)
W20260709 13:21:53.147598 25947 leader_election.cc:336] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:53.147893 25947 leader_election.cc:304] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: e0f5cbbd64e14739bd096bf5d7b85828, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:53.148371 27126 raft_consensus.cc:2749] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:53.155467 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
W20260709 13:21:53.160907 25945 consensus_peers.cc:597] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:37623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:53.171475 27126 raft_consensus.cc:493] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:53.172032 27126 raft_consensus.cc:515] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:53.174000 27126 leader_election.cc:290] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:53.179198 25946 leader_election.cc:336] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111)
W20260709 13:21:53.180212 25947 leader_election.cc:336] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Network error: Client connection negotiation failed: client connection to 127.17.139.1:43003: connect: Connection refused (error 111)
I20260709 13:21:53.180680 25947 leader_election.cc:304] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
I20260709 13:21:53.181926 27126 raft_consensus.cc:2749] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:53.185365 25945 consensus_peers.cc:597] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:37623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:53.201134 25945 consensus_peers.cc:597] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:37623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:53.201550 25945 consensus_peers.cc:597] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:37623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:53.224196 27126 raft_consensus.cc:493] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:53.224849 27126 raft_consensus.cc:515] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:53.226987 27126 leader_election.cc:290] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
W20260709 13:21:53.230861 25946 leader_election.cc:336] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111)
I20260709 13:21:53.234593 17964 tablet_server.cc:179] TabletServer@127.17.139.4:0 shutting down...
W20260709 13:21:53.234647 25945 consensus_peers.cc:597] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:37623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:53.272047 25945 consensus_peers.cc:597] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 -> Peer e0f5cbbd64e14739bd096bf5d7b85828 (127.17.139.3:37623): Couldn't send request to peer e0f5cbbd64e14739bd096bf5d7b85828. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.3:37623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:53.279192 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:53.280356 17964 tablet_replica.cc:333] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.281437 17964 raft_consensus.cc:2243] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.282431 17964 raft_consensus.cc:2272] T 5cd8f222eaf04b4c8ab0dfc37a470592 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.284632 17964 tablet_replica.cc:333] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.285279 17964 raft_consensus.cc:2243] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.285748 17964 raft_consensus.cc:2272] T 6cf81e1b5def481d86abc1ca4750ff7e P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.287685 17964 tablet_replica.cc:333] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.288262 17964 raft_consensus.cc:2243] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.289155 17964 raft_consensus.cc:2272] T 611842cf4d6647579e69a91305193c72 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.291143 17964 tablet_replica.cc:333] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.291706 17964 raft_consensus.cc:2243] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.292449 17964 raft_consensus.cc:2272] T 75b847d9971e4cc59c55d60bca9bd6fa P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.294291 17964 tablet_replica.cc:333] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.294860 17964 raft_consensus.cc:2243] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.295301 17964 raft_consensus.cc:2272] T 049578b5413b48c796dc1da162f42a17 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.297289 17964 tablet_replica.cc:333] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.297951 17964 raft_consensus.cc:2243] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.298424 17964 raft_consensus.cc:2272] T 081438f330e54faf854a05dda77dc8a3 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.300776 17964 tablet_replica.cc:333] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.301340 17964 raft_consensus.cc:2243] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.301838 17964 raft_consensus.cc:2272] T 6b11e0680366494cbe324cb81aa88f6c P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.303584 17964 tablet_replica.cc:333] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.304137 17964 raft_consensus.cc:2243] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.304543 17964 raft_consensus.cc:2272] T e86e384892614e74903bbfff46ab5bab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.306464 17964 tablet_replica.cc:333] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.306981 17964 raft_consensus.cc:2243] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.307397 17964 raft_consensus.cc:2272] T 586bf3736da64db09924ed1a59a2d4ba P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.309566 17964 tablet_replica.cc:333] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.310101 17964 raft_consensus.cc:2243] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.310572 17964 raft_consensus.cc:2272] T bb0405f6455d423cbefdabe29f4ea09a P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.313027 17964 tablet_replica.cc:333] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.313606 17964 raft_consensus.cc:2243] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.314082 17964 raft_consensus.cc:2272] T 219a9df4cc90493a8b2d7ec008f83019 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.316110 17964 tablet_replica.cc:333] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.316675 17964 raft_consensus.cc:2243] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.317135 17964 raft_consensus.cc:2272] T 7f981b3562f647568da5155558fdb832 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.319044 17964 tablet_replica.cc:333] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.319595 17964 raft_consensus.cc:2243] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.320012 17964 raft_consensus.cc:2272] T 670569c4b0454f0e9605999e38e23e7f P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.321832 17964 tablet_replica.cc:333] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.322355 17964 raft_consensus.cc:2243] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.323082 17964 raft_consensus.cc:2272] T c8a2398487364fe5b17151c707da3d38 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.324988 17964 tablet_replica.cc:333] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.325485 17964 raft_consensus.cc:2243] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.326318 17964 raft_consensus.cc:2272] T e5739b15c8ac4954a459dbcb444924dd P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.328562 17964 tablet_replica.cc:333] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.329152 17964 raft_consensus.cc:2243] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.329573 17964 raft_consensus.cc:2272] T 88a3dd40d38541089c7e684f78dc69b3 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.331326 17964 tablet_replica.cc:333] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.331817 17964 raft_consensus.cc:2243] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.332233 17964 raft_consensus.cc:2272] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.334076 17964 tablet_replica.cc:333] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.334590 17964 raft_consensus.cc:2243] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.335323 17964 raft_consensus.cc:2272] T 13463f4cd4314c158c50a0151f456a8b P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.337239 17964 tablet_replica.cc:333] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.337730 17964 raft_consensus.cc:2243] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.338195 17964 raft_consensus.cc:2272] T dc96524b1d7040a8b84b00484dc7aef9 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.340166 17964 tablet_replica.cc:333] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.340691 17964 raft_consensus.cc:2243] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.341172 17964 raft_consensus.cc:2272] T 75c3a77378814f77b6d0614228a63ee7 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.342893 17964 tablet_replica.cc:333] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.343415 17964 raft_consensus.cc:2243] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.343859 17964 raft_consensus.cc:2272] T 481ec3c460694b6d83ec94f2b784a4d3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.345846 17964 tablet_replica.cc:333] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.346347 17964 raft_consensus.cc:2243] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.347041 17964 raft_consensus.cc:2272] T 113a9ca6eaed4ac3881ea23e2261267b P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.348838 17964 tablet_replica.cc:333] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.349385 17964 raft_consensus.cc:2243] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.349787 17964 raft_consensus.cc:2272] T fefde71331ca4e0a87cdf6dc7639b9b0 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.351552 17964 tablet_replica.cc:333] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.352077 17964 raft_consensus.cc:2243] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.352803 17964 raft_consensus.cc:2272] T 668c03bad1284f0c81f6a7a445fce935 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.354584 17964 tablet_replica.cc:333] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.355082 17964 raft_consensus.cc:2243] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.355518 17964 raft_consensus.cc:2272] T 5d86df3820ac4e96b1c6bcbe7c9c9593 P 33e3240923e54438a22da49413055ab3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.357451 17964 tablet_replica.cc:333] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.357986 17964 raft_consensus.cc:2243] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.358413 17964 raft_consensus.cc:2272] T 40c147093b5240b8b481ac54e516aeab P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.360096 17964 tablet_replica.cc:333] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.360584 17964 raft_consensus.cc:2243] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.361394 17964 raft_consensus.cc:2272] T 926bedb86c194b7787f058066b3abbb7 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.363138 17964 tablet_replica.cc:333] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.363647 17964 raft_consensus.cc:2243] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.364341 17964 raft_consensus.cc:2272] T 2a5799d4780d40e9904c5edb4a579b03 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.366142 17964 tablet_replica.cc:333] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.366686 17964 raft_consensus.cc:2243] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.366677 27126 raft_consensus.cc:493] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed3d8ccf509b4a698ed5a016cc5c2373)
I20260709 13:21:53.367228 17964 raft_consensus.cc:2272] T 4816921c4c524ae7a5976325662d4c03 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.367306 27126 raft_consensus.cc:515] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e3240923e54438a22da49413055ab3" member_type: VOTER last_known_addr { host: "127.17.139.4" port: 38321 } } peers { permanent_uuid: "ed3d8ccf509b4a698ed5a016cc5c2373" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 43003 } } peers { permanent_uuid: "07f41f48d6b44bbb8d23868f1366476c" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 45007 } }
I20260709 13:21:53.369280 27126 leader_election.cc:290] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003), 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007)
I20260709 13:21:53.369427 17964 tablet_replica.cc:333] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.370087 17964 raft_consensus.cc:2243] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.370537 17964 raft_consensus.cc:2272] T d7def423740049449c29a407ce4a2855 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.372825 17964 tablet_replica.cc:333] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
W20260709 13:21:53.372996 25946 leader_election.cc:336] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 07f41f48d6b44bbb8d23868f1366476c (127.17.139.2:45007): Network error: Client connection negotiation failed: client connection to 127.17.139.2:45007: connect: Connection refused (error 111)
I20260709 13:21:53.373441 17964 raft_consensus.cc:2243] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.373886 17964 raft_consensus.cc:2272] T fb7de3cff2ff4888914ce16cee616fe3 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.375779 17964 tablet_replica.cc:333] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.376291 17964 raft_consensus.cc:2243] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.376698 17964 raft_consensus.cc:2272] T f8364a08fda04ddca37f7a62c780bf6b P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.378549 17964 tablet_replica.cc:333] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.379050 17964 raft_consensus.cc:2243] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.379492 17964 raft_consensus.cc:2272] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.381425 17964 tablet_replica.cc:333] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.381927 17964 raft_consensus.cc:2243] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.382335 17964 raft_consensus.cc:2272] T 9cdf5467ff214d0290c6ef81639ed01a P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.384133 17964 tablet_replica.cc:333] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.384642 17964 raft_consensus.cc:2243] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.385092 17964 raft_consensus.cc:2272] T 97f6007c3cb04bd59b7caf8214c65927 P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.386852 17964 tablet_replica.cc:333] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.387332 17964 raft_consensus.cc:2243] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.388022 17964 raft_consensus.cc:2272] T d83abde02ee5491eba5ed2e17bed1602 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.389781 17964 tablet_replica.cc:333] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.390275 17964 raft_consensus.cc:2243] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.391004 17964 raft_consensus.cc:2272] T 2f7e69d55ce14023b50cedeb5feae2cf P 33e3240923e54438a22da49413055ab3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.392714 17964 tablet_replica.cc:333] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.393224 17964 raft_consensus.cc:2243] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.393954 17964 raft_consensus.cc:2272] T 771eedb34a9845bb876bb0217d55cb4f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.395735 17964 tablet_replica.cc:333] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.396222 17964 raft_consensus.cc:2243] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.396622 17964 raft_consensus.cc:2272] T d6a5b70f7ceb4599ae0da4cec23f7963 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.398732 17964 tablet_replica.cc:333] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.399225 17964 raft_consensus.cc:2243] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.399646 17964 raft_consensus.cc:2272] T 440b1e80c1624e4c90ca0a9d1470da28 P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.401448 17964 tablet_replica.cc:333] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.401918 17964 raft_consensus.cc:2243] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.402302 17964 raft_consensus.cc:2272] T 82e0689353df4c828d77cdd393901a86 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.404021 17964 tablet_replica.cc:333] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.404477 17964 raft_consensus.cc:2243] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.404906 17964 raft_consensus.cc:2272] T 7950a85af94b4e019cbd26c1d87687eb P 33e3240923e54438a22da49413055ab3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.406630 17964 tablet_replica.cc:333] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.407095 17964 raft_consensus.cc:2243] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:53.407531 17964 raft_consensus.cc:2272] T 6de5011c14844d60875c562efc487b1f P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.409471 17964 tablet_replica.cc:333] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3: stopping tablet replica
I20260709 13:21:53.409890 17964 raft_consensus.cc:2243] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.410589 17964 raft_consensus.cc:2272] T f7b7a29df0a84d00b36c4968d6162f09 P 33e3240923e54438a22da49413055ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:53.767861 25944 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:53.822598 25947 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:54.213698 25947 leader_election.cc:336] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:21:54.214141 25947 leader_election.cc:304] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:54.214682 25947 raft_consensus.cc:2686] T 4e4fed752c59430787a6456b056a9791 P 33e3240923e54438a22da49413055ab3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:21:54.218063 17964 leader_election.cc:336] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ed3d8ccf509b4a698ed5a016cc5c2373 (127.17.139.1:43003): Aborted: reactor is shutting down (error 108)
I20260709 13:21:54.218374 17964 leader_election.cc:304] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33e3240923e54438a22da49413055ab3; no voters: 07f41f48d6b44bbb8d23868f1366476c, ed3d8ccf509b4a698ed5a016cc5c2373
W20260709 13:21:54.218755 17964 raft_consensus.cc:2686] T 90f919e905134e49be8c590c4ee5e3b2 P 33e3240923e54438a22da49413055ab3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:54.234030 17964 tablet_server.cc:196] TabletServer@127.17.139.4:0 shutdown complete.
I20260709 13:21:54.300943 17964 master.cc:562] Master@127.17.139.62:35925 shutting down...
I20260709 13:21:54.326253 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:54.326867 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:54.327224 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P dcfa0ff2e13d4806bb2562e5b52590a5: stopping tablet replica
I20260709 13:21:54.399020 17964 master.cc:584] Master@127.17.139.62:35925 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39588 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:21:54.489996 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:43831
I20260709 13:21:54.491153 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.497049 27134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.497124 27135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.497882 27137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.498421 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:54.499475 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:54.499652 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.499765 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603314499754 us; error 0 us; skew 500 ppm
I20260709 13:21:54.500263 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.502732 17964 webserver.cc:533] Webserver started at http://127.17.139.62:44049/ using document root <none> and password file <none>
I20260709 13:21:54.503165 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.503312 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.503520 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.505172 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "eed9ef444e5141a387606f4ceac0281a"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.509382 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:54.512622 27142 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.513341 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:54.513615 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "eed9ef444e5141a387606f4ceac0281a"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.513891 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.537441 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.538627 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.575829 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:43831
I20260709 13:21:54.575963 27193 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:43831 every 8 connection(s)
I20260709 13:21:54.579756 27194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.589913 27194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a: Bootstrap starting.
I20260709 13:21:54.594653 27194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.598754 27194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a: No bootstrap required, opened a new log
I20260709 13:21:54.600900 27194 raft_consensus.cc:359] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed9ef444e5141a387606f4ceac0281a" member_type: VOTER }
I20260709 13:21:54.601287 27194 raft_consensus.cc:385] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.601514 27194 raft_consensus.cc:740] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eed9ef444e5141a387606f4ceac0281a, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.602144 27194 consensus_queue.cc:260] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed9ef444e5141a387606f4ceac0281a" member_type: VOTER }
I20260709 13:21:54.602602 27194 raft_consensus.cc:399] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:54.602799 27194 raft_consensus.cc:493] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:54.603097 27194 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.607241 27194 raft_consensus.cc:515] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed9ef444e5141a387606f4ceac0281a" member_type: VOTER }
I20260709 13:21:54.607722 27194 leader_election.cc:304] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eed9ef444e5141a387606f4ceac0281a; no voters: 
I20260709 13:21:54.608798 27194 leader_election.cc:290] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:54.609237 27197 raft_consensus.cc:2804] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.610615 27197 raft_consensus.cc:697] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 1 LEADER]: Becoming Leader. State: Replica: eed9ef444e5141a387606f4ceac0281a, State: Running, Role: LEADER
I20260709 13:21:54.611358 27197 consensus_queue.cc:237] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed9ef444e5141a387606f4ceac0281a" member_type: VOTER }
I20260709 13:21:54.611783 27194 sys_catalog.cc:565] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:54.617151 27199 sys_catalog.cc:455] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [sys.catalog]: SysCatalogTable state changed. Reason: New leader eed9ef444e5141a387606f4ceac0281a. Latest consensus state: current_term: 1 leader_uuid: "eed9ef444e5141a387606f4ceac0281a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed9ef444e5141a387606f4ceac0281a" member_type: VOTER } }
I20260709 13:21:54.617611 27199 sys_catalog.cc:458] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:54.618440 27198 sys_catalog.cc:455] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eed9ef444e5141a387606f4ceac0281a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eed9ef444e5141a387606f4ceac0281a" member_type: VOTER } }
I20260709 13:21:54.619191 27198 sys_catalog.cc:458] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:54.619410 27204 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:54.625492 27204 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:54.627728 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:54.634622 27204 catalog_manager.cc:1383] Generated new cluster ID: 827e648aa0834f0ca1443e4380e87dd5
I20260709 13:21:54.634903 27204 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:54.655597 27204 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:54.656803 27204 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:54.672446 27204 catalog_manager.cc:6070] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a: Generated new TSK 0
I20260709 13:21:54.673059 27204 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:54.694012 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.699892 27215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.701382 27216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.705086 27218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.705415 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:54.706549 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:54.706739 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.706861 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603314706850 us; error 0 us; skew 500 ppm
I20260709 13:21:54.707320 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.709554 17964 webserver.cc:533] Webserver started at http://127.17.139.1:38557/ using document root <none> and password file <none>
I20260709 13:21:54.709990 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.710150 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.710358 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.711432 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.715792 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:21:54.718971 27223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.719712 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:21:54.720007 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.720288 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.737659 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.738837 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.740272 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:54.742537 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:54.742712 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.743003 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:54.743192 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.782588 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:37815
I20260709 13:21:54.782703 27285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:37815 every 8 connection(s)
I20260709 13:21:54.787268 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.795328 27290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.797524 27291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.799779 17964 server_base.cc:1061] running on GCE node
W20260709 13:21:54.800040 27293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.800664 27286 heartbeater.cc:344] Connected to a master server at 127.17.139.62:43831
I20260709 13:21:54.801168 27286 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:54.801367 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:54.801648 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.801857 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603314801837 us; error 0 us; skew 500 ppm
I20260709 13:21:54.802059 27286 heartbeater.cc:507] Master 127.17.139.62:43831 requested a full tablet report, sending...
I20260709 13:21:54.802654 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.804375 27159 ts_manager.cc:194] Registered new tserver with Master: d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815)
I20260709 13:21:54.805761 17964 webserver.cc:533] Webserver started at http://127.17.139.2:39515/ using document root <none> and password file <none>
I20260709 13:21:54.806304 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.806502 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.806522 27159 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33516
I20260709 13:21:54.806795 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.808204 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "4e9763d36e1645168e732b1e4cb1591b"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.812556 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:54.816227 27298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.817097 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:54.817395 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "4e9763d36e1645168e732b1e4cb1591b"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.817703 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.848407 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.849696 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.851183 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:54.853375 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:54.853595 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.853837 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:54.854007 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.893633 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:43765
I20260709 13:21:54.893736 27360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:43765 every 8 connection(s)
I20260709 13:21:54.898497 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.905597 27364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.907810 27365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.909423 27367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.910564 17964 server_base.cc:1061] running on GCE node
I20260709 13:21:54.911459 27361 heartbeater.cc:344] Connected to a master server at 127.17.139.62:43831
I20260709 13:21:54.911538 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:54.912042 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.912112 27361 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:54.912335 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603314912314 us; error 0 us; skew 500 ppm
I20260709 13:21:54.913089 27361 heartbeater.cc:507] Master 127.17.139.62:43831 requested a full tablet report, sending...
I20260709 13:21:54.913192 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.915601 27159 ts_manager.cc:194] Registered new tserver with Master: 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:54.915966 17964 webserver.cc:533] Webserver started at http://127.17.139.3:46143/ using document root <none> and password file <none>
I20260709 13:21:54.916625 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.916863 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.917224 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.917460 27159 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33530
I20260709 13:21:54.918767 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "99906955df34429dbed30d665ee2e9cb"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.923936 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:54.927246 27372 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.927979 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:54.928236 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "99906955df34429dbed30d665ee2e9cb"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:21:54.928462 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.949764 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.950896 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.952243 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:54.954458 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:54.954628 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.954933 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:54.955101 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.994530 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:44849
I20260709 13:21:54.994637 27434 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:44849 every 8 connection(s)
I20260709 13:21:55.008162 27435 heartbeater.cc:344] Connected to a master server at 127.17.139.62:43831
I20260709 13:21:55.008584 27435 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:55.009302 27435 heartbeater.cc:507] Master 127.17.139.62:43831 requested a full tablet report, sending...
I20260709 13:21:55.011224 27159 ts_manager.cc:194] Registered new tserver with Master: 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.011348 17964 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013581147s
I20260709 13:21:55.013070 27159 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33542
I20260709 13:21:55.035835 27159 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33556:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:55.038702 27159 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:55.106583 27399 tablet_service.cc:1511] Processing CreateTablet for tablet e0b03fee604e40cb89bd0098320b27e0 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:55.108199 27399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b03fee604e40cb89bd0098320b27e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.110561 27400 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7d129dc4ad4cfe8384d2a92f4911fc (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:55.112011 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7d129dc4ad4cfe8384d2a92f4911fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.114281 27398 tablet_service.cc:1511] Processing CreateTablet for tablet a3ac2bf95f8a48639b3bf2ffadb788b2 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:55.115725 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ac2bf95f8a48639b3bf2ffadb788b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.115768 27326 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7d129dc4ad4cfe8384d2a92f4911fc (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:55.118117 27325 tablet_service.cc:1511] Processing CreateTablet for tablet e0b03fee604e40cb89bd0098320b27e0 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:55.121039 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b03fee604e40cb89bd0098320b27e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.121524 27324 tablet_service.cc:1511] Processing CreateTablet for tablet a3ac2bf95f8a48639b3bf2ffadb788b2 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:55.122861 27324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ac2bf95f8a48639b3bf2ffadb788b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.122607 27397 tablet_service.cc:1511] Processing CreateTablet for tablet 61eb2606188c47d7a0124c771dbea4fb (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:55.124008 27397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61eb2606188c47d7a0124c771dbea4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.128597 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7d129dc4ad4cfe8384d2a92f4911fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.130044 27323 tablet_service.cc:1511] Processing CreateTablet for tablet 61eb2606188c47d7a0124c771dbea4fb (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:55.131371 27323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61eb2606188c47d7a0124c771dbea4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.146456 27251 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7d129dc4ad4cfe8384d2a92f4911fc (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:55.148367 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7d129dc4ad4cfe8384d2a92f4911fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.151935 27250 tablet_service.cc:1511] Processing CreateTablet for tablet e0b03fee604e40cb89bd0098320b27e0 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:55.152586 27450 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.154103 27249 tablet_service.cc:1511] Processing CreateTablet for tablet a3ac2bf95f8a48639b3bf2ffadb788b2 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:55.155593 27322 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5af5201409428eb3bf5bcec1465e04 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:55.156038 27248 tablet_service.cc:1511] Processing CreateTablet for tablet 61eb2606188c47d7a0124c771dbea4fb (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:55.157020 27322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5af5201409428eb3bf5bcec1465e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.158097 27247 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5af5201409428eb3bf5bcec1465e04 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:55.159416 27250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b03fee604e40cb89bd0098320b27e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.159900 27450 tablet_bootstrap.cc:654] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.162801 27396 tablet_service.cc:1511] Processing CreateTablet for tablet 0c5af5201409428eb3bf5bcec1465e04 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:55.164206 27396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5af5201409428eb3bf5bcec1465e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.163970 27246 tablet_service.cc:1511] Processing CreateTablet for tablet 718aa70f7e764d01a3c2b444664104db (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:55.165467 27247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5af5201409428eb3bf5bcec1465e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.169430 27249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ac2bf95f8a48639b3bf2ffadb788b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.172199 27246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718aa70f7e764d01a3c2b444664104db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.172348 27321 tablet_service.cc:1511] Processing CreateTablet for tablet 718aa70f7e764d01a3c2b444664104db (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:55.173889 27321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718aa70f7e764d01a3c2b444664104db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.173779 27395 tablet_service.cc:1511] Processing CreateTablet for tablet 718aa70f7e764d01a3c2b444664104db (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:55.175204 27395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718aa70f7e764d01a3c2b444664104db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.177444 27248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61eb2606188c47d7a0124c771dbea4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.182315 27245 tablet_service.cc:1511] Processing CreateTablet for tablet c62186bab4784e5c8e31397a2e403e31 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:55.183173 27320 tablet_service.cc:1511] Processing CreateTablet for tablet c62186bab4784e5c8e31397a2e403e31 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:55.183663 27245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62186bab4784e5c8e31397a2e403e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.184521 27320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62186bab4784e5c8e31397a2e403e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.186581 27244 tablet_service.cc:1511] Processing CreateTablet for tablet b9c6c7bec17c40068ea6b83b47c1ee2e (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:55.193210 27244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c6c7bec17c40068ea6b83b47c1ee2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.193836 27394 tablet_service.cc:1511] Processing CreateTablet for tablet b9c6c7bec17c40068ea6b83b47c1ee2e (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:55.194630 27400 tablet_service.cc:1511] Processing CreateTablet for tablet c62186bab4784e5c8e31397a2e403e31 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:55.195187 27394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c6c7bec17c40068ea6b83b47c1ee2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.195971 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c62186bab4784e5c8e31397a2e403e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.205914 27325 tablet_service.cc:1511] Processing CreateTablet for tablet b9c6c7bec17c40068ea6b83b47c1ee2e (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:55.213187 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c6c7bec17c40068ea6b83b47c1ee2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.214103 27451 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.218742 27243 tablet_service.cc:1511] Processing CreateTablet for tablet ea6522b4a6c542579edb0d25b08c2605 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:55.220197 27243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6522b4a6c542579edb0d25b08c2605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.223824 27326 tablet_service.cc:1511] Processing CreateTablet for tablet ea6522b4a6c542579edb0d25b08c2605 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:55.227277 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6522b4a6c542579edb0d25b08c2605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.225723 27396 tablet_service.cc:1511] Processing CreateTablet for tablet ea6522b4a6c542579edb0d25b08c2605 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:55.229874 27242 tablet_service.cc:1511] Processing CreateTablet for tablet 5388e2923ef3472a8fc7abaac2d505d0 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:55.231220 27396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6522b4a6c542579edb0d25b08c2605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.231348 27242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5388e2923ef3472a8fc7abaac2d505d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.231953 27324 tablet_service.cc:1511] Processing CreateTablet for tablet 5388e2923ef3472a8fc7abaac2d505d0 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:55.233196 27324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5388e2923ef3472a8fc7abaac2d505d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.239081 27451 tablet_bootstrap.cc:654] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.253072 27400 tablet_service.cc:1511] Processing CreateTablet for tablet 5388e2923ef3472a8fc7abaac2d505d0 (DEFAULT_TABLE table=test-workload [id=c738bb4dc7804a63be93d7db2f9cd803]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:55.254348 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5388e2923ef3472a8fc7abaac2d505d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:55.274904 27451 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.275458 27451 ts_tablet_manager.cc:1403] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:21:55.290038 27451 raft_consensus.cc:359] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.290774 27451 raft_consensus.cc:385] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.291059 27451 raft_consensus.cc:740] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.291970 27451 consensus_queue.cc:260] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.303366 27454 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.306761 27361 heartbeater.cc:499] Master 127.17.139.62:43831 was elected leader, sending a full tablet report...
I20260709 13:21:55.311177 27451 ts_tablet_manager.cc:1434] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.006s
I20260709 13:21:55.312794 27451 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.314684 27454 tablet_bootstrap.cc:654] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.318583 27450 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.319149 27450 ts_tablet_manager.cc:1403] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.167s	user 0.028s	sys 0.000s
I20260709 13:21:55.321015 27451 tablet_bootstrap.cc:654] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.322408 27450 raft_consensus.cc:359] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.323294 27450 raft_consensus.cc:385] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.323630 27450 raft_consensus.cc:740] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.324648 27450 consensus_queue.cc:260] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.332724 27451 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.333312 27435 heartbeater.cc:499] Master 127.17.139.62:43831 was elected leader, sending a full tablet report...
I20260709 13:21:55.333336 27451 ts_tablet_manager.cc:1403] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 13:21:55.333513 27450 ts_tablet_manager.cc:1434] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 13:21:55.334190 27454 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:55.334658 27454 ts_tablet_manager.cc:1403] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.004s
I20260709 13:21:55.334970 27450 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.336831 27451 raft_consensus.cc:359] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.337627 27451 raft_consensus.cc:385] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.337446 27454 raft_consensus.cc:359] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.338028 27451 raft_consensus.cc:740] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.338279 27454 raft_consensus.cc:385] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.338667 27454 raft_consensus.cc:740] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.339120 27451 consensus_queue.cc:260] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.339444 27454 consensus_queue.cc:260] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.341986 27450 tablet_bootstrap.cc:654] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.342875 27451 ts_tablet_manager.cc:1434] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:21:55.343957 27451 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.350399 27451 tablet_bootstrap.cc:654] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.375361 27286 heartbeater.cc:499] Master 127.17.139.62:43831 was elected leader, sending a full tablet report...
I20260709 13:21:55.376560 27454 ts_tablet_manager.cc:1434] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.042s	user 0.019s	sys 0.023s
I20260709 13:21:55.377640 27454 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.378173 27450 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.378233 27451 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.378859 27450 ts_tablet_manager.cc:1403] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.031s
I20260709 13:21:55.378890 27451 ts_tablet_manager.cc:1403] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.015s
I20260709 13:21:55.382272 27450 raft_consensus.cc:359] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.382463 27451 raft_consensus.cc:359] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.383071 27450 raft_consensus.cc:385] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.383247 27451 raft_consensus.cc:385] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.383423 27450 raft_consensus.cc:740] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.383663 27451 raft_consensus.cc:740] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.384793 27454 tablet_bootstrap.cc:654] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.384387 27450 consensus_queue.cc:260] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.384624 27451 consensus_queue.cc:260] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.386763 27450 ts_tablet_manager.cc:1434] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:21:55.387738 27450 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.390991 27451 ts_tablet_manager.cc:1434] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:21:55.392158 27451 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.394037 27450 tablet_bootstrap.cc:654] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:55.397876 27362 tablet.cc:2406] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:55.400892 27451 tablet_bootstrap.cc:654] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.406649 27450 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.407123 27450 ts_tablet_manager.cc:1403] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:21:55.410454 27451 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.410063 27450 raft_consensus.cc:359] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.411100 27451 ts_tablet_manager.cc:1403] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.006s
I20260709 13:21:55.411314 27450 raft_consensus.cc:385] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.411628 27450 raft_consensus.cc:740] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.412528 27450 consensus_queue.cc:260] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.414024 27451 raft_consensus.cc:359] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.414760 27451 raft_consensus.cc:385] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.415048 27451 raft_consensus.cc:740] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.416059 27451 consensus_queue.cc:260] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.418690 27450 ts_tablet_manager.cc:1434] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:55.419829 27450 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.421027 27451 ts_tablet_manager.cc:1434] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:55.422125 27451 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.426728 27450 tablet_bootstrap.cc:654] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.428357 27451 tablet_bootstrap.cc:654] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.433077 27455 raft_consensus.cc:493] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.433769 27455 raft_consensus.cc:515] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.442180 27455 leader_election.cc:290] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.450637 27454 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:55.451332 27454 ts_tablet_manager.cc:1403] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.045s
I20260709 13:21:55.454330 27454 raft_consensus.cc:359] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.455098 27454 raft_consensus.cc:385] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.455469 27454 raft_consensus.cc:740] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.456355 27454 consensus_queue.cc:260] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.458546 27454 ts_tablet_manager.cc:1434] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:55.459544 27454 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.461373 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ac2bf95f8a48639b3bf2ffadb788b2" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
W20260709 13:21:55.462994 27299 leader_election.cc:343] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.463971 27450 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.464572 27450 ts_tablet_manager.cc:1403] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.011s
I20260709 13:21:55.461395 27451 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.466100 27454 tablet_bootstrap.cc:654] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.466711 27451 ts_tablet_manager.cc:1403] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.001s
I20260709 13:21:55.469986 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ac2bf95f8a48639b3bf2ffadb788b2" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.471009 27261 raft_consensus.cc:2468] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:55.471971 27451 raft_consensus.cc:359] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.473271 27451 raft_consensus.cc:385] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.473667 27451 raft_consensus.cc:740] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.474993 27451 consensus_queue.cc:260] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.476630 27450 raft_consensus.cc:359] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.477234 27301 leader_election.cc:304] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:55.477519 27450 raft_consensus.cc:385] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.477941 27450 raft_consensus.cc:740] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.478564 27455 raft_consensus.cc:2804] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.478849 27454 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:55.478976 27450 consensus_queue.cc:260] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.478966 27455 raft_consensus.cc:493] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.482770 27455 raft_consensus.cc:3060] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.483632 27450 ts_tablet_manager.cc:1434] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260709 13:21:55.484823 27450 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.479676 27454 ts_tablet_manager.cc:1403] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:21:55.487991 27454 raft_consensus.cc:359] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.488742 27454 raft_consensus.cc:385] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.489073 27454 raft_consensus.cc:740] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.489773 27454 consensus_queue.cc:260] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.490267 27455 raft_consensus.cc:515] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.491750 27450 tablet_bootstrap.cc:654] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.492038 27454 ts_tablet_manager.cc:1434] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:55.480862 27451 ts_tablet_manager.cc:1434] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:21:55.496732 27451 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.501976 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ac2bf95f8a48639b3bf2ffadb788b2" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.502622 27261 raft_consensus.cc:3060] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.504197 27451 tablet_bootstrap.cc:654] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.508309 27454 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.515116 27261 raft_consensus.cc:2468] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 1.
I20260709 13:21:55.517436 27454 tablet_bootstrap.cc:654] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.518837 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ac2bf95f8a48639b3bf2ffadb788b2" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
W20260709 13:21:55.520835 27299 leader_election.cc:343] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.521796 27455 leader_election.cc:290] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.521957 27450 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.522922 27450 ts_tablet_manager.cc:1403] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.027s
I20260709 13:21:55.524523 27301 leader_election.cc:304] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:55.525732 27454 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:55.526244 27454 ts_tablet_manager.cc:1403] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 13:21:55.526441 27455 raft_consensus.cc:2804] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.526644 27450 raft_consensus.cc:359] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.527607 27450 raft_consensus.cc:385] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.527963 27450 raft_consensus.cc:740] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.529419 27450 consensus_queue.cc:260] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.529923 27454 raft_consensus.cc:359] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.530684 27454 raft_consensus.cc:385] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.530961 27454 raft_consensus.cc:740] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.531766 27454 consensus_queue.cc:260] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.534008 27454 ts_tablet_manager.cc:1434] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:55.534296 27450 ts_tablet_manager.cc:1434] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:21:55.534988 27454 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.535422 27450 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.537313 27451 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.537863 27451 ts_tablet_manager.cc:1403] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.004s
I20260709 13:21:55.541380 27451 raft_consensus.cc:359] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.542198 27451 raft_consensus.cc:385] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.542531 27451 raft_consensus.cc:740] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.543627 27454 tablet_bootstrap.cc:654] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.549240 27451 consensus_queue.cc:260] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.550464 27450 tablet_bootstrap.cc:654] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.551622 27451 ts_tablet_manager.cc:1434] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:21:55.552415 27451 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.555363 27454 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:55.556061 27454 ts_tablet_manager.cc:1403] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:21:55.558200 27451 tablet_bootstrap.cc:654] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.559903 27454 raft_consensus.cc:359] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.564951 27454 raft_consensus.cc:385] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.565083 27455 raft_consensus.cc:697] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:21:55.565421 27454 raft_consensus.cc:740] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.566461 27455 consensus_queue.cc:237] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.566661 27454 consensus_queue.cc:260] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.571942 27450 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.572152 27454 ts_tablet_manager.cc:1434] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:21:55.572609 27450 ts_tablet_manager.cc:1403] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.020s
I20260709 13:21:55.573990 27459 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.574487 27459 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.575959 27450 raft_consensus.cc:359] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.576743 27450 raft_consensus.cc:385] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.577121 27450 raft_consensus.cc:740] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.578102 27450 consensus_queue.cc:260] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.578923 27451 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.579629 27451 ts_tablet_manager.cc:1403] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
I20260709 13:21:55.583855 27450 ts_tablet_manager.cc:1434] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:55.585361 27450 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.585878 27459 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.583230 27451 raft_consensus.cc:359] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.589088 27451 raft_consensus.cc:385] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.589414 27451 raft_consensus.cc:740] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.590262 27451 consensus_queue.cc:260] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.592551 27451 ts_tablet_manager.cc:1434] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:21:55.593533 27451 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.596544 27450 tablet_bootstrap.cc:654] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.573446 27454 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.605976 27451 tablet_bootstrap.cc:654] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.609467 27450 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.610301 27458 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.610926 27458 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.617161 27458 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.618659 27458 raft_consensus.cc:493] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.620683 27454 tablet_bootstrap.cc:654] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.620590 27458 raft_consensus.cc:515] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
W20260709 13:21:55.623668 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:55.626724 27458 leader_election.cc:290] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.634363 27450 ts_tablet_manager.cc:1403] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.000s
I20260709 13:21:55.638163 27450 raft_consensus.cc:359] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.638763 27473 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.642738 27473 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.645994 27473 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849), d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815)
I20260709 13:21:55.646660 27473 raft_consensus.cc:493] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.647253 27473 raft_consensus.cc:515] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.650096 27473 leader_election.cc:290] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.678728 27459 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.679335 27459 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.682294 27459 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.670698 27450 raft_consensus.cc:385] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.688081 27450 raft_consensus.cc:740] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.693557 27450 consensus_queue.cc:260] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.697059 27454 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:55.698321 27454 ts_tablet_manager.cc:1403] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.125s	user 0.033s	sys 0.011s
I20260709 13:21:55.704351 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.704804 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.705097 27483 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.705513 27261 raft_consensus.cc:2468] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:55.705615 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.708036 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.708142 27335 raft_consensus.cc:2468] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in term 0.
I20260709 13:21:55.708611 27410 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in term 0.
I20260709 13:21:55.705569 27483 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.709756 27227 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:55.710482 27459 raft_consensus.cc:2804] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.710860 27459 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.711202 27483 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.705123 27336 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in term 0.
I20260709 13:21:55.702437 27156 catalog_manager.cc:5697] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 1 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.712595 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.713342 27409 raft_consensus.cc:2468] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in term 0.
I20260709 13:21:55.713464 27227 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:55.712340 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.711251 27459 raft_consensus.cc:3060] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.715373 27450 ts_tablet_manager.cc:1434] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:21:55.714705 27410 raft_consensus.cc:2468] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:55.701361 27454 raft_consensus.cc:359] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.719467 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.720593 27410 raft_consensus.cc:2468] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:55.720657 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.721380 27301 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
W20260709 13:21:55.723295 27301 leader_election.cc:343] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.719467 27454 raft_consensus.cc:385] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.725296 27451 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.725857 27451 ts_tablet_manager.cc:1403] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.133s	user 0.032s	sys 0.023s
I20260709 13:21:55.725661 27487 raft_consensus.cc:2804] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.725315 27454 raft_consensus.cc:740] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.726797 27487 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.727152 27299 leader_election.cc:304] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.727473 27454 consensus_queue.cc:260] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.727186 27487 raft_consensus.cc:3060] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.733896 27455 raft_consensus.cc:2804] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.734470 27455 raft_consensus.cc:493] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.734998 27455 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.734645 27451 raft_consensus.cc:359] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.735693 27451 raft_consensus.cc:385] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.736047 27451 raft_consensus.cc:740] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.737972 27459 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.741080 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.741725 27336 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 0.
I20260709 13:21:55.742208 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:55.743146 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.743857 27336 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 0.
I20260709 13:21:55.733070 27450 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.744309 27451 consensus_queue.cc:260] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.744839 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:21:55.743525 27488 raft_consensus.cc:2804] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.780499 27473 raft_consensus.cc:493] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.753808 27451 ts_tablet_manager.cc:1434] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:21:55.743871 27483 raft_consensus.cc:493] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.763800 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.757272 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.761293 27487 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.798661 27483 raft_consensus.cc:515] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.800297 27335 raft_consensus.cc:2393] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in current term 1: Already voted for candidate 4e9763d36e1645168e732b1e4cb1591b in this term.
I20260709 13:21:55.754948 27458 raft_consensus.cc:493] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.763492 27490 raft_consensus.cc:493] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.801210 27458 raft_consensus.cc:515] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.801777 27490 raft_consensus.cc:515] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.803294 27483 leader_election.cc:290] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.804361 27376 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: 
I20260709 13:21:55.804800 27483 raft_consensus.cc:493] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.805414 27455 raft_consensus.cc:515] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
W20260709 13:21:55.800307 27375 leader_election.cc:343] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.803563 27458 leader_election.cc:290] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.806562 27458 raft_consensus.cc:2804] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.807897 27458 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.808266 27258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.808696 27458 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.745824 27410 raft_consensus.cc:3060] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:55.811233 27375 leader_election.cc:343] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.797490 27488 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.812012 27488 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.803965 27490 leader_election.cc:290] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.805274 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.788910 27450 tablet_bootstrap.cc:654] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.806980 27483 raft_consensus.cc:515] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.809144 27454 ts_tablet_manager.cc:1434] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.004s
I20260709 13:21:55.809295 27491 raft_consensus.cc:493] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.763082 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.764493 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.809983 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.810251 27455 leader_election.cc:290] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.798949 27451 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.798187 27473 raft_consensus.cc:515] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.745613 27459 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 election: Requested vote from peers 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.817624 27259 raft_consensus.cc:2393] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99906955df34429dbed30d665ee2e9cb in current term 1: Already voted for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in this term.
W20260709 13:21:55.817773 27227 leader_election.cc:343] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.818885 27487 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Requested vote from peers 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849), d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815)
I20260709 13:21:55.820168 27473 leader_election.cc:290] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.820578 27454 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.812537 27376 leader_election.cc:304] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.823359 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.827836 27451 tablet_bootstrap.cc:654] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.816728 27491 raft_consensus.cc:515] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.833559 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.829094 27458 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.833902 27258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.834550 27259 raft_consensus.cc:2468] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 0.
I20260709 13:21:55.835469 27492 raft_consensus.cc:2804] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.840612 27492 raft_consensus.cc:493] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.834937 27260 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 0.
I20260709 13:21:55.836102 27257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
W20260709 13:21:55.836447 27224 leader_election.cc:343] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.829523 27483 leader_election.cc:290] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.836993 27256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b03fee604e40cb89bd0098320b27e0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.842774 27375 leader_election.cc:304] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:55.843202 27450 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.843067 27224 leader_election.cc:304] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:55.843703 27450 ts_tablet_manager.cc:1403] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.000s
I20260709 13:21:55.844018 27493 raft_consensus.cc:2749] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.844342 27458 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.844627 27483 raft_consensus.cc:2804] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.845052 27483 raft_consensus.cc:493] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.845369 27483 raft_consensus.cc:3060] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:55.845762 27301 leader_election.cc:343] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:55.846761 27301 leader_election.cc:343] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.837281 27376 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb; no voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.847980 27488 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.843818 27375 leader_election.cc:304] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:55.849202 27261 raft_consensus.cc:2393] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99906955df34429dbed30d665ee2e9cb in current term 1: Already voted for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in this term.
I20260709 13:21:55.849396 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.850939 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.851536 27336 raft_consensus.cc:2468] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 0.
I20260709 13:21:55.837973 27410 raft_consensus.cc:2468] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in term 1.
I20260709 13:21:55.838114 27491 leader_election.cc:290] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.846755 27450 raft_consensus.cc:359] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.838474 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.853729 27450 raft_consensus.cc:385] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.853590 27333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:55.854106 27450 raft_consensus.cc:740] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.854912 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:21:55.855602 27410 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.838562 27473 raft_consensus.cc:493] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.841032 27492 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.842233 27257 raft_consensus.cc:2393] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9763d36e1645168e732b1e4cb1591b in current term 1: Already voted for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in this term.
I20260709 13:21:55.852634 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:55.860612 27334 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.862704 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:55.862620 27450 consensus_queue.cc:260] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
W20260709 13:21:55.863454 27227 leader_election.cc:343] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.864593 27498 raft_consensus.cc:2749] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.865294 27498 raft_consensus.cc:2804] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.865618 27498 raft_consensus.cc:493] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.865934 27498 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.869412 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:21:55.870520 27409 raft_consensus.cc:2393] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9763d36e1645168e732b1e4cb1591b in current term 1: Already voted for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in this term.
I20260709 13:21:55.872249 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b03fee604e40cb89bd0098320b27e0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.873144 27409 raft_consensus.cc:2468] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:55.874876 27299 leader_election.cc:304] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.875097 27473 raft_consensus.cc:515] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.875765 27487 raft_consensus.cc:2804] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.876412 27301 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b; no voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.879402 27487 raft_consensus.cc:493] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.879781 27487 raft_consensus.cc:3060] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.880113 27455 raft_consensus.cc:2749] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.877316 27257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.881021 27451 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:55.881234 27257 raft_consensus.cc:2393] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99906955df34429dbed30d665ee2e9cb in current term 1: Already voted for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in this term.
I20260709 13:21:55.881506 27451 ts_tablet_manager.cc:1403] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.014s
I20260709 13:21:55.839397 27454 tablet_bootstrap.cc:654] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.878886 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.883342 27224 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:21:55.885161 27491 raft_consensus.cc:2804] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.886176 27491 raft_consensus.cc:697] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 LEADER]: Becoming Leader. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Running, Role: LEADER
I20260709 13:21:55.887316 27491 consensus_queue.cc:237] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:55.895447 27487 raft_consensus.cc:515] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.896658 27334 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in term 1.
I20260709 13:21:55.898730 27487 leader_election.cc:290] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.898289 27227 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:55.908669 27493 raft_consensus.cc:2804] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:55.874883 27376 leader_election.cc:343] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.899580 27257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b03fee604e40cb89bd0098320b27e0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.900653 27333 raft_consensus.cc:2468] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 0.
I20260709 13:21:55.901985 27473 leader_election.cc:290] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
W20260709 13:21:55.910792 27301 leader_election.cc:343] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.902638 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:55.911329 27376 leader_election.cc:304] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.911559 27261 raft_consensus.cc:2468] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:55.903339 27498 raft_consensus.cc:515] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.912181 27458 raft_consensus.cc:2804] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.912546 27458 raft_consensus.cc:493] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.912643 27376 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb; no voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.913955 27498 leader_election.cc:290] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.914487 27498 raft_consensus.cc:2749] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.902642 27410 raft_consensus.cc:2468] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 1.
I20260709 13:21:55.906301 27483 raft_consensus.cc:515] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.902575 27492 raft_consensus.cc:515] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.915102 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.915475 27333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:55.915745 27409 raft_consensus.cc:2393] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in current term 1: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:55.915781 27261 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.916782 27492 leader_election.cc:290] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.884344 27451 raft_consensus.cc:359] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.917766 27301 leader_election.cc:304] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:55.918175 27451 raft_consensus.cc:385] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.918470 27451 raft_consensus.cc:740] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.918784 27224 leader_election.cc:304] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:55.909243 27493 raft_consensus.cc:697] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 LEADER]: Becoming Leader. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Running, Role: LEADER
I20260709 13:21:55.919943 27473 raft_consensus.cc:2804] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.920346 27473 raft_consensus.cc:493] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.920681 27473 raft_consensus.cc:3060] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.920604 27493 consensus_queue.cc:237] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.921622 27257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
W20260709 13:21:55.923106 27375 leader_election.cc:343] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.922920 27156 catalog_manager.cc:5697] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.912976 27458 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.924084 27488 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 election: Requested vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.904439 27450 ts_tablet_manager.cc:1434] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.060s	user 0.012s	sys 0.015s
I20260709 13:21:55.925359 27450 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:55.926445 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b03fee604e40cb89bd0098320b27e0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:21:55.927021 27409 raft_consensus.cc:3060] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.919159 27451 consensus_queue.cc:260] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.928354 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:21:55.928608 27473 raft_consensus.cc:515] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.929185 27410 raft_consensus.cc:2393] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in current term 1: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:55.929335 27451 ts_tablet_manager.cc:1434] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:21:55.930286 27451 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b: Bootstrap starting.
I20260709 13:21:55.931560 27454 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:55.932054 27454 ts_tablet_manager.cc:1403] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.006s
I20260709 13:21:55.933665 27261 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 1.
I20260709 13:21:55.934865 27483 leader_election.cc:290] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.935374 27491 raft_consensus.cc:2749] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.942152 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:55.942973 27410 raft_consensus.cc:2393] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9763d36e1645168e732b1e4cb1591b in current term 1: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:55.943095 27458 raft_consensus.cc:515] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.944126 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:21:55.944900 27410 raft_consensus.cc:2393] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e9763d36e1645168e732b1e4cb1591b in current term 1: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:55.945762 27458 leader_election.cc:290] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:55.945822 27299 leader_election.cc:304] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.935084 27454 raft_consensus.cc:359] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.936282 27375 leader_election.cc:304] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:55.947402 27451 tablet_bootstrap.cc:654] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.937211 27257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.937894 27256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.947439 27487 raft_consensus.cc:2804] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.948395 27257 raft_consensus.cc:3060] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.939174 27473 leader_election.cc:290] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:55.939805 27450 tablet_bootstrap.cc:654] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.948666 27487 raft_consensus.cc:697] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:21:55.953025 27487 consensus_queue.cc:237] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.952185 27409 raft_consensus.cc:2468] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 1.
I20260709 13:21:55.951700 27454 raft_consensus.cc:385] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.959059 27454 raft_consensus.cc:740] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.952093 27458 raft_consensus.cc:2804] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.961289 27458 raft_consensus.cc:697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:21:55.959404 27333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:55.963747 27333 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.963596 27458 consensus_queue.cc:237] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.963965 27455 consensus_queue.cc:1048] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:55.965344 27376 leader_election.cc:343] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.970429 27299 leader_election.cc:304] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:55.972645 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:55.973053 27455 raft_consensus.cc:2804] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.973258 27335 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.973850 27455 raft_consensus.cc:697] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:21:55.974738 27455 consensus_queue.cc:237] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.965766 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:55.966853 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:55.966711 27454 consensus_queue.cc:260] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.990496 27450 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:55.991990 27450 ts_tablet_manager.cc:1403] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 13:21:55.990996 27334 raft_consensus.cc:2393] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99906955df34429dbed30d665ee2e9cb in current term 1: Already voted for candidate 4e9763d36e1645168e732b1e4cb1591b in this term.
I20260709 13:21:55.993614 27454 ts_tablet_manager.cc:1434] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.002s
I20260709 13:21:55.994663 27454 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:55.995460 27450 raft_consensus.cc:359] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:55.996436 27450 raft_consensus.cc:385] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.996784 27450 raft_consensus.cc:740] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
W20260709 13:21:55.998750 27375 leader_election.cc:343] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:56.002249 27333 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 1.
I20260709 13:21:55.997653 27450 consensus_queue.cc:260] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.004787 27450 ts_tablet_manager.cc:1434] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:21:56.005105 27376 leader_election.cc:304] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb; no voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:56.005741 27450 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb: Bootstrap starting.
I20260709 13:21:56.005914 27458 raft_consensus.cc:2749] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.006423 27376 leader_election.cc:304] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:56.010119 27458 raft_consensus.cc:2804] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.010643 27458 raft_consensus.cc:697] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:21:56.010373 27156 catalog_manager.cc:5697] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 1 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.003019 27454 tablet_bootstrap.cc:654] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.011472 27458 consensus_queue.cc:237] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.013669 27450 tablet_bootstrap.cc:654] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.015796 27257 raft_consensus.cc:2468] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 1.
I20260709 13:21:56.016628 27451 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b: No bootstrap required, opened a new log
I20260709 13:21:56.017154 27451 ts_tablet_manager.cc:1403] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.005s
I20260709 13:21:56.023943 27301 leader_election.cc:304] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:56.024678 27451 raft_consensus.cc:359] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.025671 27451 raft_consensus.cc:385] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.026021 27451 raft_consensus.cc:740] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.027815 27455 raft_consensus.cc:2804] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.029595 27455 raft_consensus.cc:697] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:21:56.030638 27455 consensus_queue.cc:237] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.035838 27159 catalog_manager.cc:5697] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.040572 27451 consensus_queue.cc:260] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.046919 27451 ts_tablet_manager.cc:1434] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:21:56.052438 27335 raft_consensus.cc:2468] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 1.
I20260709 13:21:56.057399 27376 leader_election.cc:304] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:56.058410 27458 raft_consensus.cc:2804] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.059072 27458 raft_consensus.cc:697] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:21:56.058534 27156 catalog_manager.cc:5697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 1 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.060122 27454 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:56.060798 27454 ts_tablet_manager.cc:1403] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.003s
I20260709 13:21:56.066319 27156 catalog_manager.cc:5697] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 1 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.067672 27450 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb: No bootstrap required, opened a new log
I20260709 13:21:56.068470 27450 ts_tablet_manager.cc:1403] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.014s
I20260709 13:21:56.059957 27458 consensus_queue.cc:237] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.082319 27450 raft_consensus.cc:359] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.082026 27454 raft_consensus.cc:359] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.083045 27450 raft_consensus.cc:385] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.083117 27454 raft_consensus.cc:385] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.083416 27450 raft_consensus.cc:740] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.083494 27454 raft_consensus.cc:740] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.084158 27450 consensus_queue.cc:260] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.084158 27454 consensus_queue.cc:260] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.090351 27454 ts_tablet_manager.cc:1434] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:21:56.091495 27454 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:56.091686 27450 ts_tablet_manager.cc:1434] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:21:56.092684 27159 catalog_manager.cc:5697] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 1 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.094558 27159 catalog_manager.cc:5697] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 1 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.099961 27454 tablet_bootstrap.cc:654] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.102643 27409 raft_consensus.cc:3060] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.108904 27156 catalog_manager.cc:5697] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 1 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.111158 27454 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:56.111642 27454 ts_tablet_manager.cc:1403] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.008s
I20260709 13:21:56.114420 27454 raft_consensus.cc:359] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.115024 27454 raft_consensus.cc:385] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.115309 27454 raft_consensus.cc:740] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.115360 27455 consensus_queue.cc:1048] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.116058 27454 consensus_queue.cc:260] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.118398 27454 ts_tablet_manager.cc:1434] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:21:56.119405 27454 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:21:56.124274 27454 tablet_bootstrap.cc:654] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:56.134950 27454 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: No bootstrap required, opened a new log
I20260709 13:21:56.135386 27454 ts_tablet_manager.cc:1403] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:21:56.136883 27493 raft_consensus.cc:493] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.137341 27454 raft_consensus.cc:359] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.137383 27493 raft_consensus.cc:515] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.138082 27454 raft_consensus.cc:385] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:56.138418 27454 raft_consensus.cc:740] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:21:56.139016 27454 consensus_queue.cc:260] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.139812 27493 leader_election.cc:290] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:56.140828 27454 ts_tablet_manager.cc:1434] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:21:56.141987 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:56.143235 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:56.144084 27335 raft_consensus.cc:2393] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in current term 1: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:56.145401 27227 leader_election.cc:304] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:56.146039 27493 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.151830 27493 raft_consensus.cc:2749] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.229511 27455 raft_consensus.cc:493] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.230094 27455 raft_consensus.cc:515] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.231767 27455 leader_election.cc:290] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:56.232688 27256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:56.232926 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:56.233551 27256 raft_consensus.cc:2393] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9763d36e1645168e732b1e4cb1591b in current term 1: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:56.234494 27301 leader_election.cc:304] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b; no voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:56.235095 27455 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.238950 27493 raft_consensus.cc:493] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.239395 27493 raft_consensus.cc:515] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.240172 27455 raft_consensus.cc:2749] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.241216 27493 leader_election.cc:290] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:56.241799 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:56.242201 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:56.242920 27410 raft_consensus.cc:2393] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 in current term 1: Already voted for candidate 4e9763d36e1645168e732b1e4cb1591b in this term.
I20260709 13:21:56.243746 27224 leader_election.cc:304] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:56.244364 27493 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.248863 27493 raft_consensus.cc:2749] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.282271 27493 consensus_queue.cc:1048] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.288431 27493 consensus_queue.cc:1048] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.305034 27473 raft_consensus.cc:493] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.305493 27473 raft_consensus.cc:515] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.307590 27473 leader_election.cc:290] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:56.308619 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:56.309402 27410 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:56.309799 27256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" is_pre_election: true
I20260709 13:21:56.310494 27299 leader_election.cc:304] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: 
I20260709 13:21:56.310559 27256 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 0.
I20260709 13:21:56.311492 27455 raft_consensus.cc:2804] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:56.311923 27455 raft_consensus.cc:493] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.312314 27455 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.318638 27455 raft_consensus.cc:515] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.320246 27455 leader_election.cc:290] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:56.321015 27256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:21:56.321234 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:21:56.321544 27256 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.322019 27410 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.326699 27256 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 1.
I20260709 13:21:56.327186 27410 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 1.
I20260709 13:21:56.327869 27301 leader_election.cc:304] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:21:56.328640 27455 raft_consensus.cc:2804] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:56.329169 27455 raft_consensus.cc:697] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:21:56.329977 27455 consensus_queue.cc:237] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.337132 27159 catalog_manager.cc:5697] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 1 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:56.366866 27493 consensus_queue.cc:1048] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.377099 27488 consensus_queue.cc:1048] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.411957 27458 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.420465 27499 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.426371 27455 consensus_queue.cc:1048] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.429841 27499 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.436980 27458 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.445020 27459 raft_consensus.cc:493] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.445600 27459 raft_consensus.cc:515] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:56.448239 27459 leader_election.cc:290] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:56.452049 27333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b03fee604e40cb89bd0098320b27e0" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:56.455647 27256 raft_consensus.cc:3060] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:56.456403 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b03fee604e40cb89bd0098320b27e0" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:21:56.458693 27224 leader_election.cc:304] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb
I20260709 13:21:56.463990 27459 raft_consensus.cc:2749] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:56.466389 27455 consensus_queue.cc:1048] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.480213 27487 consensus_queue.cc:1048] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.483523 27487 consensus_queue.cc:1048] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.494728 27535 consensus_queue.cc:1048] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.496055 27473 consensus_queue.cc:1048] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.561137 17964 ts_manager.cc:295] Set tserver state for d3d68ebe2b8e4a51af7bfb0b47d08d34 to MAINTENANCE_MODE
I20260709 13:21:56.562363 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
I20260709 13:21:56.586391 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:56.587169 17964 tablet_replica.cc:333] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.587785 17964 raft_consensus.cc:2243] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.588191 17964 raft_consensus.cc:2272] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.590579 17964 tablet_replica.cc:333] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.591115 17964 raft_consensus.cc:2243] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.591535 17964 raft_consensus.cc:2272] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:56.593695 27301 consensus_peers.cc:597] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:56.594298 17964 tablet_replica.cc:333] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.594899 17964 raft_consensus.cc:2243] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.595311 17964 raft_consensus.cc:2272] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.597348 17964 tablet_replica.cc:333] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.597872 17964 raft_consensus.cc:2243] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.598268 17964 raft_consensus.cc:2272] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.600265 17964 tablet_replica.cc:333] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.600795 17964 raft_consensus.cc:2243] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.601297 17964 raft_consensus.cc:2272] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.604386 17964 tablet_replica.cc:333] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.605144 17964 raft_consensus.cc:2243] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.604970 27499 consensus_queue.cc:1048] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:56.606107 17964 raft_consensus.cc:2272] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.608484 17964 tablet_replica.cc:333] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.609167 17964 raft_consensus.cc:2243] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.609694 17964 raft_consensus.cc:2272] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.612363 17964 tablet_replica.cc:333] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.613152 17964 raft_consensus.cc:2243] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:56.614123 17964 raft_consensus.cc:2272] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.620652 17964 tablet_replica.cc:333] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.621371 17964 raft_consensus.cc:2243] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.621956 17964 raft_consensus.cc:2272] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:56.624328 17964 tablet_replica.cc:333] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: stopping tablet replica
I20260709 13:21:56.625015 17964 raft_consensus.cc:2243] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:56.625519 17964 raft_consensus.cc:2272] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:56.626166 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:56.628391 27375 consensus_peers.cc:597] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:56.657734 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
W20260709 13:21:56.852195 27375 consensus_peers.cc:597] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:56.892925 27301 consensus_peers.cc:597] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:56.910075 27301 consensus_peers.cc:597] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:56.930012 27534 consensus_queue.cc:1048] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:56.959554 27375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111) [suppressed 116 similar messages]
W20260709 13:21:56.961941 27375 consensus_peers.cc:597] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.024699 27301 consensus_peers.cc:597] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.080021 27301 consensus_peers.cc:597] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.627135 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:57.797930 27458 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3d68ebe2b8e4a51af7bfb0b47d08d34)
I20260709 13:21:57.798522 27458 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:57.800421 27458 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:57.801697 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:57.802398 27335 raft_consensus.cc:2468] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 1.
I20260709 13:21:57.802863 27455 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3d68ebe2b8e4a51af7bfb0b47d08d34)
I20260709 13:21:57.803339 27455 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:57.803710 27376 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: 
W20260709 13:21:57.804324 27375 leader_election.cc:336] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111)
I20260709 13:21:57.804519 27458 raft_consensus.cc:2804] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:57.804956 27458 raft_consensus.cc:493] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3d68ebe2b8e4a51af7bfb0b47d08d34)
I20260709 13:21:57.805338 27458 raft_consensus.cc:3060] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.805477 27455 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849), d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815)
I20260709 13:21:57.806280 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
W20260709 13:21:57.810081 27301 leader_election.cc:336] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111)
I20260709 13:21:57.811627 27458 raft_consensus.cc:515] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:57.812621 27410 raft_consensus.cc:2393] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9763d36e1645168e732b1e4cb1591b in current term 2: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:57.813621 27458 leader_election.cc:290] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:57.814594 27299 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b; no voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:57.814692 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7d129dc4ad4cfe8384d2a92f4911fc" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:57.815448 27335 raft_consensus.cc:3060] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:57.817519 27375 leader_election.cc:336] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111)
I20260709 13:21:57.821401 27335 raft_consensus.cc:2468] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:21:57.821943 27455 raft_consensus.cc:2749] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:57.822520 27376 leader_election.cc:304] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:57.823364 27458 raft_consensus.cc:2804] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.823866 27458 raft_consensus.cc:697] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:21:57.824687 27458 consensus_queue.cc:237] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:21:57.831954 27157 catalog_manager.cc:5697] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 1 to 2, leader changed from d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.876722 27458 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3d68ebe2b8e4a51af7bfb0b47d08d34)
I20260709 13:21:57.877332 27458 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:57.879218 27458 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:57.880299 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:21:57.880707 27455 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3d68ebe2b8e4a51af7bfb0b47d08d34)
I20260709 13:21:57.881253 27455 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:57.882273 27335 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 1.
W20260709 13:21:57.883828 27375 leader_election.cc:336] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111)
I20260709 13:21:57.884598 27376 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:57.885385 27458 raft_consensus.cc:2804] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:57.884817 27455 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:21:57.885742 27458 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3d68ebe2b8e4a51af7bfb0b47d08d34)
I20260709 13:21:57.886178 27458 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.886281 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
W20260709 13:21:57.887275 27301 leader_election.cc:336] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111)
I20260709 13:21:57.891737 27458 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:57.893028 27410 raft_consensus.cc:2393] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e9763d36e1645168e732b1e4cb1591b in current term 2: Already voted for candidate 99906955df34429dbed30d665ee2e9cb in this term.
I20260709 13:21:57.893680 27458 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:21:57.894779 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:21:57.894953 27299 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b; no voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:57.895345 27335 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:57.897452 27375 leader_election.cc:336] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111)
I20260709 13:21:57.901019 27335 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:21:57.901513 27455 raft_consensus.cc:2749] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:57.902079 27376 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: d3d68ebe2b8e4a51af7bfb0b47d08d34
I20260709 13:21:57.902937 27458 raft_consensus.cc:2804] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.903329 27458 raft_consensus.cc:697] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:21:57.904175 27458 consensus_queue.cc:237] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:21:57.912137 27157 catalog_manager.cc:5697] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 1 to 2, leader changed from d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.272913 27335 raft_consensus.cc:1275] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.274324 27458 consensus_queue.cc:1048] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:58.285837 27375 consensus_peers.cc:597] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.416360 27375 consensus_peers.cc:597] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.462522 27335 raft_consensus.cc:1275] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:58.464010 27555 consensus_queue.cc:1048] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:58.628002 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:58.834061 27375 consensus_peers.cc:597] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:58.997020 27301 consensus_peers.cc:597] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:59.482793 27375 consensus_peers.cc:597] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:59.538141 27301 consensus_peers.cc:597] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:59.545181 27301 consensus_peers.cc:597] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:59.546834 27375 consensus_peers.cc:597] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:59.595758 27301 consensus_peers.cc:597] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:59.628918 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:59.732162 27301 consensus_peers.cc:597] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:00.523422 27375 consensus_peers.cc:597] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:00.629861 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:01.011157 27375 consensus_peers.cc:597] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:01.431676 27375 consensus_peers.cc:597] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:01.630847 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:01.677275 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:01.684273 27561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.685539 27562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.686827 27564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:01.687124 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:01.689149 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:01.689386 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:01.689596 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603321689581 us; error 0 us; skew 500 ppm
I20260709 13:22:01.690270 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:22:01.692657 27301 consensus_peers.cc:597] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:01.693064 17964 webserver.cc:533] Webserver started at http://127.17.139.1:38557/ using document root <none> and password file <none>
I20260709 13:22:01.693629 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:01.693774 17964 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:01.697392 17964 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:01.700964 27569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.701777 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:01.702102 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-z675"
I20260709 13:22:01.702383 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:01.725116 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:01.726121 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:01.727784 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:01.731217 27576 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:22:01.775071 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:22:01.775375 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.045s	user 0.002s	sys 0.000s
I20260709 13:22:01.775625 17964 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:22:01.780520 27576 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.792275 27576 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.793109 27576 tablet_bootstrap.cc:492] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.793617 27576 ts_tablet_manager.cc:1403] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.008s
I20260709 13:22:01.795570 27576 raft_consensus.cc:359] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.796089 27576 raft_consensus.cc:740] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.796674 27576 consensus_queue.cc:260] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.798825 27576 ts_tablet_manager.cc:1434] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:22:01.799532 27576 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.812429 27576 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.812958 17964 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:22:01.813284 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.038s	user 0.035s	sys 0.003s
I20260709 13:22:01.813341 27576 tablet_bootstrap.cc:492] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.814010 27576 ts_tablet_manager.cc:1403] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:22:01.815980 27576 raft_consensus.cc:359] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.816633 27576 raft_consensus.cc:740] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.817269 27576 consensus_queue.cc:260] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.818660 27576 ts_tablet_manager.cc:1434] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:22:01.819315 27576 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.835819 27576 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.837378 27576 tablet_bootstrap.cc:492] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.838222 27576 ts_tablet_manager.cc:1403] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:22:01.841159 27576 raft_consensus.cc:359] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.841885 27576 raft_consensus.cc:740] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.842684 27576 consensus_queue.cc:260] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.844805 27576 ts_tablet_manager.cc:1434] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:01.845788 27576 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.859748 27576 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.860582 27576 tablet_bootstrap.cc:492] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.861173 27576 ts_tablet_manager.cc:1403] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:22:01.863253 27576 raft_consensus.cc:359] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.863945 27576 raft_consensus.cc:740] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.864614 27576 consensus_queue.cc:260] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.866658 27576 ts_tablet_manager.cc:1434] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:01.867440 27576 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.871764 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:37815
I20260709 13:22:01.871942 27637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:37815 every 8 connection(s)
I20260709 13:22:01.876039 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:01.881856 27576 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.882778 27576 tablet_bootstrap.cc:492] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.883363 27576 ts_tablet_manager.cc:1403] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 13:22:01.885684 27576 raft_consensus.cc:359] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:22:01.886315 27576 raft_consensus.cc:740] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.887115 27576 consensus_queue.cc:260] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } } peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } }
I20260709 13:22:01.893402 27576 ts_tablet_manager.cc:1434] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:22:01.894961 27576 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.900944 27638 heartbeater.cc:344] Connected to a master server at 127.17.139.62:43831
I20260709 13:22:01.901425 27638 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:01.902302 27638 heartbeater.cc:507] Master 127.17.139.62:43831 requested a full tablet report, sending...
I20260709 13:22:01.902674 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
mode: GRACEFUL
new_leader_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:53100
I20260709 13:22:01.903390 27335 raft_consensus.cc:606] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Received request to transfer leadership to TS 99906955df34429dbed30d665ee2e9cb
I20260709 13:22:01.906910 27576 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.907840 27576 tablet_bootstrap.cc:492] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.908582 27576 ts_tablet_manager.cc:1403] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:22:01.908764 27157 ts_manager.cc:194] Re-registered known tserver with Master: d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815)
I20260709 13:22:01.910797 27576 raft_consensus.cc:359] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.911335 27576 raft_consensus.cc:385] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.911548 27576 raft_consensus.cc:740] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.912179 27576 consensus_queue.cc:260] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.914197 27576 ts_tablet_manager.cc:1434] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:01.914978 27576 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.917632 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:01.918299 27409 raft_consensus.cc:606] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:01.920974 27157 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57346
I20260709 13:22:01.921372 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:01.921947 27409 raft_consensus.cc:606] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:01.923458 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:01.923928 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:01.924512 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:01.924860 27638 heartbeater.cc:499] Master 127.17.139.62:43831 was elected leader, sending a full tablet report...
I20260709 13:22:01.933037 27576 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.933806 27576 tablet_bootstrap.cc:492] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.934330 27576 ts_tablet_manager.cc:1403] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:22:01.935913 27576 raft_consensus.cc:359] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.936393 27576 raft_consensus.cc:740] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.936959 27576 consensus_queue.cc:260] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.938393 27576 ts_tablet_manager.cc:1434] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:01.939093 27576 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.949277 27576 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.949895 27576 tablet_bootstrap.cc:492] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.950349 27576 ts_tablet_manager.cc:1403] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:22:01.951848 27576 raft_consensus.cc:359] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.952266 27576 raft_consensus.cc:740] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.952689 27576 consensus_queue.cc:260] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.954123 27576 ts_tablet_manager.cc:1434] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:01.954870 27576 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.966831 27576 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.967614 27576 tablet_bootstrap.cc:492] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.968137 27576 ts_tablet_manager.cc:1403] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:22:01.970438 27576 raft_consensus.cc:359] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.971083 27576 raft_consensus.cc:740] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.971848 27576 consensus_queue.cc:260] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.973528 27576 ts_tablet_manager.cc:1434] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:22:01.973937 27612 raft_consensus.cc:3060] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.974356 27576 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap starting.
I20260709 13:22:01.989972 27576 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.990149 27560 raft_consensus.cc:993] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:01.990688 27560 raft_consensus.cc:1081] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:01.991235 27576 tablet_bootstrap.cc:492] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Bootstrap complete.
I20260709 13:22:01.992146 27576 ts_tablet_manager.cc:1403] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:22:01.992419 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:01.993099 27335 raft_consensus.cc:493] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.993445 27335 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.994721 27576 raft_consensus.cc:359] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.995419 27576 raft_consensus.cc:740] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d68ebe2b8e4a51af7bfb0b47d08d34, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.996073 27576 consensus_queue.cc:260] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:01.998092 27576 ts_tablet_manager.cc:1434] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:01.999868 27335 raft_consensus.cc:515] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.000691 27578 raft_consensus.cc:493] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.001155 27578 raft_consensus.cc:515] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.002036 27335 leader_election.cc:290] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:02.003700 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:02.004289 27409 raft_consensus.cc:3055] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:02.004622 27409 raft_consensus.cc:740] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:02.005410 27409 consensus_queue.cc:260] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.007028 27409 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.012905 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:02.013734 27409 raft_consensus.cc:2468] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 2.
I20260709 13:22:02.014398 27612 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.014853 27578 leader_election.cc:290] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:02.015251 27299 leader_election.cc:304] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: 
I20260709 13:22:02.016162 27455 raft_consensus.cc:2804] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.020689 27455 raft_consensus.cc:697] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:02.021476 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99906955df34429dbed30d665ee2e9cb" is_pre_election: true
I20260709 13:22:02.021466 27455 consensus_queue.cc:237] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.021932 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e9763d36e1645168e732b1e4cb1591b" is_pre_election: true
I20260709 13:22:02.022387 27409 raft_consensus.cc:2368] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 for earlier term 1. Current term is 2.
I20260709 13:22:02.021549 27612 raft_consensus.cc:2468] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 2.
I20260709 13:22:02.023725 27570 leader_election.cc:400] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849) with higher term. Message: Invalid argument: T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 for earlier term 1. Current term is 2.
I20260709 13:22:02.024082 27570 leader_election.cc:403] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:22:02.024566 27578 raft_consensus.cc:2749] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849) with higher term. Message: Invalid argument: T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3d68ebe2b8e4a51af7bfb0b47d08d34 for earlier term 1. Current term is 2.
I20260709 13:22:02.028674 27157 catalog_manager.cc:5697] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 1 to 2, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 2 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.131603 27654 raft_consensus.cc:993] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:02.132085 27655 raft_consensus.cc:1081] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:02.133435 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:02.133952 27335 raft_consensus.cc:493] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:02.134258 27335 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.140134 27335 raft_consensus.cc:515] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.141912 27335 leader_election.cc:290] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:02.142958 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:02.143410 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:02.143625 27409 raft_consensus.cc:3055] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:02.143987 27409 raft_consensus.cc:740] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:02.144016 27612 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.144965 27409 consensus_queue.cc:260] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.146387 27409 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.151260 27612 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 2.
I20260709 13:22:02.152420 27301 leader_election.cc:304] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:02.153210 27455 raft_consensus.cc:2804] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.153264 27409 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 2.
I20260709 13:22:02.153692 27455 raft_consensus.cc:697] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:02.154536 27455 consensus_queue.cc:237] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.161123 27157 catalog_manager.cc:5697] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 1 to 2, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 2 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.199314 27612 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.336390 27657 raft_consensus.cc:993] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b: : Instructing follower 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:02.336867 27455 raft_consensus.cc:1081] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Signalling peer 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:02.338322 27409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:38402
I20260709 13:22:02.338799 27409 raft_consensus.cc:493] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:02.339129 27409 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.343894 27409 raft_consensus.cc:515] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.345559 27409 leader_election.cc:290] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:22:02.346339 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:02.346585 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:22:02.346900 27612 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.347190 27335 raft_consensus.cc:3055] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:02.347517 27335 raft_consensus.cc:740] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:02.348170 27335 consensus_queue.cc:260] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.349176 27335 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.351826 27612 raft_consensus.cc:2468] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:22:02.352921 27375 leader_election.cc:304] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:02.353716 27655 raft_consensus.cc:2804] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.354115 27335 raft_consensus.cc:2468] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:22:02.354137 27655 raft_consensus.cc:697] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:02.355222 27655 consensus_queue.cc:237] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:02.361553 27157 catalog_manager.cc:5697] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 1 to 2, leader changed from 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.489876 27612 raft_consensus.cc:1275] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.492471 27455 consensus_queue.cc:1048] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:02.514420 27409 raft_consensus.cc:1275] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.516630 27455 consensus_queue.cc:1048] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.555488 27409 raft_consensus.cc:1275] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.556600 27455 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.566720 27612 raft_consensus.cc:1275] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.568771 27657 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:22:02.631969 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:02.932868 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:02.941936 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:02.942704 27409 raft_consensus.cc:606] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:02.945298 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
mode: GRACEFUL
new_leader_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:53100
I20260709 13:22:02.945734 27335 raft_consensus.cc:606] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Received request to transfer leadership to TS 99906955df34429dbed30d665ee2e9cb
I20260709 13:22:02.948112 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
mode: GRACEFUL
new_leader_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:53100
I20260709 13:22:02.948509 27335 raft_consensus.cc:606] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Received request to transfer leadership to TS 99906955df34429dbed30d665ee2e9cb
I20260709 13:22:02.949568 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:02.949985 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:02.950621 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:02.967587 27612 raft_consensus.cc:1275] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.969177 27675 consensus_queue.cc:1048] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.979600 27335 raft_consensus.cc:1275] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.981485 27655 consensus_queue.cc:1048] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.988776 27654 raft_consensus.cc:993] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:02.989295 27655 raft_consensus.cc:1081] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:02.990787 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:02.991317 27335 raft_consensus.cc:493] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:02.991592 27335 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:02.999785 27335 raft_consensus.cc:515] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.001821 27335 leader_election.cc:290] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 3 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:03.004041 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:03.005053 27409 raft_consensus.cc:3055] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:03.005409 27409 raft_consensus.cc:740] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:03.006592 27409 consensus_queue.cc:260] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.007656 27409 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.008702 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c5af5201409428eb3bf5bcec1465e04" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:03.009521 27612 raft_consensus.cc:3060] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.015234 27409 raft_consensus.cc:2468] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 3.
I20260709 13:22:03.016980 27299 leader_election.cc:304] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, 99906955df34429dbed30d665ee2e9cb; no voters: 
I20260709 13:22:03.017740 27657 raft_consensus.cc:2804] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:03.018206 27657 raft_consensus.cc:697] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:03.019217 27657 consensus_queue.cc:237] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.021358 27612 raft_consensus.cc:2468] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 3.
I20260709 13:22:03.025818 27157 catalog_manager.cc:5697] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 2 to 3, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 3 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.083966 27455 raft_consensus.cc:993] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b: : Instructing follower 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:03.084478 27657 raft_consensus.cc:1081] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Signalling peer 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:03.085891 27409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:38402
I20260709 13:22:03.086463 27409 raft_consensus.cc:493] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:03.086824 27409 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.093266 27409 raft_consensus.cc:515] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.094959 27409 leader_election.cc:290] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 3 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:22:03.095654 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:03.096065 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:22:03.096390 27612 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.096696 27335 raft_consensus.cc:3055] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:03.097090 27335 raft_consensus.cc:740] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:03.097968 27335 consensus_queue.cc:260] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.099239 27335 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.103260 27612 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 3.
I20260709 13:22:03.104405 27375 leader_election.cc:304] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:03.105150 27655 raft_consensus.cc:2804] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:03.105552 27655 raft_consensus.cc:697] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:03.105576 27335 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 3.
I20260709 13:22:03.106632 27655 consensus_queue.cc:237] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.112385 27157 catalog_manager.cc:5697] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 2 to 3, leader changed from 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 3 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:03.190763 27455 raft_consensus.cc:993] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b: : Instructing follower 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:03.191218 27657 raft_consensus.cc:1081] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Signalling peer 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:03.192675 27409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:38402
I20260709 13:22:03.193168 27409 raft_consensus.cc:493] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:03.193480 27409 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:03.198868 27409 raft_consensus.cc:515] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.200428 27409 leader_election.cc:290] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:22:03.201423 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:22:03.201391 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:03.202188 27335 raft_consensus.cc:3055] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:03.202322 27611 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:03.202559 27335 raft_consensus.cc:740] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:03.203531 27335 consensus_queue.cc:260] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.204806 27335 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:03.210281 27611 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:22:03.211580 27375 leader_election.cc:304] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:03.212008 27335 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:22:03.212541 27654 raft_consensus.cc:2804] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:03.213130 27654 raft_consensus.cc:697] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:03.214133 27654 consensus_queue.cc:237] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:03.221299 27157 catalog_manager.cc:5697] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 1 to 2, leader changed from 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:03.442727 27409 raft_consensus.cc:1275] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:03.443991 27657 consensus_queue.cc:1048] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:03.451400 27611 raft_consensus.cc:1275] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:03.453431 27673 consensus_queue.cc:1048] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:03.533176 27335 raft_consensus.cc:1275] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:03.534282 27654 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:03.542408 27611 raft_consensus.cc:1275] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:03.543720 27654 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:22:03.633018 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:03.810062 27335 raft_consensus.cc:1275] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.811372 27654 consensus_queue.cc:1048] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.817310 27611 raft_consensus.cc:1275] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.818733 27655 consensus_queue.cc:1048] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.956436 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:03.963852 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:03.964382 27409 raft_consensus.cc:606] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:03.966995 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:03.967372 27409 raft_consensus.cc:606] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:03.969522 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
mode: GRACEFUL
new_leader_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:53100
I20260709 13:22:03.970000 27335 raft_consensus.cc:606] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Received request to transfer leadership to TS 99906955df34429dbed30d665ee2e9cb
I20260709 13:22:03.971093 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:03.971568 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:03.972132 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:03.998993 27684 raft_consensus.cc:993] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:03.999517 27682 raft_consensus.cc:1081] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:04.001014 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:04.001405 27335 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.001619 27335 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.006398 27335 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.007669 27335 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 3 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:04.008515 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:04.008740 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:04.009254 27611 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.009404 27409 raft_consensus.cc:3055] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:04.009824 27409 raft_consensus.cc:740] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:04.010694 27409 consensus_queue.cc:260] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.011950 27409 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.015208 27611 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 3.
I20260709 13:22:04.016599 27301 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:04.017247 27673 raft_consensus.cc:2804] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:04.017669 27409 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 3.
I20260709 13:22:04.018271 27673 raft_consensus.cc:697] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:04.019402 27673 consensus_queue.cc:237] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.026171 27158 catalog_manager.cc:5697] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 2 to 3, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 3 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.085414 27684 raft_consensus.cc:993] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:04.085891 27682 raft_consensus.cc:1081] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:04.087214 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:04.087648 27335 raft_consensus.cc:493] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.087914 27335 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.092408 27335 raft_consensus.cc:515] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.093762 27335 leader_election.cc:290] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:04.094656 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:04.094992 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:04.095227 27611 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.095573 27409 raft_consensus.cc:3055] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:04.095862 27409 raft_consensus.cc:740] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:04.096598 27409 consensus_queue.cc:260] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.097676 27409 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.100641 27611 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 2.
I20260709 13:22:04.101759 27301 leader_election.cc:304] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:04.102643 27409 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 2.
I20260709 13:22:04.102649 27691 raft_consensus.cc:2804] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.103340 27691 raft_consensus.cc:697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:04.104485 27691 consensus_queue.cc:237] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.112267 27158 catalog_manager.cc:5697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 1 to 2, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 2 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.400274 27686 raft_consensus.cc:993] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b: : Instructing follower 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:04.400910 27673 raft_consensus.cc:1081] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Signalling peer 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:04.402302 27410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:38402
I20260709 13:22:04.402714 27410 raft_consensus.cc:493] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.402971 27410 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.409004 27410 raft_consensus.cc:515] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.410528 27410 leader_election.cc:290] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 3 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:22:04.411404 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:04.411536 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6522b4a6c542579edb0d25b08c2605" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:22:04.411971 27611 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.412096 27335 raft_consensus.cc:3055] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:04.412493 27335 raft_consensus.cc:740] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:04.413184 27335 consensus_queue.cc:260] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.414114 27335 raft_consensus.cc:3060] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.417402 27611 raft_consensus.cc:2468] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 3.
I20260709 13:22:04.418433 27375 leader_election.cc:304] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:04.418702 27335 raft_consensus.cc:2468] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 3.
I20260709 13:22:04.419301 27682 raft_consensus.cc:2804] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:04.419811 27682 raft_consensus.cc:697] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:04.420625 27682 consensus_queue.cc:237] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:04.428143 27158 catalog_manager.cc:5697] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 2 to 3, leader changed from 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 3 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:04.518473 27611 raft_consensus.cc:1275] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:04.519840 27673 consensus_queue.cc:1048] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:04.534101 27410 raft_consensus.cc:1275] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:04.535764 27691 consensus_queue.cc:1048] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:04.571364 27410 raft_consensus.cc:1275] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:04.572491 27691 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:04.581112 27611 raft_consensus.cc:1275] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:04.582470 27691 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:04.633932 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:04.810722 27611 raft_consensus.cc:1275] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:04.811980 27682 consensus_queue.cc:1048] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:04.820567 27335 raft_consensus.cc:1275] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:04.822944 27682 consensus_queue.cc:1048] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:04.978470 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:04.985910 27410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:04.986469 27410 raft_consensus.cc:606] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:04.988941 27333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
mode: GRACEFUL
new_leader_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:53100
I20260709 13:22:04.989430 27333 raft_consensus.cc:606] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Received request to transfer leadership to TS 99906955df34429dbed30d665ee2e9cb
I20260709 13:22:04.991724 27333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
mode: GRACEFUL
new_leader_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:53100
I20260709 13:22:04.992172 27333 raft_consensus.cc:606] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Received request to transfer leadership to TS 99906955df34429dbed30d665ee2e9cb
I20260709 13:22:04.993250 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:04.993721 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:04.994267 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:05.110497 27703 raft_consensus.cc:993] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:05.111124 27682 raft_consensus.cc:1081] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:05.112516 27333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:05.113121 27333 raft_consensus.cc:493] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:05.113415 27333 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.119294 27333 raft_consensus.cc:515] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.121100 27333 leader_election.cc:290] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 4 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:05.121773 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:05.122059 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718aa70f7e764d01a3c2b444664104db" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:05.122473 27611 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.122654 27410 raft_consensus.cc:3055] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:05.123114 27410 raft_consensus.cc:740] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:05.123813 27410 consensus_queue.cc:260] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.124748 27410 raft_consensus.cc:3060] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.128913 27611 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 4.
I20260709 13:22:05.129590 27410 raft_consensus.cc:2468] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 4.
I20260709 13:22:05.130020 27301 leader_election.cc:304] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:05.130764 27686 raft_consensus.cc:2804] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:05.131564 27686 raft_consensus.cc:697] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 4 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:05.132205 27686 consensus_queue.cc:237] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.138532 27157 catalog_manager.cc:5697] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 3 to 4, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 4 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:05.156886 27686 raft_consensus.cc:993] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b: : Instructing follower 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:05.157377 27711 raft_consensus.cc:1081] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Signalling peer 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:05.158733 27410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:38402
I20260709 13:22:05.159215 27410 raft_consensus.cc:493] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:05.159566 27410 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.164202 27410 raft_consensus.cc:515] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.165791 27410 leader_election.cc:290] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 4 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:22:05.166714 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:05.166724 27333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c62186bab4784e5c8e31397a2e403e31" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:22:05.167594 27611 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.167668 27333 raft_consensus.cc:3055] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:05.168134 27333 raft_consensus.cc:740] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:05.168838 27333 consensus_queue.cc:260] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.169855 27333 raft_consensus.cc:3060] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.172696 27611 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 4.
I20260709 13:22:05.173763 27375 leader_election.cc:304] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:05.174422 27682 raft_consensus.cc:2804] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:05.174788 27333 raft_consensus.cc:2468] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 4.
I20260709 13:22:05.174824 27682 raft_consensus.cc:697] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 4 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:05.175961 27682 consensus_queue.cc:237] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.181710 27157 catalog_manager.cc:5697] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 3 to 4, leader changed from 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 4 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:05.477957 27686 raft_consensus.cc:993] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b: : Instructing follower 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:05.478415 27711 raft_consensus.cc:1081] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Signalling peer 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:05.479714 27410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:38402
I20260709 13:22:05.480147 27410 raft_consensus.cc:493] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:05.480396 27410 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:05.484730 27410 raft_consensus.cc:515] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.486148 27410 leader_election.cc:290] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 3 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:22:05.486887 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:05.487183 27333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:22:05.487517 27611 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:05.487746 27333 raft_consensus.cc:3055] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:05.488087 27333 raft_consensus.cc:740] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:05.488688 27333 consensus_queue.cc:260] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.489637 27333 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:05.492417 27611 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 3.
I20260709 13:22:05.493408 27375 leader_election.cc:304] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:05.494129 27712 raft_consensus.cc:2804] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:05.494539 27712 raft_consensus.cc:697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:05.494742 27333 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 3.
I20260709 13:22:05.495332 27712 consensus_queue.cc:237] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:05.503748 27157 catalog_manager.cc:5697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 2 to 3, leader changed from 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 3 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:05.635076 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:05.651137 27611 raft_consensus.cc:1275] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:05.652550 27711 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.668649 27410 raft_consensus.cc:1275] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:05.671132 27686 consensus_queue.cc:1048] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.705776 27333 raft_consensus.cc:1275] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:05.706907 27712 consensus_queue.cc:1048] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.715054 27611 raft_consensus.cc:1275] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:05.716787 27682 consensus_queue.cc:1048] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:05.946149 27611 raft_consensus.cc:1275] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:05.947470 27682 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:05.956046 27333 raft_consensus.cc:1275] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:05.958292 27724 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:06.000500 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:06.007699 27410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:06.008309 27410 raft_consensus.cc:606] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:06.010921 27333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
mode: GRACEFUL
new_leader_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:53100
I20260709 13:22:06.011340 27333 raft_consensus.cc:606] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Received request to transfer leadership to TS 99906955df34429dbed30d665ee2e9cb
I20260709 13:22:06.013768 27410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
mode: GRACEFUL
new_leader_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:36080
I20260709 13:22:06.014164 27410 raft_consensus.cc:606] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Received request to transfer leadership to TS 4e9763d36e1645168e732b1e4cb1591b
I20260709 13:22:06.015105 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:22:06.015702 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:06.016316 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:06.203543 27718 raft_consensus.cc:993] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b: : Instructing follower 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:06.204015 27686 raft_consensus.cc:1081] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Signalling peer 99906955df34429dbed30d665ee2e9cb to start an election
I20260709 13:22:06.205464 27410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb"
dest_uuid: "99906955df34429dbed30d665ee2e9cb"
 from {username='slave'} at 127.0.0.1:38402
I20260709 13:22:06.205885 27410 raft_consensus.cc:493] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:06.206171 27410 raft_consensus.cc:3060] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.210625 27410 raft_consensus.cc:515] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.212021 27410 leader_election.cc:290] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765)
I20260709 13:22:06.212816 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:06.213073 27333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61eb2606188c47d7a0124c771dbea4fb" candidate_uuid: "99906955df34429dbed30d665ee2e9cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
I20260709 13:22:06.213557 27612 raft_consensus.cc:3060] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.213680 27333 raft_consensus.cc:3055] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:06.214147 27333 raft_consensus.cc:740] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:06.214820 27333 consensus_queue.cc:260] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.216013 27333 raft_consensus.cc:3060] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:06.218875 27612 raft_consensus.cc:2468] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:22:06.220031 27375 leader_election.cc:304] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99906955df34429dbed30d665ee2e9cb, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:06.220703 27682 raft_consensus.cc:2804] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:06.221226 27682 raft_consensus.cc:697] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Leader. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:06.221359 27333 raft_consensus.cc:2468] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99906955df34429dbed30d665ee2e9cb in term 2.
I20260709 13:22:06.222285 27682 consensus_queue.cc:237] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.229818 27158 catalog_manager.cc:5697] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb reported cstate change: term changed from 1 to 2, leader changed from 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2) to 99906955df34429dbed30d665ee2e9cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "99906955df34429dbed30d665ee2e9cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:06.341920 27703 raft_consensus.cc:993] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:06.342360 27682 raft_consensus.cc:1081] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:06.343686 27333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:06.344209 27333 raft_consensus.cc:493] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:06.344501 27333 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:06.349388 27333 raft_consensus.cc:515] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.350871 27333 leader_election.cc:290] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 3 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:06.351653 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:06.351764 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5388e2923ef3472a8fc7abaac2d505d0" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:06.352365 27612 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:06.352447 27410 raft_consensus.cc:3055] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:06.352933 27410 raft_consensus.cc:740] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:06.353559 27410 consensus_queue.cc:260] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.354409 27410 raft_consensus.cc:3060] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:06.357321 27612 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 3.
I20260709 13:22:06.358282 27301 leader_election.cc:304] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:06.358774 27410 raft_consensus.cc:2468] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 3.
I20260709 13:22:06.359033 27686 raft_consensus.cc:2804] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:06.359546 27686 raft_consensus.cc:697] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:06.360234 27686 consensus_queue.cc:237] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.367025 27158 catalog_manager.cc:5697] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 2 to 3, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 3 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:06.441784 27703 raft_consensus.cc:993] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: : Instructing follower 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:06.442252 27682 raft_consensus.cc:1081] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Signalling peer 4e9763d36e1645168e732b1e4cb1591b to start an election
I20260709 13:22:06.443717 27333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e"
dest_uuid: "4e9763d36e1645168e732b1e4cb1591b"
 from {username='slave'} at 127.0.0.1:56762
I20260709 13:22:06.444345 27333 raft_consensus.cc:493] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:06.444758 27333 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:06.449810 27333 raft_consensus.cc:515] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.451495 27333 leader_election.cc:290] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 4 election: Requested vote from peers d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815), 99906955df34429dbed30d665ee2e9cb (127.17.139.3:44849)
I20260709 13:22:06.452136 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34"
I20260709 13:22:06.452494 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c6c7bec17c40068ea6b83b47c1ee2e" candidate_uuid: "4e9763d36e1645168e732b1e4cb1591b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99906955df34429dbed30d665ee2e9cb"
I20260709 13:22:06.452762 27612 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:06.453073 27410 raft_consensus.cc:3055] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:06.453351 27410 raft_consensus.cc:740] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 99906955df34429dbed30d665ee2e9cb, State: Running, Role: LEADER
I20260709 13:22:06.453990 27410 consensus_queue.cc:260] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.454994 27410 raft_consensus.cc:3060] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:06.458184 27612 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 4.
I20260709 13:22:06.459108 27301 leader_election.cc:304] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e9763d36e1645168e732b1e4cb1591b, d3d68ebe2b8e4a51af7bfb0b47d08d34; no voters: 
I20260709 13:22:06.459631 27410 raft_consensus.cc:2468] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e9763d36e1645168e732b1e4cb1591b in term 4.
I20260709 13:22:06.459779 27686 raft_consensus.cc:2804] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:06.460328 27686 raft_consensus.cc:697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 4 LEADER]: Becoming Leader. State: Replica: 4e9763d36e1645168e732b1e4cb1591b, State: Running, Role: LEADER
I20260709 13:22:06.461072 27686 consensus_queue.cc:237] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } }
I20260709 13:22:06.466924 27158 catalog_manager.cc:5697] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b reported cstate change: term changed from 3 to 4, leader changed from 99906955df34429dbed30d665ee2e9cb (127.17.139.3) to 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2). New cstate: current_term: 4 leader_uuid: "4e9763d36e1645168e732b1e4cb1591b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:06.636174 27207 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:06.673157 27612 raft_consensus.cc:1275] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.674522 27703 consensus_queue.cc:1048] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.681809 27333 raft_consensus.cc:1275] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Refusing update from remote peer 99906955df34429dbed30d665ee2e9cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:06.683209 27724 consensus_queue.cc:1048] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e9763d36e1645168e732b1e4cb1591b" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:06.762733 27410 raft_consensus.cc:1275] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:06.763904 27686 consensus_queue.cc:1048] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:06.774597 27612 raft_consensus.cc:1275] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:06.775969 27686 consensus_queue.cc:1048] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:07.022466 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:07.031113 27612 raft_consensus.cc:1275] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:07.032794 27686 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d68ebe2b8e4a51af7bfb0b47d08d34" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:07.041910 27410 raft_consensus.cc:1275] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Refusing update from remote peer 4e9763d36e1645168e732b1e4cb1591b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:07.043540 27718 consensus_queue.cc:1048] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [LEADER]: Connected to new peer: Peer: permanent_uuid: "99906955df34429dbed30d665ee2e9cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:07.057715 17964 tablet_server.cc:179] TabletServer@127.17.139.1:37815 shutting down...
I20260709 13:22:07.083925 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:07.084918 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.085747 17964 raft_consensus.cc:2243] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.086182 17964 raft_consensus.cc:2272] T a3ac2bf95f8a48639b3bf2ffadb788b2 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.088529 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.089229 17964 raft_consensus.cc:2243] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.089685 17964 raft_consensus.cc:2272] T 718aa70f7e764d01a3c2b444664104db P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.091817 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.092372 17964 raft_consensus.cc:2243] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.092777 17964 raft_consensus.cc:2272] T 61eb2606188c47d7a0124c771dbea4fb P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.095521 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.096148 17964 raft_consensus.cc:2243] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.096561 17964 raft_consensus.cc:2272] T 0c5af5201409428eb3bf5bcec1465e04 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.098780 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.099346 17964 raft_consensus.cc:2243] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.099782 17964 raft_consensus.cc:2272] T ea6522b4a6c542579edb0d25b08c2605 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.102028 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.102545 17964 raft_consensus.cc:2243] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.103014 17964 raft_consensus.cc:2272] T 5d7d129dc4ad4cfe8384d2a92f4911fc P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.105427 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.105944 17964 raft_consensus.cc:2243] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.106348 17964 raft_consensus.cc:2272] T c62186bab4784e5c8e31397a2e403e31 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.108325 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.108835 17964 raft_consensus.cc:2243] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.109316 17964 raft_consensus.cc:2272] T 5388e2923ef3472a8fc7abaac2d505d0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.112668 17964 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:07.113346 17964 raft_consensus.cc:2243] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.113871 17964 raft_consensus.cc:2272] T e0b03fee604e40cb89bd0098320b27e0 P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.114074 27375 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 97 similar messages]
I20260709 13:22:07.116931 17964 tablet_replica.cc:333] stopping tablet replica
W20260709 13:22:07.117182 27375 consensus_peers.cc:597] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.117717 17964 raft_consensus.cc:2243] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.118172 17964 raft_consensus.cc:2272] T b9c6c7bec17c40068ea6b83b47c1ee2e P d3d68ebe2b8e4a51af7bfb0b47d08d34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.152217 17964 tablet_server.cc:196] TabletServer@127.17.139.1:37815 shutdown complete.
W20260709 13:22:07.170167 27301 consensus_peers.cc:597] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.182101 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
I20260709 13:22:07.210080 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:07.211037 17964 tablet_replica.cc:333] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.212054 17964 raft_consensus.cc:2243] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.213104 17964 raft_consensus.cc:2272] T b9c6c7bec17c40068ea6b83b47c1ee2e P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.213590 27301 consensus_peers.cc:597] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.216382 17964 tablet_replica.cc:333] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.217160 17964 raft_consensus.cc:2243] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.217633 17964 raft_consensus.cc:2272] T c62186bab4784e5c8e31397a2e403e31 P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.220837 27376 consensus_peers.cc:597] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb -> Peer 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765): Couldn't send request to peer 4e9763d36e1645168e732b1e4cb1591b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.222419 17964 tablet_replica.cc:333] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.223356 17964 raft_consensus.cc:2243] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.224340 17964 raft_consensus.cc:2272] T 0c5af5201409428eb3bf5bcec1465e04 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.226683 17964 tablet_replica.cc:333] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.227263 17964 raft_consensus.cc:2243] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.227686 17964 raft_consensus.cc:2272] T ea6522b4a6c542579edb0d25b08c2605 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.229875 17964 tablet_replica.cc:333] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.230448 17964 raft_consensus.cc:2243] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.231215 17964 raft_consensus.cc:2272] T 5388e2923ef3472a8fc7abaac2d505d0 P 4e9763d36e1645168e732b1e4cb1591b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.233794 17964 tablet_replica.cc:333] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.234390 17964 raft_consensus.cc:2243] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.235221 17964 raft_consensus.cc:2272] T e0b03fee604e40cb89bd0098320b27e0 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.238144 17964 tablet_replica.cc:333] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.238785 17964 raft_consensus.cc:2243] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.239676 17964 raft_consensus.cc:2272] T 718aa70f7e764d01a3c2b444664104db P 4e9763d36e1645168e732b1e4cb1591b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:07.241430 27375 consensus_peers.cc:597] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb -> Peer d3d68ebe2b8e4a51af7bfb0b47d08d34 (127.17.139.1:37815): Couldn't send request to peer d3d68ebe2b8e4a51af7bfb0b47d08d34. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.242750 17964 tablet_replica.cc:333] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.243322 17964 raft_consensus.cc:2243] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.244050 17964 raft_consensus.cc:2272] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 4e9763d36e1645168e732b1e4cb1591b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.246420 17964 tablet_replica.cc:333] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.246877 17964 raft_consensus.cc:2243] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.247238 17964 raft_consensus.cc:2272] T 61eb2606188c47d7a0124c771dbea4fb P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.249709 17964 tablet_replica.cc:333] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b: stopping tablet replica
I20260709 13:22:07.250167 17964 raft_consensus.cc:2243] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.250568 17964 raft_consensus.cc:2272] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 4e9763d36e1645168e732b1e4cb1591b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.273639 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
W20260709 13:22:07.280824 27376 consensus_peers.cc:597] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb -> Peer 4e9763d36e1645168e732b1e4cb1591b (127.17.139.2:43765): Couldn't send request to peer 4e9763d36e1645168e732b1e4cb1591b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:43765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:07.297962 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
I20260709 13:22:07.325415 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:07.326047 17964 tablet_replica.cc:333] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.326651 17964 raft_consensus.cc:2243] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.327055 17964 raft_consensus.cc:2272] T 5388e2923ef3472a8fc7abaac2d505d0 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.329878 17964 tablet_replica.cc:333] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.330617 17964 raft_consensus.cc:2243] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.331293 17964 raft_consensus.cc:2272] T a3ac2bf95f8a48639b3bf2ffadb788b2 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.333971 17964 tablet_replica.cc:333] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.334590 17964 raft_consensus.cc:2243] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.335116 17964 raft_consensus.cc:2272] T e0b03fee604e40cb89bd0098320b27e0 P 99906955df34429dbed30d665ee2e9cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.337313 17964 tablet_replica.cc:333] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.337894 17964 raft_consensus.cc:2243] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.338682 17964 raft_consensus.cc:2272] T c62186bab4784e5c8e31397a2e403e31 P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.340597 17964 tablet_replica.cc:333] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.341215 17964 raft_consensus.cc:2243] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.341629 17964 raft_consensus.cc:2272] T b9c6c7bec17c40068ea6b83b47c1ee2e P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.344074 17964 tablet_replica.cc:333] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.344619 17964 raft_consensus.cc:2243] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.345420 17964 raft_consensus.cc:2272] T ea6522b4a6c542579edb0d25b08c2605 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.347437 17964 tablet_replica.cc:333] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.347960 17964 raft_consensus.cc:2243] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.348381 17964 raft_consensus.cc:2272] T 0c5af5201409428eb3bf5bcec1465e04 P 99906955df34429dbed30d665ee2e9cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.350726 17964 tablet_replica.cc:333] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.351210 17964 raft_consensus.cc:2243] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.351950 17964 raft_consensus.cc:2272] T 5d7d129dc4ad4cfe8384d2a92f4911fc P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.353945 17964 tablet_replica.cc:333] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.354434 17964 raft_consensus.cc:2243] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:07.354825 17964 raft_consensus.cc:2272] T 718aa70f7e764d01a3c2b444664104db P 99906955df34429dbed30d665ee2e9cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.356702 17964 tablet_replica.cc:333] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb: stopping tablet replica
I20260709 13:22:07.357234 17964 raft_consensus.cc:2243] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.357995 17964 raft_consensus.cc:2272] T 61eb2606188c47d7a0124c771dbea4fb P 99906955df34429dbed30d665ee2e9cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.388449 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
I20260709 13:22:07.412410 17964 master.cc:562] Master@127.17.139.62:43831 shutting down...
I20260709 13:22:07.437357 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:07.437927 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:07.438266 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P eed9ef444e5141a387606f4ceac0281a: stopping tablet replica
I20260709 13:22:07.459476 17964 master.cc:584] Master@127.17.139.62:43831 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13013 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:22:07.503484 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:43315
I20260709 13:22:07.504595 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.509888 27749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.509994 27750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.511240 27752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.512408 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:07.513530 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:07.513702 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.513907 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603327513873 us; error 0 us; skew 500 ppm
I20260709 13:22:07.514503 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.516820 17964 webserver.cc:533] Webserver started at http://127.17.139.62:46119/ using document root <none> and password file <none>
I20260709 13:22:07.517436 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.517625 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.517921 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.519014 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "c066bf38383d4cbba8541fb8a2f3f484"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.523545 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:22:07.526842 27757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.527513 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:22:07.527827 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "c066bf38383d4cbba8541fb8a2f3f484"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.528072 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.547070 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.548306 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.586141 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:43315
I20260709 13:22:07.586267 27808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:43315 every 8 connection(s)
I20260709 13:22:07.590101 27809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.600505 27809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484: Bootstrap starting.
I20260709 13:22:07.605329 27809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.609254 27809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484: No bootstrap required, opened a new log
I20260709 13:22:07.611289 27809 raft_consensus.cc:359] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c066bf38383d4cbba8541fb8a2f3f484" member_type: VOTER }
I20260709 13:22:07.611635 27809 raft_consensus.cc:385] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.611817 27809 raft_consensus.cc:740] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c066bf38383d4cbba8541fb8a2f3f484, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.612406 27809 consensus_queue.cc:260] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c066bf38383d4cbba8541fb8a2f3f484" member_type: VOTER }
I20260709 13:22:07.612810 27809 raft_consensus.cc:399] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:07.613019 27809 raft_consensus.cc:493] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:07.613221 27809 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.617749 27809 raft_consensus.cc:515] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c066bf38383d4cbba8541fb8a2f3f484" member_type: VOTER }
I20260709 13:22:07.618191 27809 leader_election.cc:304] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c066bf38383d4cbba8541fb8a2f3f484; no voters: 
I20260709 13:22:07.619257 27809 leader_election.cc:290] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:07.619666 27812 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:07.621079 27812 raft_consensus.cc:697] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 1 LEADER]: Becoming Leader. State: Replica: c066bf38383d4cbba8541fb8a2f3f484, State: Running, Role: LEADER
I20260709 13:22:07.621809 27812 consensus_queue.cc:237] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c066bf38383d4cbba8541fb8a2f3f484" member_type: VOTER }
I20260709 13:22:07.622257 27809 sys_catalog.cc:565] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:07.626767 27814 sys_catalog.cc:455] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c066bf38383d4cbba8541fb8a2f3f484. Latest consensus state: current_term: 1 leader_uuid: "c066bf38383d4cbba8541fb8a2f3f484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c066bf38383d4cbba8541fb8a2f3f484" member_type: VOTER } }
I20260709 13:22:07.627389 27813 sys_catalog.cc:455] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c066bf38383d4cbba8541fb8a2f3f484" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c066bf38383d4cbba8541fb8a2f3f484" member_type: VOTER } }
I20260709 13:22:07.627609 27814 sys_catalog.cc:458] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:07.629273 27813 sys_catalog.cc:458] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:07.629840 27820 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:07.636287 27820 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:07.637292 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:07.644996 27820 catalog_manager.cc:1383] Generated new cluster ID: 605036a093cd4bfa9a1ccde4cb5544c0
I20260709 13:22:07.645264 27820 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:07.674935 27820 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:07.676215 27820 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:07.692950 27820 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484: Generated new TSK 0
I20260709 13:22:07.693598 27820 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:07.703960 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.710325 27830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.711580 27831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.713028 27833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.713152 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:07.714234 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:07.714452 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.714634 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603327714618 us; error 0 us; skew 500 ppm
I20260709 13:22:07.715173 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.717478 17964 webserver.cc:533] Webserver started at http://127.17.139.1:37401/ using document root <none> and password file <none>
I20260709 13:22:07.717984 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.718199 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.718467 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.719517 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "f23d169306d947b69b667a50c44b16d6"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.724117 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:22:07.727406 27838 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.728286 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:07.728616 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "f23d169306d947b69b667a50c44b16d6"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.728962 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.746969 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.748188 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.749683 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:07.751943 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:07.752166 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.752411 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:07.752596 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.793694 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:36807
I20260709 13:22:07.793866 27900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:36807 every 8 connection(s)
I20260709 13:22:07.798808 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.806783 27906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.807700 27905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.809757 27908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.810835 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:07.811869 27901 heartbeater.cc:344] Connected to a master server at 127.17.139.62:43315
I20260709 13:22:07.812058 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:07.812325 27901 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:07.812331 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.812738 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603327812718 us; error 0 us; skew 500 ppm
I20260709 13:22:07.813416 27901 heartbeater.cc:507] Master 127.17.139.62:43315 requested a full tablet report, sending...
I20260709 13:22:07.813591 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.815937 27774 ts_manager.cc:194] Registered new tserver with Master: f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807)
I20260709 13:22:07.816514 17964 webserver.cc:533] Webserver started at http://127.17.139.2:45577/ using document root <none> and password file <none>
I20260709 13:22:07.817112 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.817328 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.817591 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.818141 27774 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37122
I20260709 13:22:07.818840 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "8d539a16778a4f3784e7cd4320df90cf"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.824008 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:07.827303 27913 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.828140 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:07.828454 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "8d539a16778a4f3784e7cd4320df90cf"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.828769 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.851159 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.852332 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.853847 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:07.856007 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:07.856225 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.856468 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:07.856652 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.896674 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:38651
I20260709 13:22:07.896832 27975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:38651 every 8 connection(s)
I20260709 13:22:07.901562 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.908737 27979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.911298 27980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.913265 17964 server_base.cc:1061] running on GCE node
W20260709 13:22:07.913519 27982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.914125 27976 heartbeater.cc:344] Connected to a master server at 127.17.139.62:43315
I20260709 13:22:07.914520 27976 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:07.914654 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:07.914945 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.915138 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603327915120 us; error 0 us; skew 500 ppm
I20260709 13:22:07.915302 27976 heartbeater.cc:507] Master 127.17.139.62:43315 requested a full tablet report, sending...
I20260709 13:22:07.915807 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.917464 27774 ts_manager.cc:194] Registered new tserver with Master: 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651)
I20260709 13:22:07.918744 17964 webserver.cc:533] Webserver started at http://127.17.139.3:39965/ using document root <none> and password file <none>
I20260709 13:22:07.919008 27774 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37132
I20260709 13:22:07.919345 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.919623 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.919920 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.921154 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "73d4221224b04459993846a512cc8b6a"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.925637 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:07.929032 27987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.929831 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:07.930178 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "73d4221224b04459993846a512cc8b6a"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-z675"
I20260709 13:22:07.930475 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.951628 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.952730 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.954171 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:07.956270 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:07.956488 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.956718 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:07.956910 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.998128 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:40639
I20260709 13:22:07.998276 28049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:40639 every 8 connection(s)
I20260709 13:22:08.012012 28050 heartbeater.cc:344] Connected to a master server at 127.17.139.62:43315
I20260709 13:22:08.012444 28050 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:08.013229 28050 heartbeater.cc:507] Master 127.17.139.62:43315 requested a full tablet report, sending...
I20260709 13:22:08.015086 27774 ts_manager.cc:194] Registered new tserver with Master: 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.016044 17964 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014607559s
I20260709 13:22:08.016453 27774 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37142
I20260709 13:22:08.041633 27774 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37144:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:08.043816 27774 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:08.087893 27941 tablet_service.cc:1511] Processing CreateTablet for tablet f2b25f5a52994c53a120db1439d27cbb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4370c7bec72e44a183720304dd017a92]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:08.089346 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b25f5a52994c53a120db1439d27cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.093743 27940 tablet_service.cc:1511] Processing CreateTablet for tablet c57ca5a996644cf787709d76a1ece89a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4370c7bec72e44a183720304dd017a92]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:08.095091 27940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57ca5a996644cf787709d76a1ece89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.101651 28014 tablet_service.cc:1511] Processing CreateTablet for tablet c57ca5a996644cf787709d76a1ece89a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4370c7bec72e44a183720304dd017a92]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:08.103197 28014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57ca5a996644cf787709d76a1ece89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.102941 28015 tablet_service.cc:1511] Processing CreateTablet for tablet f2b25f5a52994c53a120db1439d27cbb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4370c7bec72e44a183720304dd017a92]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:08.104307 28015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b25f5a52994c53a120db1439d27cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.115010 28065 tablet_bootstrap.cc:492] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf: Bootstrap starting.
I20260709 13:22:08.122397 28065 tablet_bootstrap.cc:654] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.124631 28066 tablet_bootstrap.cc:492] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a: Bootstrap starting.
I20260709 13:22:08.124343 27866 tablet_service.cc:1511] Processing CreateTablet for tablet f2b25f5a52994c53a120db1439d27cbb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4370c7bec72e44a183720304dd017a92]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:08.126101 27866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b25f5a52994c53a120db1439d27cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.126238 27865 tablet_service.cc:1511] Processing CreateTablet for tablet c57ca5a996644cf787709d76a1ece89a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4370c7bec72e44a183720304dd017a92]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:08.127580 27865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57ca5a996644cf787709d76a1ece89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.133528 28066 tablet_bootstrap.cc:654] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.134899 28065 tablet_bootstrap.cc:492] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf: No bootstrap required, opened a new log
I20260709 13:22:08.135509 28065 ts_tablet_manager.cc:1403] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:22:08.141144 28065 raft_consensus.cc:359] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.141960 28065 raft_consensus.cc:385] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.142315 28065 raft_consensus.cc:740] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.143319 28065 consensus_queue.cc:260] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.158668 27976 heartbeater.cc:499] Master 127.17.139.62:43315 was elected leader, sending a full tablet report...
I20260709 13:22:08.159545 28066 tablet_bootstrap.cc:492] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a: No bootstrap required, opened a new log
I20260709 13:22:08.160081 28066 ts_tablet_manager.cc:1403] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.022s
I20260709 13:22:08.160418 28070 tablet_bootstrap.cc:492] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6: Bootstrap starting.
I20260709 13:22:08.161243 28065 ts_tablet_manager.cc:1434] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:22:08.162330 28065 tablet_bootstrap.cc:492] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf: Bootstrap starting.
I20260709 13:22:08.163446 28066 raft_consensus.cc:359] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.166245 28066 raft_consensus.cc:385] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.166580 28066 raft_consensus.cc:740] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d4221224b04459993846a512cc8b6a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.167723 28070 tablet_bootstrap.cc:654] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.167893 28066 consensus_queue.cc:260] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.169483 28065 tablet_bootstrap.cc:654] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.178412 28050 heartbeater.cc:499] Master 127.17.139.62:43315 was elected leader, sending a full tablet report...
I20260709 13:22:08.179042 28066 ts_tablet_manager.cc:1434] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.011s
I20260709 13:22:08.180269 28066 tablet_bootstrap.cc:492] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a: Bootstrap starting.
I20260709 13:22:08.180408 28070 tablet_bootstrap.cc:492] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6: No bootstrap required, opened a new log
I20260709 13:22:08.180841 28065 tablet_bootstrap.cc:492] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf: No bootstrap required, opened a new log
I20260709 13:22:08.180968 28070 ts_tablet_manager.cc:1403] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:22:08.181494 28065 ts_tablet_manager.cc:1403] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.013s
I20260709 13:22:08.184242 28070 raft_consensus.cc:359] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.185178 28070 raft_consensus.cc:385] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.184850 28065 raft_consensus.cc:359] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.185635 28070 raft_consensus.cc:740] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.185832 28065 raft_consensus.cc:385] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.186272 28065 raft_consensus.cc:740] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.186761 28070 consensus_queue.cc:260] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.187546 28066 tablet_bootstrap.cc:654] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.187229 28065 consensus_queue.cc:260] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.189738 28065 ts_tablet_manager.cc:1434] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:08.193941 28066 tablet_bootstrap.cc:492] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a: No bootstrap required, opened a new log
I20260709 13:22:08.195578 27901 heartbeater.cc:499] Master 127.17.139.62:43315 was elected leader, sending a full tablet report...
I20260709 13:22:08.196082 28070 ts_tablet_manager.cc:1434] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 13:22:08.197016 28066 ts_tablet_manager.cc:1403] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:22:08.197085 28070 tablet_bootstrap.cc:492] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6: Bootstrap starting.
I20260709 13:22:08.200348 28066 raft_consensus.cc:359] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.201135 28066 raft_consensus.cc:385] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.201511 28066 raft_consensus.cc:740] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d4221224b04459993846a512cc8b6a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.202283 28066 consensus_queue.cc:260] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.204530 28066 ts_tablet_manager.cc:1434] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:22:08.204636 28070 tablet_bootstrap.cc:654] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.209409 28070 tablet_bootstrap.cc:492] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6: No bootstrap required, opened a new log
I20260709 13:22:08.209898 28070 ts_tablet_manager.cc:1403] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.008s
I20260709 13:22:08.212601 28070 raft_consensus.cc:359] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.213323 28070 raft_consensus.cc:385] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.213683 28070 raft_consensus.cc:740] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.214430 28070 consensus_queue.cc:260] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.215982 28070 ts_tablet_manager.cc:1434] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:08.306059 28069 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.306556 28069 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.308511 28069 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639), f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807)
I20260709 13:22:08.317862 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
I20260709 13:22:08.318603 28025 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 0.
I20260709 13:22:08.318670 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f23d169306d947b69b667a50c44b16d6" is_pre_election: true
I20260709 13:22:08.319437 27876 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 0.
I20260709 13:22:08.319587 27916 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:08.320441 28069 raft_consensus.cc:2804] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.320748 28069 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.321079 28069 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.326104 28069 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.327811 28069 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 election: Requested vote from peers 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639), f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807)
I20260709 13:22:08.328600 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:08.328927 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f23d169306d947b69b667a50c44b16d6"
I20260709 13:22:08.329308 28025 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.329579 27876 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.335856 28025 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 1.
I20260709 13:22:08.335983 27876 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 1.
I20260709 13:22:08.337085 27916 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:08.337939 28069 raft_consensus.cc:2804] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.338789 28069 raft_consensus.cc:697] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Becoming Leader. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Running, Role: LEADER
I20260709 13:22:08.339582 28069 consensus_queue.cc:237] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:08.345891 27774 catalog_manager.cc:5697] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2). New cstate: current_term: 1 leader_uuid: "8d539a16778a4f3784e7cd4320df90cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.479933 28069 raft_consensus.cc:493] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.480445 28069 raft_consensus.cc:515] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.482268 28069 leader_election.cc:290] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.483040 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f23d169306d947b69b667a50c44b16d6" is_pre_election: true
I20260709 13:22:08.483294 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
I20260709 13:22:08.483565 28075 raft_consensus.cc:493] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.483911 28025 raft_consensus.cc:2468] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 0.
I20260709 13:22:08.484140 28075 raft_consensus.cc:515] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.485031 27916 leader_election.cc:304] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:08.485183 27876 raft_consensus.cc:2468] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 0.
I20260709 13:22:08.485869 28069 raft_consensus.cc:2804] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.486263 28069 raft_consensus.cc:493] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.486634 28069 raft_consensus.cc:3060] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.490250 28075 leader_election.cc:290] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.494167 28069 raft_consensus.cc:515] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.496913 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f23d169306d947b69b667a50c44b16d6"
I20260709 13:22:08.497190 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:08.497496 27876 raft_consensus.cc:3060] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.497798 28025 raft_consensus.cc:3060] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.500840 28069 leader_election.cc:290] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 election: Requested vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.501734 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf" is_pre_election: true
I20260709 13:22:08.502322 28024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
I20260709 13:22:08.502619 27951 raft_consensus.cc:2393] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f23d169306d947b69b667a50c44b16d6 in current term 1: Already voted for candidate 8d539a16778a4f3784e7cd4320df90cf in this term.
I20260709 13:22:08.504696 28025 raft_consensus.cc:2468] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 1.
I20260709 13:22:08.505255 27839 leader_election.cc:304] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f23d169306d947b69b667a50c44b16d6; no voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf
I20260709 13:22:08.505832 27916 leader_election.cc:304] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:08.506217 27876 raft_consensus.cc:2468] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 1.
I20260709 13:22:08.506628 28069 raft_consensus.cc:2804] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.506757 28075 raft_consensus.cc:2749] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:08.507184 28069 raft_consensus.cc:697] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Becoming Leader. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Running, Role: LEADER
I20260709 13:22:08.507948 28069 consensus_queue.cc:237] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.514484 27774 catalog_manager.cc:5697] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2). New cstate: current_term: 1 leader_uuid: "8d539a16778a4f3784e7cd4320df90cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.573561 27774 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37150:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:08.575430 27774 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:08.597084 27866 tablet_service.cc:1511] Processing CreateTablet for tablet b4b7a51b29574850b16d78c4da0ceb2c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=be8bbcf204c14ab9a436a0291742dfc6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:08.598340 27941 tablet_service.cc:1511] Processing CreateTablet for tablet b4b7a51b29574850b16d78c4da0ceb2c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=be8bbcf204c14ab9a436a0291742dfc6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:08.598372 27866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b7a51b29574850b16d78c4da0ceb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.599671 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b7a51b29574850b16d78c4da0ceb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.599768 28014 tablet_service.cc:1511] Processing CreateTablet for tablet b4b7a51b29574850b16d78c4da0ceb2c (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=be8bbcf204c14ab9a436a0291742dfc6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:08.601126 28014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b7a51b29574850b16d78c4da0ceb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.602159 27865 tablet_service.cc:1511] Processing CreateTablet for tablet 4f66cdb09518487fb9256728bda4b107 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=be8bbcf204c14ab9a436a0291742dfc6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:08.602835 27940 tablet_service.cc:1511] Processing CreateTablet for tablet 4f66cdb09518487fb9256728bda4b107 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=be8bbcf204c14ab9a436a0291742dfc6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:08.604032 27940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f66cdb09518487fb9256728bda4b107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.604588 28015 tablet_service.cc:1511] Processing CreateTablet for tablet 4f66cdb09518487fb9256728bda4b107 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=be8bbcf204c14ab9a436a0291742dfc6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:08.606042 28015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f66cdb09518487fb9256728bda4b107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.613314 27865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f66cdb09518487fb9256728bda4b107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:08.617743 28065 tablet_bootstrap.cc:492] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf: Bootstrap starting.
I20260709 13:22:08.618824 28066 tablet_bootstrap.cc:492] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a: Bootstrap starting.
I20260709 13:22:08.624336 28065 tablet_bootstrap.cc:654] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.625236 28066 tablet_bootstrap.cc:654] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:08.632700 27822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:08.636389 28065 tablet_bootstrap.cc:492] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf: No bootstrap required, opened a new log
I20260709 13:22:08.637002 28065 ts_tablet_manager.cc:1403] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:22:08.638495 28066 tablet_bootstrap.cc:492] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a: No bootstrap required, opened a new log
I20260709 13:22:08.639012 28066 ts_tablet_manager.cc:1403] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.001s
I20260709 13:22:08.640861 28070 tablet_bootstrap.cc:492] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6: Bootstrap starting.
I20260709 13:22:08.640333 28065 raft_consensus.cc:359] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.641423 28065 raft_consensus.cc:385] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.641773 28065 raft_consensus.cc:740] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.642640 28065 consensus_queue.cc:260] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.643543 28066 raft_consensus.cc:359] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.644347 28066 raft_consensus.cc:385] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.644707 28066 raft_consensus.cc:740] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d4221224b04459993846a512cc8b6a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.645615 28066 consensus_queue.cc:260] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.647234 28065 ts_tablet_manager.cc:1434] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:22:08.647500 28070 tablet_bootstrap.cc:654] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.647945 28066 ts_tablet_manager.cc:1434] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:22:08.649070 28066 tablet_bootstrap.cc:492] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a: Bootstrap starting.
I20260709 13:22:08.649245 28065 tablet_bootstrap.cc:492] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf: Bootstrap starting.
I20260709 13:22:08.656111 28070 tablet_bootstrap.cc:492] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6: No bootstrap required, opened a new log
I20260709 13:22:08.656445 28065 tablet_bootstrap.cc:654] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.656745 28070 ts_tablet_manager.cc:1403] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:22:08.657858 28066 tablet_bootstrap.cc:654] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.660122 28070 raft_consensus.cc:359] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.661741 28070 raft_consensus.cc:385] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.662184 28070 raft_consensus.cc:740] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.663219 28070 consensus_queue.cc:260] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.665766 28070 ts_tablet_manager.cc:1434] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:22:08.666836 28070 tablet_bootstrap.cc:492] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6: Bootstrap starting.
I20260709 13:22:08.671074 28065 tablet_bootstrap.cc:492] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf: No bootstrap required, opened a new log
I20260709 13:22:08.671732 28065 ts_tablet_manager.cc:1403] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:22:08.673584 28070 tablet_bootstrap.cc:654] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.674198 28066 tablet_bootstrap.cc:492] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a: No bootstrap required, opened a new log
I20260709 13:22:08.674722 28066 ts_tablet_manager.cc:1403] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.010s
I20260709 13:22:08.676079 28065 raft_consensus.cc:359] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.676829 28065 raft_consensus.cc:385] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.677156 28065 raft_consensus.cc:740] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.678000 28065 consensus_queue.cc:260] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.677821 28066 raft_consensus.cc:359] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.686228 28066 raft_consensus.cc:385] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.686549 28066 raft_consensus.cc:740] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d4221224b04459993846a512cc8b6a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.687168 28065 ts_tablet_manager.cc:1434] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:22:08.687345 28066 consensus_queue.cc:260] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.691496 28066 ts_tablet_manager.cc:1434] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:22:08.692353 28070 tablet_bootstrap.cc:492] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6: No bootstrap required, opened a new log
I20260709 13:22:08.692960 28070 ts_tablet_manager.cc:1403] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.014s
I20260709 13:22:08.695576 28070 raft_consensus.cc:359] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.696292 28070 raft_consensus.cc:385] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.696568 28070 raft_consensus.cc:740] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.697269 28070 consensus_queue.cc:260] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.698911 28070 ts_tablet_manager.cc:1434] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:08.702106 28069 raft_consensus.cc:493] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.702662 28069 raft_consensus.cc:515] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.705397 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f23d169306d947b69b667a50c44b16d6" is_pre_election: true
I20260709 13:22:08.705992 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
I20260709 13:22:08.704738 28069 leader_election.cc:290] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.706086 27876 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 0.
I20260709 13:22:08.706725 28025 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 0.
I20260709 13:22:08.707559 27915 leader_election.cc:304] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d539a16778a4f3784e7cd4320df90cf, f23d169306d947b69b667a50c44b16d6; no voters: 
I20260709 13:22:08.709093 28069 raft_consensus.cc:2804] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.709435 28069 raft_consensus.cc:493] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.709707 28069 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.714423 28069 raft_consensus.cc:515] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.715864 28069 leader_election.cc:290] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 election: Requested vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.716563 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f23d169306d947b69b667a50c44b16d6"
I20260709 13:22:08.716952 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:08.717237 27876 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.717563 28025 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.723956 28025 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 1.
I20260709 13:22:08.723969 27876 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 1.
I20260709 13:22:08.725061 27915 leader_election.cc:304] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d539a16778a4f3784e7cd4320df90cf, f23d169306d947b69b667a50c44b16d6; no voters: 
I20260709 13:22:08.725821 28069 raft_consensus.cc:2804] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.726315 28069 raft_consensus.cc:697] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Becoming Leader. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Running, Role: LEADER
I20260709 13:22:08.727010 28069 consensus_queue.cc:237] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.733697 27772 catalog_manager.cc:5697] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2). New cstate: current_term: 1 leader_uuid: "8d539a16778a4f3784e7cd4320df90cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.765697 28075 raft_consensus.cc:493] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.766517 28075 raft_consensus.cc:515] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.770531 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf" is_pre_election: true
I20260709 13:22:08.771370 27951 raft_consensus.cc:2468] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 0.
I20260709 13:22:08.831717 28075 leader_election.cc:290] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.859030 28069 consensus_queue.cc:1048] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:08.872255 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
I20260709 13:22:08.882155 28025 raft_consensus.cc:2468] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 0.
I20260709 13:22:08.883816 27841 leader_election.cc:304] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, f23d169306d947b69b667a50c44b16d6; no voters: 
I20260709 13:22:08.884907 28075 raft_consensus.cc:2804] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.885351 28075 raft_consensus.cc:493] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.886011 28075 raft_consensus.cc:3060] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.899689 28075 raft_consensus.cc:515] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:08.903631 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:08.904348 28025 raft_consensus.cc:3060] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.918803 28075 leader_election.cc:290] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 1 election: Requested vote from peers 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:08.923139 28025 raft_consensus.cc:2468] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 1.
I20260709 13:22:08.924760 27841 leader_election.cc:304] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, f23d169306d947b69b667a50c44b16d6; no voters: 
I20260709 13:22:08.925899 28075 raft_consensus.cc:2804] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.931972 28075 raft_consensus.cc:697] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 LEADER]: Becoming Leader. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Running, Role: LEADER
I20260709 13:22:08.933842 28075 consensus_queue.cc:237] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:09.199474 28069 consensus_queue.cc:1048] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:09.902621 27822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:09.912806 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
I20260709 13:22:09.913554 27951 raft_consensus.cc:3060] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.921173 27951 raft_consensus.cc:2468] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 1.
I20260709 13:22:09.922812 28075 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:09.923358 28075 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:09.925531 28075 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639), 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651)
I20260709 13:22:09.926159 28102 consensus_queue.cc:1048] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.927536 28102 consensus_queue.cc:1048] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.929541 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf" is_pre_election: true
I20260709 13:22:09.932633 28024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
I20260709 13:22:09.932823 28075 consensus_queue.cc:1048] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.934346 27841 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f23d169306d947b69b667a50c44b16d6; no voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf
I20260709 13:22:09.938234 28103 consensus_queue.cc:1048] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.947139 28107 consensus_queue.cc:1048] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:10.011574 27774 catalog_manager.cc:5697] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f23d169306d947b69b667a50c44b16d6 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "f23d169306d947b69b667a50c44b16d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.019090 28075 consensus_queue.cc:1048] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:10.053723 28100 raft_consensus.cc:2749] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:10.219733 27951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb"
dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
mode: GRACEFUL
new_leader_uuid: "f23d169306d947b69b667a50c44b16d6"
 from {username='slave'} at 127.0.0.1:55608
I20260709 13:22:10.220209 27951 raft_consensus.cc:606] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Received request to transfer leadership to TS f23d169306d947b69b667a50c44b16d6
I20260709 13:22:10.225059 27951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a"
dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
mode: GRACEFUL
new_leader_uuid: "73d4221224b04459993846a512cc8b6a"
 from {username='slave'} at 127.0.0.1:55608
I20260709 13:22:10.225482 27951 raft_consensus.cc:606] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Received request to transfer leadership to TS 73d4221224b04459993846a512cc8b6a
I20260709 13:22:10.233533 27951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107"
dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
mode: GRACEFUL
new_leader_uuid: "f23d169306d947b69b667a50c44b16d6"
 from {username='slave'} at 127.0.0.1:55608
I20260709 13:22:10.233965 27951 raft_consensus.cc:606] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Received request to transfer leadership to TS f23d169306d947b69b667a50c44b16d6
I20260709 13:22:10.307078 28107 raft_consensus.cc:993] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf: : Instructing follower f23d169306d947b69b667a50c44b16d6 to start an election
I20260709 13:22:10.307556 28107 raft_consensus.cc:1081] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Signalling peer f23d169306d947b69b667a50c44b16d6 to start an election
I20260709 13:22:10.309352 27876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb"
dest_uuid: "f23d169306d947b69b667a50c44b16d6"
 from {username='slave'} at 127.0.0.1:58362
I20260709 13:22:10.309913 27876 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:10.310276 27876 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.316756 27876 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:10.318533 27876 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 2 election: Requested vote from peers 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639), 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651)
I20260709 13:22:10.319183 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:10.319517 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
I20260709 13:22:10.319784 28025 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.320147 27951 raft_consensus.cc:3055] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:10.320412 27951 raft_consensus.cc:740] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Running, Role: LEADER
I20260709 13:22:10.321108 27951 consensus_queue.cc:260] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:10.322036 27951 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.324932 28025 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 2.
I20260709 13:22:10.325953 27841 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, f23d169306d947b69b667a50c44b16d6; no voters: 
I20260709 13:22:10.326781 28127 raft_consensus.cc:2804] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:10.327241 28127 raft_consensus.cc:697] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 2 LEADER]: Becoming Leader. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Running, Role: LEADER
I20260709 13:22:10.327694 27951 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 2.
I20260709 13:22:10.328109 28127 consensus_queue.cc:237] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:10.335389 27774 catalog_manager.cc:5697] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 reported cstate change: term changed from 1 to 2, leader changed from 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2) to f23d169306d947b69b667a50c44b16d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "f23d169306d947b69b667a50c44b16d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:10.348241 28103 raft_consensus.cc:993] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf: : Instructing follower f23d169306d947b69b667a50c44b16d6 to start an election
I20260709 13:22:10.348636 28107 raft_consensus.cc:1081] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Signalling peer f23d169306d947b69b667a50c44b16d6 to start an election
I20260709 13:22:10.349999 27876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107"
dest_uuid: "f23d169306d947b69b667a50c44b16d6"
 from {username='slave'} at 127.0.0.1:58362
I20260709 13:22:10.350457 27876 raft_consensus.cc:493] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:10.350744 27876 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.355428 27876 raft_consensus.cc:515] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:10.356961 27876 leader_election.cc:290] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 2 election: Requested vote from peers 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:10.357913 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
I20260709 13:22:10.358163 28025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "f23d169306d947b69b667a50c44b16d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:10.358552 27951 raft_consensus.cc:3055] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:10.358767 28025 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.358997 27951 raft_consensus.cc:740] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Running, Role: LEADER
I20260709 13:22:10.359848 27951 consensus_queue.cc:260] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:10.360790 27951 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.363806 28025 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 2.
I20260709 13:22:10.364934 27841 leader_election.cc:304] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, f23d169306d947b69b667a50c44b16d6; no voters: 
I20260709 13:22:10.365718 28127 raft_consensus.cc:2804] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:10.366020 27951 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f23d169306d947b69b667a50c44b16d6 in term 2.
I20260709 13:22:10.366236 28127 raft_consensus.cc:697] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 2 LEADER]: Becoming Leader. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Running, Role: LEADER
I20260709 13:22:10.367118 28127 consensus_queue.cc:237] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:10.373553 27773 catalog_manager.cc:5697] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 reported cstate change: term changed from 1 to 2, leader changed from 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2) to f23d169306d947b69b667a50c44b16d6 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "f23d169306d947b69b667a50c44b16d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.547158 28103 raft_consensus.cc:993] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf: : Instructing follower 73d4221224b04459993846a512cc8b6a to start an election
I20260709 13:22:10.547681 28107 raft_consensus.cc:1081] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Signalling peer 73d4221224b04459993846a512cc8b6a to start an election
I20260709 13:22:10.549136 28025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a"
dest_uuid: "73d4221224b04459993846a512cc8b6a"
 from {username='slave'} at 127.0.0.1:51304
I20260709 13:22:10.549606 28025 raft_consensus.cc:493] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:10.549923 28025 raft_consensus.cc:3060] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.554677 28025 raft_consensus.cc:515] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:10.556746 28025 leader_election.cc:290] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 2 election: Requested vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651)
I20260709 13:22:10.569705 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "73d4221224b04459993846a512cc8b6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f23d169306d947b69b667a50c44b16d6"
I20260709 13:22:10.570243 27876 raft_consensus.cc:3060] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.570261 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57ca5a996644cf787709d76a1ece89a" candidate_uuid: "73d4221224b04459993846a512cc8b6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
I20260709 13:22:10.570931 27951 raft_consensus.cc:3055] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:10.571266 27951 raft_consensus.cc:740] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Running, Role: LEADER
I20260709 13:22:10.572045 27951 consensus_queue.cc:260] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:10.573288 27951 raft_consensus.cc:3060] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.577402 27876 raft_consensus.cc:2468] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d4221224b04459993846a512cc8b6a in term 2.
I20260709 13:22:10.578631 27989 leader_election.cc:304] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, f23d169306d947b69b667a50c44b16d6; no voters: 
I20260709 13:22:10.579686 27951 raft_consensus.cc:2468] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d4221224b04459993846a512cc8b6a in term 2.
I20260709 13:22:10.580253 28136 raft_consensus.cc:2804] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:10.581271 28136 raft_consensus.cc:697] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 2 LEADER]: Becoming Leader. State: Replica: 73d4221224b04459993846a512cc8b6a, State: Running, Role: LEADER
I20260709 13:22:10.581951 28136 consensus_queue.cc:237] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:10.587894 27774 catalog_manager.cc:5697] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a reported cstate change: term changed from 1 to 2, leader changed from 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2) to 73d4221224b04459993846a512cc8b6a (127.17.139.3). New cstate: current_term: 2 leader_uuid: "73d4221224b04459993846a512cc8b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:10.661291 17964 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:22:10.662784 17964 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:22:10.663167 17964 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:22:10.674310 27876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c"
dest_uuid: "f23d169306d947b69b667a50c44b16d6"
mode: GRACEFUL
new_leader_uuid: "8d539a16778a4f3784e7cd4320df90cf"
 from {username='slave'} at 127.0.0.1:33030
I20260709 13:22:10.674891 27876 raft_consensus.cc:606] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 LEADER]: Received request to transfer leadership to TS 8d539a16778a4f3784e7cd4320df90cf
I20260709 13:22:10.676046 17964 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
W20260709 13:22:10.732699 27897 debug-util.cc:398] Leaking SignalData structure 0x7b0800158740 after lost signal to thread 17967
W20260709 13:22:10.734022 27897 debug-util.cc:398] Leaking SignalData structure 0x7b08002a83a0 after lost signal to thread 27808
W20260709 13:22:10.736603 27897 debug-util.cc:398] Leaking SignalData structure 0x7b08001255c0 after lost signal to thread 28049
I20260709 13:22:10.833623 27951 raft_consensus.cc:1275] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Refusing update from remote peer f23d169306d947b69b667a50c44b16d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.835031 28138 consensus_queue.cc:1048] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.839430 27950 raft_consensus.cc:1275] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Refusing update from remote peer f23d169306d947b69b667a50c44b16d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.841223 28100 consensus_queue.cc:1048] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.849422 28025 raft_consensus.cc:1275] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Refusing update from remote peer f23d169306d947b69b667a50c44b16d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.851425 28138 consensus_queue.cc:1048] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:10.866393 28024 raft_consensus.cc:1275] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Refusing update from remote peer f23d169306d947b69b667a50c44b16d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.868213 28144 consensus_queue.cc:1048] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:10.980969 27876 raft_consensus.cc:1275] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Refusing update from remote peer 73d4221224b04459993846a512cc8b6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.982375 28136 consensus_queue.cc:1048] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.990967 27950 raft_consensus.cc:1275] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Refusing update from remote peer 73d4221224b04459993846a512cc8b6a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.992694 28136 consensus_queue.cc:1048] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.059868 28127 raft_consensus.cc:993] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6: : Instructing follower 8d539a16778a4f3784e7cd4320df90cf to start an election
I20260709 13:22:11.060405 28144 raft_consensus.cc:1081] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 LEADER]: Signalling peer 8d539a16778a4f3784e7cd4320df90cf to start an election
I20260709 13:22:11.062024 27950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c"
dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
 from {username='slave'} at 127.0.0.1:57160
I20260709 13:22:11.062513 27950 raft_consensus.cc:493] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.062842 27950 raft_consensus.cc:3060] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.068116 27950 raft_consensus.cc:515] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:11.070118 27950 leader_election.cc:290] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 2 election: Requested vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:11.070887 27876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f23d169306d947b69b667a50c44b16d6"
I20260709 13:22:11.071524 28024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b7a51b29574850b16d78c4da0ceb2c" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:11.071573 27876 raft_consensus.cc:3055] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.072248 28024 raft_consensus.cc:3060] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.072211 27876 raft_consensus.cc:740] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f23d169306d947b69b667a50c44b16d6, State: Running, Role: LEADER
I20260709 13:22:11.073323 27876 consensus_queue.cc:260] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:11.074709 27876 raft_consensus.cc:3060] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.080192 28024 raft_consensus.cc:2468] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 2.
I20260709 13:22:11.081525 27916 leader_election.cc:304] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:11.082003 27876 raft_consensus.cc:2468] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 2.
I20260709 13:22:11.082413 28107 raft_consensus.cc:2804] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.083580 28107 raft_consensus.cc:697] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 2 LEADER]: Becoming Leader. State: Replica: 8d539a16778a4f3784e7cd4320df90cf, State: Running, Role: LEADER
I20260709 13:22:11.084470 28107 consensus_queue.cc:237] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:11.092051 27772 catalog_manager.cc:5697] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf reported cstate change: term changed from 1 to 2, leader changed from f23d169306d947b69b667a50c44b16d6 (127.17.139.1) to 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2). New cstate: current_term: 2 leader_uuid: "8d539a16778a4f3784e7cd4320df90cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:11.298689 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
I20260709 13:22:11.323540 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:11.324245 17964 tablet_replica.cc:333] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6: stopping tablet replica
I20260709 13:22:11.324944 17964 raft_consensus.cc:2243] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.325863 17964 raft_consensus.cc:2272] T 4f66cdb09518487fb9256728bda4b107 P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.328303 17964 tablet_replica.cc:333] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6: stopping tablet replica
I20260709 13:22:11.328929 17964 raft_consensus.cc:2243] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.329316 17964 raft_consensus.cc:2272] T b4b7a51b29574850b16d78c4da0ceb2c P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.331092 17964 tablet_replica.cc:333] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6: stopping tablet replica
I20260709 13:22:11.331570 17964 raft_consensus.cc:2243] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.331972 17964 raft_consensus.cc:2272] T c57ca5a996644cf787709d76a1ece89a P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.334125 17964 tablet_replica.cc:333] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6: stopping tablet replica
I20260709 13:22:11.334609 17964 raft_consensus.cc:2243] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.335340 17964 raft_consensus.cc:2272] T f2b25f5a52994c53a120db1439d27cbb P f23d169306d947b69b667a50c44b16d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.487892 27989 consensus_peers.cc:597] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a -> Peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Couldn't send request to peer f23d169306d947b69b667a50c44b16d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:11.589715 28024 raft_consensus.cc:1275] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Refusing update from remote peer 8d539a16778a4f3784e7cd4320df90cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.591109 28107 consensus_queue.cc:1048] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:11.620338 27915 consensus_peers.cc:597] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf -> Peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Couldn't send request to peer f23d169306d947b69b667a50c44b16d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:12.199232 27915 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260709 13:22:12.344177 28107 raft_consensus.cc:493] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f23d169306d947b69b667a50c44b16d6)
I20260709 13:22:12.344750 28107 raft_consensus.cc:515] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:12.346532 28107 leader_election.cc:290] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639)
I20260709 13:22:12.347748 28024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
W20260709 13:22:12.348634 17964 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27897)
W20260709 13:22:12.351007 27915 leader_election.cc:336] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111)
I20260709 13:22:12.351533 27915 leader_election.cc:304] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d539a16778a4f3784e7cd4320df90cf; no voters: 73d4221224b04459993846a512cc8b6a, f23d169306d947b69b667a50c44b16d6
I20260709 13:22:12.352312 28107 raft_consensus.cc:2749] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:12.355576 28157 raft_consensus.cc:493] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f23d169306d947b69b667a50c44b16d6)
I20260709 13:22:12.356122 28157 raft_consensus.cc:515] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:12.357990 28157 leader_election.cc:290] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651)
I20260709 13:22:12.359164 27950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "73d4221224b04459993846a512cc8b6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf" is_pre_election: true
I20260709 13:22:12.359822 27950 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d4221224b04459993846a512cc8b6a in term 2.
I20260709 13:22:12.360874 27988 leader_election.cc:304] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:12.361680 28157 raft_consensus.cc:2804] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:22:12.361956 27989 leader_election.cc:336] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111)
I20260709 13:22:12.362056 28157 raft_consensus.cc:493] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f23d169306d947b69b667a50c44b16d6)
I20260709 13:22:12.362600 28157 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:12.371042 28157 raft_consensus.cc:515] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:12.373083 28157 leader_election.cc:290] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 election: Requested vote from peers f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807), 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651)
I20260709 13:22:12.374230 27950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f66cdb09518487fb9256728bda4b107" candidate_uuid: "73d4221224b04459993846a512cc8b6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
I20260709 13:22:12.374872 27950 raft_consensus.cc:3060] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:12.376680 27989 leader_election.cc:336] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111)
I20260709 13:22:12.382302 27950 raft_consensus.cc:2468] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d4221224b04459993846a512cc8b6a in term 3.
I20260709 13:22:12.383484 27988 leader_election.cc:304] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: f23d169306d947b69b667a50c44b16d6
I20260709 13:22:12.384186 28157 raft_consensus.cc:2804] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:12.384698 28157 raft_consensus.cc:697] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 3 LEADER]: Becoming Leader. State: Replica: 73d4221224b04459993846a512cc8b6a, State: Running, Role: LEADER
I20260709 13:22:12.385601 28157 consensus_queue.cc:237] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } }
I20260709 13:22:12.393793 27772 catalog_manager.cc:5697] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a reported cstate change: term changed from 2 to 3, leader changed from f23d169306d947b69b667a50c44b16d6 (127.17.139.1) to 73d4221224b04459993846a512cc8b6a (127.17.139.3). New cstate: current_term: 3 leader_uuid: "73d4221224b04459993846a512cc8b6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:12.755637 28157 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f23d169306d947b69b667a50c44b16d6)
I20260709 13:22:12.756963 28107 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f23d169306d947b69b667a50c44b16d6)
I20260709 13:22:12.756799 28157 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:12.757961 28107 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:12.760028 28157 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651), f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807)
I20260709 13:22:12.761240 28107 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639), f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807)
I20260709 13:22:12.761999 28024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a" is_pre_election: true
I20260709 13:22:12.762918 27950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "73d4221224b04459993846a512cc8b6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf" is_pre_election: true
I20260709 13:22:12.763003 28024 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d539a16778a4f3784e7cd4320df90cf in term 2.
I20260709 13:22:12.763720 27950 raft_consensus.cc:2468] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d4221224b04459993846a512cc8b6a in term 2.
I20260709 13:22:12.765455 27916 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:12.765836 27988 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d4221224b04459993846a512cc8b6a, 8d539a16778a4f3784e7cd4320df90cf; no voters: 
I20260709 13:22:12.766535 28107 raft_consensus.cc:2804] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:12.766909 28107 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader f23d169306d947b69b667a50c44b16d6)
I20260709 13:22:12.767416 28107 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:12.767738 28157 raft_consensus.cc:2804] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:12.768270 28157 raft_consensus.cc:493] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f23d169306d947b69b667a50c44b16d6)
I20260709 13:22:12.768728 28157 raft_consensus.cc:3060] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:12.770435 27915 leader_election.cc:336] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111)
W20260709 13:22:12.767060 27989 leader_election.cc:336] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111)
I20260709 13:22:12.777165 28107 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:12.778916 28107 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 election: Requested vote from peers 73d4221224b04459993846a512cc8b6a (127.17.139.3:40639), f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807)
I20260709 13:22:12.779750 28024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "8d539a16778a4f3784e7cd4320df90cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73d4221224b04459993846a512cc8b6a"
I20260709 13:22:12.780659 28157 raft_consensus.cc:515] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d4221224b04459993846a512cc8b6a" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40639 } } peers { permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 } } peers { permanent_uuid: "f23d169306d947b69b667a50c44b16d6" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 36807 } }
I20260709 13:22:12.781975 28024 raft_consensus.cc:2393] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d539a16778a4f3784e7cd4320df90cf in current term 3: Already voted for candidate 73d4221224b04459993846a512cc8b6a in this term.
I20260709 13:22:12.783753 28157 leader_election.cc:290] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 election: Requested vote from peers 8d539a16778a4f3784e7cd4320df90cf (127.17.139.2:38651), f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807)
W20260709 13:22:12.785040 27915 leader_election.cc:336] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111)
I20260709 13:22:12.787845 27916 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d539a16778a4f3784e7cd4320df90cf; no voters: 73d4221224b04459993846a512cc8b6a, f23d169306d947b69b667a50c44b16d6
I20260709 13:22:12.789103 28107 raft_consensus.cc:2749] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:22:12.789134 27989 leader_election.cc:336] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111)
I20260709 13:22:12.789216 27950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b25f5a52994c53a120db1439d27cbb" candidate_uuid: "73d4221224b04459993846a512cc8b6a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8d539a16778a4f3784e7cd4320df90cf"
I20260709 13:22:12.790449 27950 raft_consensus.cc:2393] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d4221224b04459993846a512cc8b6a in current term 3: Already voted for candidate 8d539a16778a4f3784e7cd4320df90cf in this term.
I20260709 13:22:12.791425 27988 leader_election.cc:304] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d4221224b04459993846a512cc8b6a; no voters: 8d539a16778a4f3784e7cd4320df90cf, f23d169306d947b69b667a50c44b16d6
I20260709 13:22:12.792248 28157 raft_consensus.cc:2749] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:22:12.842137 27989 consensus_peers.cc:597] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a -> Peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Couldn't send request to peer f23d169306d947b69b667a50c44b16d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:12.990329 27950 raft_consensus.cc:1275] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Refusing update from remote peer 73d4221224b04459993846a512cc8b6a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:12.991911 28157 consensus_queue.cc:1048] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d539a16778a4f3784e7cd4320df90cf" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 38651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:22:13.349242 17964 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27897)
W20260709 13:22:13.900517 27989 consensus_peers.cc:597] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a -> Peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Couldn't send request to peer f23d169306d947b69b667a50c44b16d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:14.319881 27915 consensus_peers.cc:597] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf -> Peer f23d169306d947b69b667a50c44b16d6 (127.17.139.1:36807): Couldn't send request to peer f23d169306d947b69b667a50c44b16d6. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:36807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:14.349689 17964 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 27897)
I20260709 13:22:14.419495 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
I20260709 13:22:14.449098 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
I20260709 13:22:14.474341 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:14.475066 17964 tablet_replica.cc:333] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf: stopping tablet replica
I20260709 13:22:14.475883 17964 raft_consensus.cc:2243] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.476372 17964 raft_consensus.cc:2272] T 4f66cdb09518487fb9256728bda4b107 P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.478798 17964 tablet_replica.cc:333] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf: stopping tablet replica
I20260709 13:22:14.479302 17964 raft_consensus.cc:2243] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.480216 17964 raft_consensus.cc:2272] T b4b7a51b29574850b16d78c4da0ceb2c P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.482678 17964 tablet_replica.cc:333] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf: stopping tablet replica
I20260709 13:22:14.483258 17964 raft_consensus.cc:2243] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.483758 17964 raft_consensus.cc:2272] T c57ca5a996644cf787709d76a1ece89a P 8d539a16778a4f3784e7cd4320df90cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.486254 17964 tablet_replica.cc:333] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf: stopping tablet replica
I20260709 13:22:14.486737 17964 raft_consensus.cc:2243] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.487200 17964 raft_consensus.cc:2272] T f2b25f5a52994c53a120db1439d27cbb P 8d539a16778a4f3784e7cd4320df90cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.513442 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
I20260709 13:22:14.532346 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
I20260709 13:22:14.555562 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:14.556314 17964 tablet_replica.cc:333] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a: stopping tablet replica
I20260709 13:22:14.557157 17964 raft_consensus.cc:2243] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.558194 17964 raft_consensus.cc:2272] T 4f66cdb09518487fb9256728bda4b107 P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.560647 17964 tablet_replica.cc:333] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a: stopping tablet replica
I20260709 13:22:14.561250 17964 raft_consensus.cc:2243] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.561717 17964 raft_consensus.cc:2272] T b4b7a51b29574850b16d78c4da0ceb2c P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.564064 17964 tablet_replica.cc:333] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a: stopping tablet replica
I20260709 13:22:14.564584 17964 raft_consensus.cc:2243] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.565586 17964 raft_consensus.cc:2272] T c57ca5a996644cf787709d76a1ece89a P 73d4221224b04459993846a512cc8b6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.567819 17964 tablet_replica.cc:333] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a: stopping tablet replica
I20260709 13:22:14.568301 17964 raft_consensus.cc:2243] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.568715 17964 raft_consensus.cc:2272] T f2b25f5a52994c53a120db1439d27cbb P 73d4221224b04459993846a512cc8b6a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.594199 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
I20260709 13:22:14.613207 17964 master.cc:562] Master@127.17.139.62:43315 shutting down...
I20260709 13:22:14.633993 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.634600 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.634897 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P c066bf38383d4cbba8541fb8a2f3f484: stopping tablet replica
I20260709 13:22:14.654635 17964 master.cc:584] Master@127.17.139.62:43315 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (7194 ms)
[----------] 6 tests from LeaderRebalancerTest (281316 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:22:14.699328 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:33385
I20260709 13:22:14.700726 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:14.706722 28187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.707121 28190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.706697 28188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:14.709339 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:14.710242 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:14.710446 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:14.710599 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603334710586 us; error 0 us; skew 500 ppm
I20260709 13:22:14.711205 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:14.713754 17964 webserver.cc:533] Webserver started at http://127.17.139.62:44777/ using document root <none> and password file <none>
I20260709 13:22:14.714243 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:14.714437 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:14.714718 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:14.715839 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "af33ebd91dbe449d954e3d9fd17d794f"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-z675"
I20260709 13:22:14.720252 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:14.723611 28195 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.724323 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:14.724614 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "af33ebd91dbe449d954e3d9fd17d794f"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-z675"
I20260709 13:22:14.724944 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:14.734175 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:14.735351 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:14.773273 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:33385
I20260709 13:22:14.773381 28246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:33385 every 8 connection(s)
I20260709 13:22:14.777290 28247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.788846 28247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f: Bootstrap starting.
I20260709 13:22:14.793816 28247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.798164 28247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f: No bootstrap required, opened a new log
I20260709 13:22:14.800369 28247 raft_consensus.cc:359] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af33ebd91dbe449d954e3d9fd17d794f" member_type: VOTER }
I20260709 13:22:14.800722 28247 raft_consensus.cc:385] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.801034 28247 raft_consensus.cc:740] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af33ebd91dbe449d954e3d9fd17d794f, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.801723 28247 consensus_queue.cc:260] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af33ebd91dbe449d954e3d9fd17d794f" member_type: VOTER }
I20260709 13:22:14.802176 28247 raft_consensus.cc:399] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:14.802403 28247 raft_consensus.cc:493] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:14.802675 28247 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.807370 28247 raft_consensus.cc:515] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af33ebd91dbe449d954e3d9fd17d794f" member_type: VOTER }
I20260709 13:22:14.807869 28247 leader_election.cc:304] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af33ebd91dbe449d954e3d9fd17d794f; no voters: 
I20260709 13:22:14.809088 28247 leader_election.cc:290] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:14.809444 28250 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.810783 28250 raft_consensus.cc:697] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 1 LEADER]: Becoming Leader. State: Replica: af33ebd91dbe449d954e3d9fd17d794f, State: Running, Role: LEADER
I20260709 13:22:14.811528 28250 consensus_queue.cc:237] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af33ebd91dbe449d954e3d9fd17d794f" member_type: VOTER }
I20260709 13:22:14.812045 28247 sys_catalog.cc:565] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:14.816155 28252 sys_catalog.cc:455] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [sys.catalog]: SysCatalogTable state changed. Reason: New leader af33ebd91dbe449d954e3d9fd17d794f. Latest consensus state: current_term: 1 leader_uuid: "af33ebd91dbe449d954e3d9fd17d794f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af33ebd91dbe449d954e3d9fd17d794f" member_type: VOTER } }
I20260709 13:22:14.816185 28251 sys_catalog.cc:455] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af33ebd91dbe449d954e3d9fd17d794f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af33ebd91dbe449d954e3d9fd17d794f" member_type: VOTER } }
I20260709 13:22:14.817039 28252 sys_catalog.cc:458] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:14.817065 28251 sys_catalog.cc:458] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:14.820344 28258 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:14.828102 28258 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:14.829183 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:14.836990 28258 catalog_manager.cc:1383] Generated new cluster ID: bfd6480eb38140de9336311a0341ea58
I20260709 13:22:14.837289 28258 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:14.864032 28258 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:14.865468 28258 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:14.878798 28258 catalog_manager.cc:6070] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f: Generated new TSK 0
I20260709 13:22:14.879429 28258 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:14.895908 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:14.902050 28268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.903122 28269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.904172 28271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:14.905252 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:14.906108 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:14.906281 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:14.906479 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603334906445 us; error 0 us; skew 500 ppm
I20260709 13:22:14.907017 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:14.909325 17964 webserver.cc:533] Webserver started at http://127.17.139.1:44865/ using document root <none> and password file <none>
I20260709 13:22:14.909809 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:14.910007 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:14.910287 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:14.911381 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "2b5c647a9d774626be162778d230192b"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-z675"
I20260709 13:22:14.916036 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:22:14.919407 28276 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.920104 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:14.920404 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "2b5c647a9d774626be162778d230192b"
format_stamp: "Formatted at 2026-07-09 13:22:14 on dist-test-slave-z675"
I20260709 13:22:14.920675 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:14.938629 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:14.939808 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:14.941268 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:14.943552 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:14.943764 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.944015 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:14.944203 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:14.985024 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:38227
I20260709 13:22:14.985118 28338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:38227 every 8 connection(s)
I20260709 13:22:14.990092 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:14.998136 28343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:14.998991 28344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.001107 28346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.002308 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:15.003750 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:15.003968 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.004177 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603335004157 us; error 0 us; skew 500 ppm
I20260709 13:22:15.004722 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.008031 17964 webserver.cc:533] Webserver started at http://127.17.139.2:40799/ using document root <none> and password file <none>
I20260709 13:22:15.008597 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.008637 28339 heartbeater.cc:344] Connected to a master server at 127.17.139.62:33385
I20260709 13:22:15.008806 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.009194 28339 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:15.009250 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.010057 28339 heartbeater.cc:507] Master 127.17.139.62:33385 requested a full tablet report, sending...
I20260709 13:22:15.010694 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "b3cbce46d4d34801b930867d57fd971a"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-z675"
I20260709 13:22:15.012214 28212 ts_manager.cc:194] Registered new tserver with Master: 2b5c647a9d774626be162778d230192b (127.17.139.1:38227)
I20260709 13:22:15.014231 28212 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54952
I20260709 13:22:15.015703 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:15.019379 28351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.020068 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:15.020357 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "b3cbce46d4d34801b930867d57fd971a"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-z675"
I20260709 13:22:15.020614 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.041352 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.042490 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.043893 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:15.046067 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:15.046239 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.046542 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:15.046701 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.086365 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:42347
I20260709 13:22:15.086524 28413 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:42347 every 8 connection(s)
I20260709 13:22:15.091566 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:15.098016 28417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.098881 28418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.102082 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:15.104257 28414 heartbeater.cc:344] Connected to a master server at 127.17.139.62:33385
W20260709 13:22:15.104455 28421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.104691 28414 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:15.105531 28414 heartbeater.cc:507] Master 127.17.139.62:33385 requested a full tablet report, sending...
I20260709 13:22:15.105580 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:15.105887 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.106076 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603335106056 us; error 0 us; skew 500 ppm
I20260709 13:22:15.106880 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.107642 28212 ts_manager.cc:194] Registered new tserver with Master: b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:15.109388 17964 webserver.cc:533] Webserver started at http://127.17.139.3:41209/ using document root <none> and password file <none>
I20260709 13:22:15.109499 28212 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54960
I20260709 13:22:15.109973 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.110203 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.110536 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.111764 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "238ba152154c47ca9d461295041ff4cb"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-z675"
I20260709 13:22:15.116379 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:22:15.119791 28425 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.120575 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:15.120936 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "238ba152154c47ca9d461295041ff4cb"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-z675"
I20260709 13:22:15.121284 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.150169 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.151386 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.152864 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:15.155094 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:15.155323 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.155601 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:15.155781 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.195137 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:40815
I20260709 13:22:15.195254 28487 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:40815 every 8 connection(s)
I20260709 13:22:15.209021 28488 heartbeater.cc:344] Connected to a master server at 127.17.139.62:33385
I20260709 13:22:15.209471 28488 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:15.210143 28488 heartbeater.cc:507] Master 127.17.139.62:33385 requested a full tablet report, sending...
I20260709 13:22:15.212122 28212 ts_manager.cc:194] Registered new tserver with Master: 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.212957 17964 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014661298s
I20260709 13:22:15.213752 28212 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54968
I20260709 13:22:15.238868 28212 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54972:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:15.241712 28212 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:15.313681 28379 tablet_service.cc:1511] Processing CreateTablet for tablet fef5f9b8141a4dd49ee1ff50783020f5 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:15.315179 28379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef5f9b8141a4dd49ee1ff50783020f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.315974 28378 tablet_service.cc:1511] Processing CreateTablet for tablet 8418cdfa88484445a1973deb11358a64 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:15.317400 28378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8418cdfa88484445a1973deb11358a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.318413 28375 tablet_service.cc:1511] Processing CreateTablet for tablet 80bbdc1e691947f0aa4edd44f98f217f (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:15.319890 28375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bbdc1e691947f0aa4edd44f98f217f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.320933 28302 tablet_service.cc:1511] Processing CreateTablet for tablet 76a02b35be0345f2962b1d827e15e1ce (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:15.321623 28301 tablet_service.cc:1511] Processing CreateTablet for tablet a111e1284a664153bf0e70987a47e7a9 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:15.322333 28303 tablet_service.cc:1511] Processing CreateTablet for tablet 8418cdfa88484445a1973deb11358a64 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:15.322681 28376 tablet_service.cc:1511] Processing CreateTablet for tablet a111e1284a664153bf0e70987a47e7a9 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:15.324079 28376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a111e1284a664153bf0e70987a47e7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.320478 28374 tablet_service.cc:1511] Processing CreateTablet for tablet 8d655cb4c3c84af58e4a6fad1f289c40 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:15.323982 28299 tablet_service.cc:1511] Processing CreateTablet for tablet 8d655cb4c3c84af58e4a6fad1f289c40 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:15.324285 28377 tablet_service.cc:1511] Processing CreateTablet for tablet 76a02b35be0345f2962b1d827e15e1ce (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:15.325245 28374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d655cb4c3c84af58e4a6fad1f289c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.325930 28377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a02b35be0345f2962b1d827e15e1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.326409 28300 tablet_service.cc:1511] Processing CreateTablet for tablet 80bbdc1e691947f0aa4edd44f98f217f (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:15.328665 28453 tablet_service.cc:1511] Processing CreateTablet for tablet fef5f9b8141a4dd49ee1ff50783020f5 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:15.324150 28304 tablet_service.cc:1511] Processing CreateTablet for tablet fef5f9b8141a4dd49ee1ff50783020f5 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:15.335060 28453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef5f9b8141a4dd49ee1ff50783020f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.333500 28449 tablet_service.cc:1511] Processing CreateTablet for tablet 80bbdc1e691947f0aa4edd44f98f217f (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:15.336633 28449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bbdc1e691947f0aa4edd44f98f217f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.328773 28452 tablet_service.cc:1511] Processing CreateTablet for tablet 8418cdfa88484445a1973deb11358a64 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:15.337765 28452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8418cdfa88484445a1973deb11358a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.330157 28451 tablet_service.cc:1511] Processing CreateTablet for tablet 76a02b35be0345f2962b1d827e15e1ce (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:15.341944 28451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a02b35be0345f2962b1d827e15e1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.331722 28450 tablet_service.cc:1511] Processing CreateTablet for tablet a111e1284a664153bf0e70987a47e7a9 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:15.344858 28450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a111e1284a664153bf0e70987a47e7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.322369 28302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a02b35be0345f2962b1d827e15e1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.353637 28303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8418cdfa88484445a1973deb11358a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.355504 28304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef5f9b8141a4dd49ee1ff50783020f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.357193 28301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a111e1284a664153bf0e70987a47e7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.361177 28299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d655cb4c3c84af58e4a6fad1f289c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.365175 28300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bbdc1e691947f0aa4edd44f98f217f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.367607 28298 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba96465c2fa41848022f2ead1233c34 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:15.371013 28298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba96465c2fa41848022f2ead1233c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.371798 28297 tablet_service.cc:1511] Processing CreateTablet for tablet fd18235ba6304fdd9b8365620bc31545 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:15.374158 28297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd18235ba6304fdd9b8365620bc31545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.375013 28448 tablet_service.cc:1511] Processing CreateTablet for tablet 8d655cb4c3c84af58e4a6fad1f289c40 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:15.376713 28377 tablet_service.cc:1511] Processing CreateTablet for tablet fd18235ba6304fdd9b8365620bc31545 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:15.377998 28377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd18235ba6304fdd9b8365620bc31545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.381955 28373 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa85e395a184869b2b6bb699647d534 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:15.385130 28379 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba96465c2fa41848022f2ead1233c34 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:15.385778 28373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa85e395a184869b2b6bb699647d534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.386857 28379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba96465c2fa41848022f2ead1233c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.378947 28447 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba96465c2fa41848022f2ead1233c34 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:15.381013 28446 tablet_service.cc:1511] Processing CreateTablet for tablet fd18235ba6304fdd9b8365620bc31545 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:15.384343 28445 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa85e395a184869b2b6bb699647d534 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:15.376842 28448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d655cb4c3c84af58e4a6fad1f289c40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.380003 28296 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa85e395a184869b2b6bb699647d534 (DEFAULT_TABLE table=test-workload [id=5cc744aba6c34c608301abb393b2ab7e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:15.391875 28296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa85e395a184869b2b6bb699647d534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.397199 28445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa85e395a184869b2b6bb699647d534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.401202 28446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd18235ba6304fdd9b8365620bc31545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.403321 28447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba96465c2fa41848022f2ead1233c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.432755 28503 tablet_bootstrap.cc:492] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.459484 28503 tablet_bootstrap.cc:654] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.474377 28505 tablet_bootstrap.cc:492] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.474704 28504 tablet_bootstrap.cc:492] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.496263 28504 tablet_bootstrap.cc:654] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.502401 28505 tablet_bootstrap.cc:654] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.513437 28504 tablet_bootstrap.cc:492] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:15.513428 28503 tablet_bootstrap.cc:492] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.514088 28504 ts_tablet_manager.cc:1403] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.013s
I20260709 13:22:15.514163 28503 ts_tablet_manager.cc:1403] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.082s	user 0.002s	sys 0.010s
I20260709 13:22:15.516947 28503 raft_consensus.cc:359] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.517650 28503 raft_consensus.cc:385] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.517299 28504 raft_consensus.cc:359] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.517940 28503 raft_consensus.cc:740] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.517957 28505 tablet_bootstrap.cc:492] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.518164 28504 raft_consensus.cc:385] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.518625 28504 raft_consensus.cc:740] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.518705 28505 ts_tablet_manager.cc:1403] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.006s
I20260709 13:22:15.519021 28503 consensus_queue.cc:260] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.519450 28504 consensus_queue.cc:260] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.521447 28414 heartbeater.cc:499] Master 127.17.139.62:33385 was elected leader, sending a full tablet report...
I20260709 13:22:15.522047 28503 ts_tablet_manager.cc:1434] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:15.522167 28505 raft_consensus.cc:359] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.523181 28503 tablet_bootstrap.cc:492] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.523253 28505 raft_consensus.cc:385] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.523895 28505 raft_consensus.cc:740] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.524832 28505 consensus_queue.cc:260] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.529924 28503 tablet_bootstrap.cc:654] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.532481 28505 ts_tablet_manager.cc:1434] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:22:15.533453 28339 heartbeater.cc:499] Master 127.17.139.62:33385 was elected leader, sending a full tablet report...
I20260709 13:22:15.541822 28503 tablet_bootstrap.cc:492] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.542464 28503 ts_tablet_manager.cc:1403] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:22:15.544478 28505 tablet_bootstrap.cc:492] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.545684 28503 raft_consensus.cc:359] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.546519 28503 raft_consensus.cc:385] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.546830 28503 raft_consensus.cc:740] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.547783 28503 consensus_queue.cc:260] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.550269 28503 ts_tablet_manager.cc:1434] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:15.551283 28503 tablet_bootstrap.cc:492] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.554307 28488 heartbeater.cc:499] Master 127.17.139.62:33385 was elected leader, sending a full tablet report...
I20260709 13:22:15.555091 28505 tablet_bootstrap.cc:654] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.557710 28503 tablet_bootstrap.cc:654] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.566900 28505 tablet_bootstrap.cc:492] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.567440 28505 ts_tablet_manager.cc:1403] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.011s
I20260709 13:22:15.568711 28504 ts_tablet_manager.cc:1434] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.031s
I20260709 13:22:15.569157 28503 tablet_bootstrap.cc:492] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.569715 28503 ts_tablet_manager.cc:1403] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:22:15.569864 28504 tablet_bootstrap.cc:492] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.570382 28505 raft_consensus.cc:359] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.571187 28505 raft_consensus.cc:385] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.571466 28505 raft_consensus.cc:740] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.572468 28505 consensus_queue.cc:260] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.572781 28503 raft_consensus.cc:359] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.573589 28503 raft_consensus.cc:385] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.573915 28503 raft_consensus.cc:740] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.575026 28505 ts_tablet_manager.cc:1434] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:22:15.574667 28503 consensus_queue.cc:260] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.576086 28505 tablet_bootstrap.cc:492] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.576982 28503 ts_tablet_manager.cc:1434] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:15.577102 28504 tablet_bootstrap.cc:654] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.578042 28503 tablet_bootstrap.cc:492] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.584364 28505 tablet_bootstrap.cc:654] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.584832 28503 tablet_bootstrap.cc:654] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.591115 28504 tablet_bootstrap.cc:492] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:15.591630 28504 ts_tablet_manager.cc:1403] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:22:15.593009 28505 tablet_bootstrap.cc:492] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.593549 28505 ts_tablet_manager.cc:1403] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:22:15.594611 28504 raft_consensus.cc:359] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.595372 28504 raft_consensus.cc:385] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.595691 28504 raft_consensus.cc:740] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.596453 28505 raft_consensus.cc:359] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.596586 28504 consensus_queue.cc:260] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.597386 28505 raft_consensus.cc:385] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.597707 28505 raft_consensus.cc:740] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.598465 28505 consensus_queue.cc:260] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.599310 28504 ts_tablet_manager.cc:1434] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:15.600713 28505 ts_tablet_manager.cc:1434] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:15.602345 28504 tablet_bootstrap.cc:492] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.602886 28505 tablet_bootstrap.cc:492] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.606540 28503 tablet_bootstrap.cc:492] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.607060 28503 ts_tablet_manager.cc:1403] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.008s
I20260709 13:22:15.609609 28504 tablet_bootstrap.cc:654] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.610016 28505 tablet_bootstrap.cc:654] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.610021 28503 raft_consensus.cc:359] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.611011 28503 raft_consensus.cc:385] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.611340 28503 raft_consensus.cc:740] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.612241 28503 consensus_queue.cc:260] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.617523 28503 ts_tablet_manager.cc:1434] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:22:15.618614 28503 tablet_bootstrap.cc:492] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.622895 28511 raft_consensus.cc:493] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.623486 28504 tablet_bootstrap.cc:492] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:15.623435 28511 raft_consensus.cc:515] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.624063 28504 ts_tablet_manager.cc:1403] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:22:15.627416 28504 raft_consensus.cc:359] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.628108 28504 raft_consensus.cc:385] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.628418 28504 raft_consensus.cc:740] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.628516 28511 leader_election.cc:290] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.629426 28503 tablet_bootstrap.cc:654] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.629380 28504 consensus_queue.cc:260] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.636837 28504 ts_tablet_manager.cc:1434] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:15.638038 28504 tablet_bootstrap.cc:492] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.645588 28503 tablet_bootstrap.cc:492] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.646128 28503 ts_tablet_manager.cc:1403] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.011s
I20260709 13:22:15.646960 28505 tablet_bootstrap.cc:492] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.647516 28505 ts_tablet_manager.cc:1403] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.004s
I20260709 13:22:15.649029 28503 raft_consensus.cc:359] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.649832 28504 tablet_bootstrap.cc:654] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.649875 28503 raft_consensus.cc:385] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.650638 28503 raft_consensus.cc:740] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.651599 28503 consensus_queue.cc:260] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.654040 28510 raft_consensus.cc:493] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.654539 28510 raft_consensus.cc:515] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.656066 28503 ts_tablet_manager.cc:1434] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:15.657241 28503 tablet_bootstrap.cc:492] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.660420 28510 leader_election.cc:290] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:15.664505 28505 raft_consensus.cc:359] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.665309 28505 raft_consensus.cc:385] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.665620 28505 raft_consensus.cc:740] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.666422 28505 consensus_queue.cc:260] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.671319 28503 tablet_bootstrap.cc:654] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.680959 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
W20260709 13:22:15.683219 28427 leader_election.cc:343] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:15.668764 28505 ts_tablet_manager.cc:1434] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:22:15.688894 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d655cb4c3c84af58e4a6fad1f289c40" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.689826 28505 tablet_bootstrap.cc:492] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
W20260709 13:22:15.693262 28280 leader_election.cc:343] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:15.694770 28503 tablet_bootstrap.cc:492] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.695361 28503 ts_tablet_manager.cc:1403] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.003s
I20260709 13:22:15.696094 28505 tablet_bootstrap.cc:654] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.698529 28503 raft_consensus.cc:359] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.699338 28503 raft_consensus.cc:385] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.699616 28503 raft_consensus.cc:740] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.699954 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d655cb4c3c84af58e4a6fad1f289c40" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
W20260709 13:22:15.702453 28278 leader_election.cc:343] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:15.700520 28503 consensus_queue.cc:260] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.703471 28278 leader_election.cc:304] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b5c647a9d774626be162778d230192b; no voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:15.704277 28511 raft_consensus.cc:2749] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:15.704973 28505 tablet_bootstrap.cc:492] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.705366 28503 ts_tablet_manager.cc:1434] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:22:15.705483 28505 ts_tablet_manager.cc:1403] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:22:15.705830 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:15.706525 28389 raft_consensus.cc:2468] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 0.
I20260709 13:22:15.708573 28427 leader_election.cc:304] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 2b5c647a9d774626be162778d230192b
I20260709 13:22:15.709810 28504 tablet_bootstrap.cc:492] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:15.709895 28510 raft_consensus.cc:2804] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.710481 28510 raft_consensus.cc:493] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.710598 28504 ts_tablet_manager.cc:1403] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.005s
I20260709 13:22:15.710901 28510 raft_consensus.cc:3060] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.712392 28503 tablet_bootstrap.cc:492] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.714030 28504 raft_consensus.cc:359] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.714764 28504 raft_consensus.cc:385] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.715075 28504 raft_consensus.cc:740] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.715996 28504 consensus_queue.cc:260] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.718613 28505 raft_consensus.cc:359] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.719398 28505 raft_consensus.cc:385] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.720561 28505 raft_consensus.cc:740] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.719259 28510 raft_consensus.cc:515] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.721036 28503 tablet_bootstrap.cc:654] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.721367 28505 consensus_queue.cc:260] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.724784 28505 ts_tablet_manager.cc:1434] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:22:15.725813 28505 tablet_bootstrap.cc:492] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.727669 28503 tablet_bootstrap.cc:492] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.728179 28503 ts_tablet_manager.cc:1403] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:22:15.734397 28505 tablet_bootstrap.cc:654] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.737984 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:15.738705 28314 raft_consensus.cc:3060] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.740922 28509 raft_consensus.cc:493] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.741442 28509 raft_consensus.cc:515] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.755151 28510 leader_election.cc:290] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:15.758273 28504 ts_tablet_manager.cc:1434] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.047s	user 0.011s	sys 0.013s
I20260709 13:22:15.758492 28509 leader_election.cc:290] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.759066 28314 raft_consensus.cc:2468] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 1.
I20260709 13:22:15.760377 28427 leader_election.cc:304] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:15.759066 28509 raft_consensus.cc:493] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.763217 28509 raft_consensus.cc:515] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.765491 28528 raft_consensus.cc:2804] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:15.766119 28528 raft_consensus.cc:697] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:15.767292 28528 consensus_queue.cc:237] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.770900 28504 tablet_bootstrap.cc:492] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.775269 28509 leader_election.cc:290] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.778007 28503 raft_consensus.cc:359] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.779019 28503 raft_consensus.cc:385] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.779248 28504 tablet_bootstrap.cc:654] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.779405 28503 raft_consensus.cc:740] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.779690 28505 tablet_bootstrap.cc:492] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.780376 28505 ts_tablet_manager.cc:1403] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.027s
I20260709 13:22:15.784679 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:15.784047 28505 raft_consensus.cc:359] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.785393 28389 raft_consensus.cc:3060] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.785573 28505 raft_consensus.cc:385] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.786070 28505 raft_consensus.cc:740] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.780504 28503 consensus_queue.cc:260] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.786897 28505 consensus_queue.cc:260] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.788344 28503 ts_tablet_manager.cc:1434] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.003s
I20260709 13:22:15.789881 28505 ts_tablet_manager.cc:1434] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:22:15.791075 28505 tablet_bootstrap.cc:492] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.796451 28503 tablet_bootstrap.cc:492] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.797031 28212 catalog_manager.cc:5697] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 1 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:15.797906 28505 tablet_bootstrap.cc:654] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.807331 28389 raft_consensus.cc:2468] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 1.
I20260709 13:22:15.812136 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.819775 28504 tablet_bootstrap.cc:492] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:15.819732 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.820169 28503 tablet_bootstrap.cc:654] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.821661 28463 raft_consensus.cc:2468] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:15.822759 28504 ts_tablet_manager.cc:1403] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.006s
I20260709 13:22:15.823283 28528 raft_consensus.cc:493] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.823761 28528 raft_consensus.cc:515] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.825539 28528 leader_election.cc:290] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
W20260709 13:22:15.827258 28260 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:15.827484 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
W20260709 13:22:15.828197 28355 leader_election.cc:343] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:15.828156 28314 raft_consensus.cc:2468] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 0.
I20260709 13:22:15.830811 28355 leader_election.cc:304] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:15.831409 28427 leader_election.cc:304] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:15.832453 28532 raft_consensus.cc:2804] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.832384 28504 raft_consensus.cc:359] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.833025 28532 raft_consensus.cc:493] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.833153 28528 raft_consensus.cc:2804] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.833321 28504 raft_consensus.cc:385] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.833413 28532 raft_consensus.cc:3060] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.831626 28505 tablet_bootstrap.cc:492] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.833676 28504 raft_consensus.cc:740] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.834290 28505 ts_tablet_manager.cc:1403] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.028s
I20260709 13:22:15.834743 28504 consensus_queue.cc:260] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.835290 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:15.833657 28528 raft_consensus.cc:493] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.835919 28528 raft_consensus.cc:3060] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.837390 28504 ts_tablet_manager.cc:1434] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:22:15.838486 28504 tablet_bootstrap.cc:492] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.839236 28505 raft_consensus.cc:359] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.839989 28505 raft_consensus.cc:385] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.840313 28505 raft_consensus.cc:740] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.841228 28532 raft_consensus.cc:515] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.842404 28389 raft_consensus.cc:2393] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 238ba152154c47ca9d461295041ff4cb in current term 1: Already voted for candidate b3cbce46d4d34801b930867d57fd971a in this term.
I20260709 13:22:15.842850 28505 consensus_queue.cc:260] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.843881 28528 raft_consensus.cc:515] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.847083 28505 ts_tablet_manager.cc:1434] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:22:15.847596 28503 tablet_bootstrap.cc:492] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.849962 28503 ts_tablet_manager.cc:1403] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.005s
I20260709 13:22:15.847721 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:15.850761 28314 raft_consensus.cc:3060] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.850966 28505 tablet_bootstrap.cc:492] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.853075 28503 raft_consensus.cc:359] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.853972 28503 raft_consensus.cc:385] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.854242 28503 raft_consensus.cc:740] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.855082 28503 consensus_queue.cc:260] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.848299 28511 raft_consensus.cc:493] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.857156 28511 raft_consensus.cc:515] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.859337 28511 leader_election.cc:290] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.848227 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:15.860152 28463 raft_consensus.cc:2393] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3cbce46d4d34801b930867d57fd971a in current term 1: Already voted for candidate 238ba152154c47ca9d461295041ff4cb in this term.
I20260709 13:22:15.860433 28503 ts_tablet_manager.cc:1434] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:15.847077 28532 leader_election.cc:290] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.862237 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:15.862217 28505 tablet_bootstrap.cc:654] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.862967 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.863234 28504 tablet_bootstrap.cc:654] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.863130 28389 raft_consensus.cc:2468] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
W20260709 13:22:15.864486 28280 leader_election.cc:343] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:15.865178 28511 raft_consensus.cc:493] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.865104 28278 leader_election.cc:304] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:15.865862 28511 raft_consensus.cc:515] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.869812 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.870645 28503 tablet_bootstrap.cc:492] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:15.870573 28463 raft_consensus.cc:2468] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:15.872308 28280 leader_election.cc:304] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:15.873561 28511 leader_election.cc:290] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.873706 28532 raft_consensus.cc:493] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.874351 28532 raft_consensus.cc:515] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.875203 28511 raft_consensus.cc:2804] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.875227 28504 tablet_bootstrap.cc:492] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:15.876616 28504 ts_tablet_manager.cc:1403] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 13:22:15.877189 28314 raft_consensus.cc:2468] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 1.
I20260709 13:22:15.877760 28532 leader_election.cc:290] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.878305 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.879999 28463 raft_consensus.cc:2468] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:15.880125 28504 raft_consensus.cc:359] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.881004 28504 raft_consensus.cc:385] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.881201 28355 leader_election.cc:304] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:15.881353 28504 raft_consensus.cc:740] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.882300 28532 raft_consensus.cc:2804] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.882771 28532 raft_consensus.cc:493] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.882375 28504 consensus_queue.cc:260] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.883153 28532 raft_consensus.cc:3060] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.876662 28511 raft_consensus.cc:493] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.883889 28511 raft_consensus.cc:3060] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.887368 28504 ts_tablet_manager.cc:1434] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:22:15.888476 28504 tablet_bootstrap.cc:492] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.888314 28427 leader_election.cc:304] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:15.894871 28510 raft_consensus.cc:2804] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:15.894985 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:15.896242 28313 raft_consensus.cc:2393] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3cbce46d4d34801b930867d57fd971a in current term 1: Already voted for candidate 238ba152154c47ca9d461295041ff4cb in this term.
I20260709 13:22:15.897459 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:15.899287 28532 raft_consensus.cc:515] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.899950 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:15.901181 28388 raft_consensus.cc:2393] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 238ba152154c47ca9d461295041ff4cb in current term 1: Already voted for candidate b3cbce46d4d34801b930867d57fd971a in this term.
I20260709 13:22:15.901969 28532 leader_election.cc:290] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.892565 28505 tablet_bootstrap.cc:492] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.892643 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:15.903355 28505 ts_tablet_manager.cc:1403] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.007s
I20260709 13:22:15.903651 28389 raft_consensus.cc:2393] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b5c647a9d774626be162778d230192b in current term 1: Already voted for candidate b3cbce46d4d34801b930867d57fd971a in this term.
I20260709 13:22:15.902086 28504 tablet_bootstrap.cc:654] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.906023 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:15.907434 28463 raft_consensus.cc:3060] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.907145 28505 raft_consensus.cc:359] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.908389 28505 raft_consensus.cc:385] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.908718 28505 raft_consensus.cc:740] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.909500 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:15.909974 28505 consensus_queue.cc:260] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.910575 28313 raft_consensus.cc:2393] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3cbce46d4d34801b930867d57fd971a in current term 1: Already voted for candidate 238ba152154c47ca9d461295041ff4cb in this term.
I20260709 13:22:15.912513 28505 ts_tablet_manager.cc:1434] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:15.912431 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:15.915174 28353 leader_election.cc:304] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3cbce46d4d34801b930867d57fd971a; no voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b
I20260709 13:22:15.915853 28312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:15.889613 28542 raft_consensus.cc:2804] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.917940 28313 raft_consensus.cc:2468] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:15.918514 28505 tablet_bootstrap.cc:492] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:15.919795 28542 raft_consensus.cc:493] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.920362 28542 raft_consensus.cc:3060] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.922561 28503 tablet_bootstrap.cc:654] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.923147 28510 raft_consensus.cc:697] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:15.924137 28510 consensus_queue.cc:237] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.927565 28505 tablet_bootstrap.cc:654] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.929050 28528 leader_election.cc:290] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:15.930128 28532 raft_consensus.cc:2749] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:15.935508 28504 tablet_bootstrap.cc:492] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:15.936019 28504 ts_tablet_manager.cc:1403] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.003s
I20260709 13:22:15.936112 28544 raft_consensus.cc:493] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.936834 28544 raft_consensus.cc:515] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.936444 28542 raft_consensus.cc:515] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.939706 28504 raft_consensus.cc:359] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.939826 28544 leader_election.cc:290] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.940470 28504 raft_consensus.cc:385] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.950758 28504 raft_consensus.cc:740] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.951583 28504 consensus_queue.cc:260] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.953055 28504 ts_tablet_manager.cc:1434] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:22:15.953872 28504 tablet_bootstrap.cc:492] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:15.954932 28505 tablet_bootstrap.cc:492] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:15.955466 28505 ts_tablet_manager.cc:1403] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.019s
I20260709 13:22:15.940727 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:15.941921 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:15.959313 28388 raft_consensus.cc:2393] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b5c647a9d774626be162778d230192b in current term 1: Already voted for candidate b3cbce46d4d34801b930867d57fd971a in this term.
I20260709 13:22:15.948869 28463 raft_consensus.cc:2468] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:15.960078 28389 raft_consensus.cc:2468] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
W20260709 13:22:15.940550 28280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:40815, user_credentials={real_user=slave}} blocked reactor thread for 68351.8us
I20260709 13:22:15.960698 28355 leader_election.cc:304] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 2b5c647a9d774626be162778d230192b
I20260709 13:22:15.941206 28542 leader_election.cc:290] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.963241 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:15.962469 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.961050 28505 raft_consensus.cc:359] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.975557 28463 raft_consensus.cc:2393] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b5c647a9d774626be162778d230192b in current term 1: Already voted for candidate b3cbce46d4d34801b930867d57fd971a in this term.
I20260709 13:22:15.944728 28503 tablet_bootstrap.cc:492] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:15.963325 28278 leader_election.cc:304] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:15.976336 28462 raft_consensus.cc:2468] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:15.970554 28532 raft_consensus.cc:2804] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:15.959313 28504 tablet_bootstrap.cc:654] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.977202 28532 raft_consensus.cc:697] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:15.975943 28505 raft_consensus.cc:385] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.978446 28505 raft_consensus.cc:740] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.976761 28503 ts_tablet_manager.cc:1403] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.000s
I20260709 13:22:15.979163 28505 consensus_queue.cc:260] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.979087 28532 consensus_queue.cc:237] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.980630 28544 raft_consensus.cc:2804] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.980852 28509 raft_consensus.cc:493] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:15.981106 28544 raft_consensus.cc:493] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.976817 28280 leader_election.cc:304] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b5c647a9d774626be162778d230192b; no voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:15.981457 28544 raft_consensus.cc:3060] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.971691 28212 catalog_manager.cc:5697] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 1 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:15.981405 28509 raft_consensus.cc:515] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.982656 28542 raft_consensus.cc:2749] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:15.984105 28509 leader_election.cc:290] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.981345 28505 ts_tablet_manager.cc:1434] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:22:15.985678 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:15.987365 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:15.989730 28503 raft_consensus.cc:359] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.991078 28503 raft_consensus.cc:385] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.991393 28503 raft_consensus.cc:740] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.944393 28511 raft_consensus.cc:515] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.991282 28313 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:15.992476 28314 raft_consensus.cc:2393] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3cbce46d4d34801b930867d57fd971a in current term 1: Already voted for candidate 2b5c647a9d774626be162778d230192b in this term.
I20260709 13:22:15.993036 28353 leader_election.cc:304] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:15.993058 28503 consensus_queue.cc:260] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.994343 28353 leader_election.cc:304] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3cbce46d4d34801b930867d57fd971a; no voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b
I20260709 13:22:15.994812 28509 raft_consensus.cc:2804] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:15.995244 28509 raft_consensus.cc:493] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:15.995534 28462 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:15.990446 28544 raft_consensus.cc:515] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:15.997112 28509 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.998772 28544 leader_election.cc:290] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:15.999409 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:16.000026 28389 raft_consensus.cc:3060] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.001094 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.001312 28504 tablet_bootstrap.cc:492] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:16.001682 28462 raft_consensus.cc:3060] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.001857 28504 ts_tablet_manager.cc:1403] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.006s
I20260709 13:22:16.007499 28503 ts_tablet_manager.cc:1434] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.005s
I20260709 13:22:16.014032 28509 raft_consensus.cc:515] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.015538 28544 raft_consensus.cc:493] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.016207 28544 raft_consensus.cc:515] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.017436 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.018039 28463 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.020116 28509 leader_election.cc:290] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.021994 28509 raft_consensus.cc:3060] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.023180 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:16.023828 28388 raft_consensus.cc:2468] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:16.025296 28278 leader_election.cc:304] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.026700 28551 raft_consensus.cc:2804] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.027201 28551 raft_consensus.cc:493] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.027606 28551 raft_consensus.cc:3060] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.029960 28509 raft_consensus.cc:2749] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.030682 28509 raft_consensus.cc:493] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.031159 28509 raft_consensus.cc:515] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.033958 28389 raft_consensus.cc:2468] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:16.034617 28461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba96465c2fa41848022f2ead1233c34" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:16.035974 28544 leader_election.cc:290] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.038908 28462 raft_consensus.cc:2468] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:16.039716 28511 leader_election.cc:290] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.041376 28278 leader_election.cc:304] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
W20260709 13:22:16.041733 28355 leader_election.cc:343] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.042268 28463 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:16.042362 28461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:16.042577 28511 raft_consensus.cc:2804] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.043017 28461 raft_consensus.cc:2468] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
W20260709 13:22:16.045389 28353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.1:38227, user_credentials={real_user=slave}} blocked reactor thread for 51137.3us
I20260709 13:22:16.043744 28504 raft_consensus.cc:359] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.046975 28504 raft_consensus.cc:385] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.047330 28504 raft_consensus.cc:740] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.047981 28504 consensus_queue.cc:260] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.049621 28504 ts_tablet_manager.cc:1434] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 13:22:16.050417 28504 tablet_bootstrap.cc:492] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:16.046480 28509 leader_election.cc:290] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.051697 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:16.052060 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba96465c2fa41848022f2ead1233c34" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:16.052315 28314 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.052544 28313 raft_consensus.cc:2468] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:16.053267 28355 leader_election.cc:304] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.053678 28353 leader_election.cc:304] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:16.054764 28532 raft_consensus.cc:2804] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.055474 28553 raft_consensus.cc:2804] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.055861 28553 raft_consensus.cc:493] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.056257 28553 raft_consensus.cc:3060] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.055928 28551 raft_consensus.cc:515] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.057787 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:16.059463 28212 catalog_manager.cc:5697] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.045452 28511 raft_consensus.cc:697] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.063205 28314 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:16.062789 28532 raft_consensus.cc:697] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:16.063508 28511 consensus_queue.cc:237] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.064218 28509 raft_consensus.cc:493] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.064442 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.066437 28532 consensus_queue.cc:237] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.064862 28553 raft_consensus.cc:515] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.071959 28553 leader_election.cc:290] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.070396 28509 raft_consensus.cc:515] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.074402 28461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba96465c2fa41848022f2ead1233c34" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
W20260709 13:22:16.074616 28280 leader_election.cc:343] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.074941 28461 raft_consensus.cc:3060] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.081481 28389 raft_consensus.cc:2468] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:16.085836 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:16.084421 28504 tablet_bootstrap.cc:654] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.084299 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d655cb4c3c84af58e4a6fad1f289c40" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:16.086462 28388 raft_consensus.cc:3060] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.082914 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba96465c2fa41848022f2ead1233c34" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:16.086653 28313 raft_consensus.cc:2468] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:16.087150 28314 raft_consensus.cc:3060] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.087996 28353 leader_election.cc:304] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.085373 28551 leader_election.cc:290] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.086937 28211 catalog_manager.cc:5697] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 1 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.086362 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.096521 28388 raft_consensus.cc:2468] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:16.090037 28553 raft_consensus.cc:2804] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.092305 28462 raft_consensus.cc:3060] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.103075 28553 raft_consensus.cc:493] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.103593 28553 raft_consensus.cc:3060] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.106379 28461 raft_consensus.cc:2468] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:16.107692 28509 leader_election.cc:290] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.107605 28355 leader_election.cc:304] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.108474 28532 raft_consensus.cc:2804] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.109033 28532 raft_consensus.cc:697] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:16.109803 28278 leader_election.cc:304] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:16.109913 28532 consensus_queue.cc:237] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.111125 28278 leader_election.cc:304] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.112823 28511 raft_consensus.cc:2804] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.113306 28511 raft_consensus.cc:697] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.113481 28544 raft_consensus.cc:2804] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.114167 28511 consensus_queue.cc:237] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.114179 28544 raft_consensus.cc:697] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.115377 28212 catalog_manager.cc:5697] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.115778 28544 consensus_queue.cc:237] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.118111 28461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d655cb4c3c84af58e4a6fad1f289c40" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:16.118767 28461 raft_consensus.cc:2468] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:16.127246 28504 tablet_bootstrap.cc:492] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:16.127771 28504 ts_tablet_manager.cc:1403] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.026s
I20260709 13:22:16.130764 28504 raft_consensus.cc:359] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.131448 28504 raft_consensus.cc:385] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.131713 28504 raft_consensus.cc:740] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.132561 28504 consensus_queue.cc:260] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.135120 28314 raft_consensus.cc:2468] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:16.138212 28504 ts_tablet_manager.cc:1434] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:16.144033 28212 catalog_manager.cc:5697] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.145380 28553 raft_consensus.cc:515] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.148164 28211 catalog_manager.cc:5697] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 1 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.149430 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d655cb4c3c84af58e4a6fad1f289c40" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:16.150041 28314 raft_consensus.cc:3060] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.150208 28462 raft_consensus.cc:2468] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:16.149941 28211 catalog_manager.cc:5697] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 1 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.151932 28553 leader_election.cc:290] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.153644 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d655cb4c3c84af58e4a6fad1f289c40" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.154074 28462 raft_consensus.cc:3060] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.158769 28314 raft_consensus.cc:2468] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:16.159817 28462 raft_consensus.cc:2468] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:16.159853 28353 leader_election.cc:304] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.161875 28553 raft_consensus.cc:2804] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.162315 28553 raft_consensus.cc:697] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:16.163161 28553 consensus_queue.cc:237] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.170852 28211 catalog_manager.cc:5697] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.191037 28510 raft_consensus.cc:493] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.191654 28510 raft_consensus.cc:515] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.193902 28510 leader_election.cc:290] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:16.194623 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:16.194864 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a111e1284a664153bf0e70987a47e7a9" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:16.195624 28388 raft_consensus.cc:2393] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 238ba152154c47ca9d461295041ff4cb in current term 1: Already voted for candidate 2b5c647a9d774626be162778d230192b in this term.
I20260709 13:22:16.196539 28427 leader_election.cc:304] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb; no voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:16.197223 28510 raft_consensus.cc:3060] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.202585 28510 raft_consensus.cc:2749] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.217217 28388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
mode: GRACEFUL
new_leader_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:50876
I20260709 13:22:16.217866 28388 raft_consensus.cc:606] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Received request to transfer leadership to TS 2b5c647a9d774626be162778d230192b
I20260709 13:22:16.230808 28462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8418cdfa88484445a1973deb11358a64"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
mode: GRACEFUL
new_leader_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:47306
I20260709 13:22:16.231369 28462 raft_consensus.cc:606] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Received request to transfer leadership to TS 2b5c647a9d774626be162778d230192b
I20260709 13:22:16.236438 28462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
mode: GRACEFUL
new_leader_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:47306
I20260709 13:22:16.236997 28462 raft_consensus.cc:606] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Received request to transfer leadership to TS 2b5c647a9d774626be162778d230192b
I20260709 13:22:16.251986 28314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f"
dest_uuid: "2b5c647a9d774626be162778d230192b"
mode: GRACEFUL
new_leader_uuid: "b3cbce46d4d34801b930867d57fd971a"
 from {username='slave'} at 127.0.0.1:55366
I20260709 13:22:16.252497 28314 raft_consensus.cc:606] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Received request to transfer leadership to TS b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:16.265029 28314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534"
dest_uuid: "2b5c647a9d774626be162778d230192b"
mode: GRACEFUL
new_leader_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:55366
I20260709 13:22:16.265542 28314 raft_consensus.cc:606] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Received request to transfer leadership to TS 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:16.363691 28553 consensus_queue.cc:1048] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.367836 28510 consensus_queue.cc:1048] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.376816 28532 consensus_queue.cc:1048] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.390982 28510 consensus_queue.cc:1048] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.402972 28510 raft_consensus.cc:993] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb: : Instructing follower 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:16.403544 28545 raft_consensus.cc:1081] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Signalling peer 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:16.405037 28314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce"
dest_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:55342
I20260709 13:22:16.405499 28314 raft_consensus.cc:493] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.405781 28314 raft_consensus.cc:3060] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.411809 28314 raft_consensus.cc:515] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.413985 28314 leader_election.cc:290] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.414230 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:16.414850 28388 raft_consensus.cc:3060] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.415022 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a02b35be0345f2962b1d827e15e1ce" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.415639 28462 raft_consensus.cc:3055] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.415956 28462 raft_consensus.cc:740] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:16.416754 28462 consensus_queue.cc:260] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.418172 28462 raft_consensus.cc:3060] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.421741 28388 raft_consensus.cc:2468] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:16.422933 28278 leader_election.cc:304] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.423713 28544 raft_consensus.cc:2804] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.424149 28544 raft_consensus.cc:697] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.425062 28462 raft_consensus.cc:2468] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:16.424935 28544 consensus_queue.cc:237] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.431090 28211 catalog_manager.cc:5697] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 1 to 2, leader changed from 238ba152154c47ca9d461295041ff4cb (127.17.139.3) to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 2 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.452036 28545 consensus_queue.cc:1048] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.462949 28528 consensus_queue.cc:1048] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.470184 28510 raft_consensus.cc:993] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb: : Instructing follower 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:16.470654 28528 raft_consensus.cc:1081] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Signalling peer 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:16.472213 28314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8418cdfa88484445a1973deb11358a64"
dest_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:55342
I20260709 13:22:16.472680 28314 raft_consensus.cc:493] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.473040 28314 raft_consensus.cc:3060] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.477981 28314 raft_consensus.cc:515] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.480069 28314 leader_election.cc:290] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.480479 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:16.480635 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8418cdfa88484445a1973deb11358a64" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.481192 28388 raft_consensus.cc:3060] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.481317 28462 raft_consensus.cc:3055] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.481782 28462 raft_consensus.cc:740] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:16.482607 28462 consensus_queue.cc:260] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.483920 28462 raft_consensus.cc:3060] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.486903 28388 raft_consensus.cc:2468] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:16.487960 28278 leader_election.cc:304] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.488669 28544 raft_consensus.cc:2804] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.489099 28462 raft_consensus.cc:2468] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:16.489172 28544 raft_consensus.cc:697] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.490095 28544 consensus_queue.cc:237] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.496577 28211 catalog_manager.cc:5697] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 1 to 2, leader changed from 238ba152154c47ca9d461295041ff4cb (127.17.139.3) to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 2 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.502904 28544 consensus_queue.cc:1048] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.509343 28511 raft_consensus.cc:993] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b: : Instructing follower b3cbce46d4d34801b930867d57fd971a to start an election
I20260709 13:22:16.509833 28551 raft_consensus.cc:1081] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Signalling peer b3cbce46d4d34801b930867d57fd971a to start an election
I20260709 13:22:16.514079 28551 consensus_queue.cc:1048] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.515650 28388 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
 from {username='slave'} at 127.0.0.1:50860
I20260709 13:22:16.516315 28388 raft_consensus.cc:493] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.516777 28388 raft_consensus.cc:3060] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.524452 28388 raft_consensus.cc:515] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.525934 28511 consensus_queue.cc:1048] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.526890 28388 leader_election.cc:290] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 2 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.527267 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:16.527876 28314 raft_consensus.cc:3055] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.528100 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bbdc1e691947f0aa4edd44f98f217f" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.528192 28314 raft_consensus.cc:740] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.529024 28462 raft_consensus.cc:3060] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.529448 28314 consensus_queue.cc:260] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.530864 28314 raft_consensus.cc:3060] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.537112 28462 raft_consensus.cc:2468] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 2.
I20260709 13:22:16.541973 28314 raft_consensus.cc:2468] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 2.
I20260709 13:22:16.543462 28353 leader_election.cc:304] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.543431 28509 consensus_queue.cc:1048] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:16.544286 28542 consensus_queue.cc:1048] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.544600 28532 raft_consensus.cc:2804] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.545205 28532 raft_consensus.cc:697] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 2 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:16.546059 28532 consensus_queue.cc:237] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.557284 28209 catalog_manager.cc:5697] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 1 to 2, leader changed from 2b5c647a9d774626be162778d230192b (127.17.139.1) to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 2 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.564687 28542 raft_consensus.cc:993] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b: : Instructing follower 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:16.565152 28511 raft_consensus.cc:1081] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Signalling peer 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:16.567512 28461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:47300
I20260709 13:22:16.568040 28461 raft_consensus.cc:493] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.568394 28461 raft_consensus.cc:3060] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.571679 28552 consensus_queue.cc:1048] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.573097 28552 consensus_queue.cc:1048] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.575376 28461 raft_consensus.cc:515] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.578440 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:16.579176 28313 raft_consensus.cc:3055] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.579594 28313 raft_consensus.cc:740] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.580624 28313 consensus_queue.cc:260] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.582073 28313 raft_consensus.cc:3060] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.588618 28542 consensus_queue.cc:1048] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.590546 28461 leader_election.cc:290] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:16.591238 28313 raft_consensus.cc:2468] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:16.592696 28427 leader_election.cc:304] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:16.593791 28528 raft_consensus.cc:2804] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.594260 28528 raft_consensus.cc:697] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:16.594520 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa85e395a184869b2b6bb699647d534" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:16.594969 28554 consensus_queue.cc:1048] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:16.595358 28389 raft_consensus.cc:3060] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.595093 28528 consensus_queue.cc:237] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.608127 28553 raft_consensus.cc:993] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a: : Instructing follower 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:16.608687 28553 raft_consensus.cc:1081] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Signalling peer 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:16.610888 28313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5"
dest_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:22:16.611456 28313 raft_consensus.cc:493] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:16.611841 28313 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.613018 28389 raft_consensus.cc:2468] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:16.615394 28554 consensus_queue.cc:1048] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.619036 28542 consensus_queue.cc:1048] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.619082 28313 raft_consensus.cc:515] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.620129 28314 raft_consensus.cc:1240] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Rejecting Update request from peer b3cbce46d4d34801b930867d57fd971a for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:16.622810 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:16.623562 28388 raft_consensus.cc:3055] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:16.623952 28388 raft_consensus.cc:740] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:16.625013 28388 consensus_queue.cc:260] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.628747 28553 consensus_queue.cc:1048] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.629245 28211 catalog_manager.cc:5697] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 1 to 2, leader changed from 2b5c647a9d774626be162778d230192b (127.17.139.1) to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:16.629944 28388 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.631484 28313 leader_election.cc:290] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:16.632055 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:16.632642 28462 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:16.639389 28388 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:16.640774 28278 leader_election.cc:304] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:16.641745 28542 raft_consensus.cc:2804] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:16.642225 28542 raft_consensus.cc:697] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:16.643060 28542 consensus_queue.cc:237] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:16.647176 28462 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:16.652854 28212 catalog_manager.cc:5697] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 1 to 2, leader changed from b3cbce46d4d34801b930867d57fd971a (127.17.139.2) to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 2 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.946669 28462 raft_consensus.cc:1275] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.947937 28511 consensus_queue.cc:1048] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.954378 28462 raft_consensus.cc:1275] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer b3cbce46d4d34801b930867d57fd971a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.957194 28553 consensus_queue.cc:1048] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.957201 28388 raft_consensus.cc:1275] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.959728 28542 consensus_queue.cc:1048] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:16.965683 28312 raft_consensus.cc:1275] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Refusing update from remote peer b3cbce46d4d34801b930867d57fd971a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:16.967141 28553 consensus_queue.cc:1048] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.003906 28462 raft_consensus.cc:1275] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.004609 28388 raft_consensus.cc:1275] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.005263 28511 consensus_queue.cc:1048] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.006001 28551 consensus_queue.cc:1048] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.066258 28312 raft_consensus.cc:1275] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.067410 28528 consensus_queue.cc:1048] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.079171 28388 raft_consensus.cc:1275] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.080786 28510 consensus_queue.cc:1048] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:17.108441 28388 raft_consensus.cc:1275] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.109647 28544 consensus_queue.cc:1048] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.120007 28462 raft_consensus.cc:1275] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.121426 28544 consensus_queue.cc:1048] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:19.293622 28211 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54978:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:19.295769 28211 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:19.344611 28300 tablet_service.cc:1511] Processing CreateTablet for tablet b579cd7832a44ede9f3a4388b6cea694 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:19.345522 28375 tablet_service.cc:1511] Processing CreateTablet for tablet b579cd7832a44ede9f3a4388b6cea694 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:19.345963 28300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b579cd7832a44ede9f3a4388b6cea694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.346777 28375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b579cd7832a44ede9f3a4388b6cea694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.346648 28450 tablet_service.cc:1511] Processing CreateTablet for tablet b579cd7832a44ede9f3a4388b6cea694 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:19.347854 28450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b579cd7832a44ede9f3a4388b6cea694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.351576 28298 tablet_service.cc:1511] Processing CreateTablet for tablet d05d0393bba84ec6a83709942c5ff1ed (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:19.352057 28377 tablet_service.cc:1511] Processing CreateTablet for tablet d05d0393bba84ec6a83709942c5ff1ed (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:19.352902 28298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05d0393bba84ec6a83709942c5ff1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.353338 28377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05d0393bba84ec6a83709942c5ff1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.353351 28374 tablet_service.cc:1511] Processing CreateTablet for tablet 66827369c92b4c86b27ae62411e30511 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:19.353868 28297 tablet_service.cc:1511] Processing CreateTablet for tablet 66827369c92b4c86b27ae62411e30511 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:19.354719 28374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66827369c92b4c86b27ae62411e30511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.355136 28297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66827369c92b4c86b27ae62411e30511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.361905 28447 tablet_service.cc:1511] Processing CreateTablet for tablet d05d0393bba84ec6a83709942c5ff1ed (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:19.363224 28447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05d0393bba84ec6a83709942c5ff1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.373888 28449 tablet_service.cc:1511] Processing CreateTablet for tablet 66827369c92b4c86b27ae62411e30511 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:19.375200 28449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66827369c92b4c86b27ae62411e30511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.377341 28448 tablet_service.cc:1511] Processing CreateTablet for tablet 8031e23012f64b8f9931a64f390499e8 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:19.378643 28448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8031e23012f64b8f9931a64f390499e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.382889 28304 tablet_service.cc:1511] Processing CreateTablet for tablet 8031e23012f64b8f9931a64f390499e8 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:19.383671 28373 tablet_service.cc:1511] Processing CreateTablet for tablet 8031e23012f64b8f9931a64f390499e8 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:19.384209 28304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8031e23012f64b8f9931a64f390499e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.384473 28451 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5c38ba4d9d441681a2f9688d4e13ee (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:19.384975 28373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8031e23012f64b8f9931a64f390499e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.385703 28451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5c38ba4d9d441681a2f9688d4e13ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.389832 28303 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5c38ba4d9d441681a2f9688d4e13ee (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:19.390344 28302 tablet_service.cc:1511] Processing CreateTablet for tablet 8b28b7727a5a453a9288ec80b960df8e (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:19.391142 28303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5c38ba4d9d441681a2f9688d4e13ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.391803 28302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b28b7727a5a453a9288ec80b960df8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.383985 28378 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5c38ba4d9d441681a2f9688d4e13ee (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:19.392787 28378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5c38ba4d9d441681a2f9688d4e13ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.426955 28376 tablet_service.cc:1511] Processing CreateTablet for tablet 8b28b7727a5a453a9288ec80b960df8e (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:19.428000 28303 tablet_service.cc:1511] Processing CreateTablet for tablet 378dc6cba506434a9b67aa6bf6310ca4 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:19.429414 28303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378dc6cba506434a9b67aa6bf6310ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.428419 28376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b28b7727a5a453a9288ec80b960df8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.429612 28446 tablet_service.cc:1511] Processing CreateTablet for tablet 8b28b7727a5a453a9288ec80b960df8e (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:19.434191 28446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b28b7727a5a453a9288ec80b960df8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.447495 28453 tablet_service.cc:1511] Processing CreateTablet for tablet 378dc6cba506434a9b67aa6bf6310ca4 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:19.449263 28453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378dc6cba506434a9b67aa6bf6310ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.453006 28598 tablet_bootstrap.cc:492] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.455277 28373 tablet_service.cc:1511] Processing CreateTablet for tablet 378dc6cba506434a9b67aa6bf6310ca4 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:19.456545 28373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378dc6cba506434a9b67aa6bf6310ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.459841 28598 tablet_bootstrap.cc:654] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.460317 28445 tablet_service.cc:1511] Processing CreateTablet for tablet 58b425795f3a4879a3b6c8a158ccbf9b (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:19.462560 28304 tablet_service.cc:1511] Processing CreateTablet for tablet 58b425795f3a4879a3b6c8a158ccbf9b (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:19.462843 28375 tablet_service.cc:1511] Processing CreateTablet for tablet 58b425795f3a4879a3b6c8a158ccbf9b (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:19.465993 28445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b425795f3a4879a3b6c8a158ccbf9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.466104 28375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b425795f3a4879a3b6c8a158ccbf9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.467796 28304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b425795f3a4879a3b6c8a158ccbf9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.477496 28600 tablet_bootstrap.cc:492] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.480968 28451 tablet_service.cc:1511] Processing CreateTablet for tablet 58307189141944e29874da9302d7f6e2 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:19.481542 28298 tablet_service.cc:1511] Processing CreateTablet for tablet 58307189141944e29874da9302d7f6e2 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:19.482203 28451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58307189141944e29874da9302d7f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.482776 28298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58307189141944e29874da9302d7f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.487191 28600 tablet_bootstrap.cc:654] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.489327 28599 tablet_bootstrap.cc:492] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.491483 28376 tablet_service.cc:1511] Processing CreateTablet for tablet 58307189141944e29874da9302d7f6e2 (DEFAULT_TABLE table=soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:19.492702 28376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58307189141944e29874da9302d7f6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:19.504750 28599 tablet_bootstrap.cc:654] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.514982 28600 tablet_bootstrap.cc:492] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.515535 28600 ts_tablet_manager.cc:1403] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.003s
I20260709 13:22:19.522293 28599 tablet_bootstrap.cc:492] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.522970 28599 ts_tablet_manager.cc:1403] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.005s
I20260709 13:22:19.523671 28598 tablet_bootstrap.cc:492] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.524192 28598 ts_tablet_manager.cc:1403] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.079s	user 0.005s	sys 0.008s
I20260709 13:22:19.527136 28598 raft_consensus.cc:359] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.527832 28598 raft_consensus.cc:385] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.528120 28598 raft_consensus.cc:740] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.528806 28598 consensus_queue.cc:260] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.529383 28599 raft_consensus.cc:359] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.533677 28599 raft_consensus.cc:385] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.533943 28599 raft_consensus.cc:740] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.534633 28599 consensus_queue.cc:260] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.536213 28600 raft_consensus.cc:359] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.536749 28599 ts_tablet_manager.cc:1434] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:22:19.537039 28600 raft_consensus.cc:385] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.537400 28600 raft_consensus.cc:740] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.538031 28600 consensus_queue.cc:260] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.540186 28600 ts_tablet_manager.cc:1434] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:22:19.541179 28600 tablet_bootstrap.cc:492] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.545528 28599 tablet_bootstrap.cc:492] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.548187 28600 tablet_bootstrap.cc:654] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.552518 28599 tablet_bootstrap.cc:654] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.531136 28598 ts_tablet_manager.cc:1434] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:19.555227 28598 tablet_bootstrap.cc:492] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.560810 28598 tablet_bootstrap.cc:654] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.573367 28598 tablet_bootstrap.cc:492] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.573886 28598 ts_tablet_manager.cc:1403] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:22:19.574299 28599 tablet_bootstrap.cc:492] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.574885 28599 ts_tablet_manager.cc:1403] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 13:22:19.576741 28598 raft_consensus.cc:359] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.577489 28598 raft_consensus.cc:385] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.577569 28599 raft_consensus.cc:359] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.577786 28598 raft_consensus.cc:740] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.578410 28599 raft_consensus.cc:385] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.578752 28599 raft_consensus.cc:740] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.579015 28598 consensus_queue.cc:260] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.579466 28599 consensus_queue.cc:260] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.580026 28600 tablet_bootstrap.cc:492] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.580547 28600 ts_tablet_manager.cc:1403] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.015s
I20260709 13:22:19.581455 28598 ts_tablet_manager.cc:1434] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:19.581867 28599 ts_tablet_manager.cc:1434] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:19.582526 28598 tablet_bootstrap.cc:492] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.582849 28599 tablet_bootstrap.cc:492] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.583551 28600 raft_consensus.cc:359] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.584280 28600 raft_consensus.cc:385] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.584560 28600 raft_consensus.cc:740] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.585492 28600 consensus_queue.cc:260] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.589673 28598 tablet_bootstrap.cc:654] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.589852 28599 tablet_bootstrap.cc:654] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.590407 28600 ts_tablet_manager.cc:1434] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:19.591413 28600 tablet_bootstrap.cc:492] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.599574 28600 tablet_bootstrap.cc:654] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.602396 28599 tablet_bootstrap.cc:492] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.602555 28598 tablet_bootstrap.cc:492] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.603046 28599 ts_tablet_manager.cc:1403] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:22:19.603096 28598 ts_tablet_manager.cc:1403] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:22:19.606583 28598 raft_consensus.cc:359] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.607270 28598 raft_consensus.cc:385] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.607647 28598 raft_consensus.cc:740] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.607318 28599 raft_consensus.cc:359] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.608421 28599 raft_consensus.cc:385] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.608831 28599 raft_consensus.cc:740] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.608568 28598 consensus_queue.cc:260] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.609867 28599 consensus_queue.cc:260] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.611024 28598 ts_tablet_manager.cc:1434] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:19.612967 28599 ts_tablet_manager.cc:1434] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.003s
I20260709 13:22:19.614337 28599 tablet_bootstrap.cc:492] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.615808 28598 tablet_bootstrap.cc:492] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.623000 28599 tablet_bootstrap.cc:654] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.624178 28598 tablet_bootstrap.cc:654] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.625418 28600 tablet_bootstrap.cc:492] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.625939 28600 ts_tablet_manager.cc:1403] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.004s
I20260709 13:22:19.634903 28600 raft_consensus.cc:359] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.635675 28598 tablet_bootstrap.cc:492] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.635965 28600 raft_consensus.cc:385] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.636389 28598 ts_tablet_manager.cc:1403] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 13:22:19.636436 28600 raft_consensus.cc:740] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.639644 28598 raft_consensus.cc:359] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.639909 28600 consensus_queue.cc:260] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.640352 28598 raft_consensus.cc:385] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.640803 28598 raft_consensus.cc:740] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.641769 28598 consensus_queue.cc:260] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.644300 28598 ts_tablet_manager.cc:1434] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:19.644834 28600 ts_tablet_manager.cc:1434] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:22:19.645339 28598 tablet_bootstrap.cc:492] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.645932 28600 tablet_bootstrap.cc:492] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.646932 28599 tablet_bootstrap.cc:492] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.647482 28599 ts_tablet_manager.cc:1403] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.008s
I20260709 13:22:19.650487 28599 raft_consensus.cc:359] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.651196 28599 raft_consensus.cc:385] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.651496 28599 raft_consensus.cc:740] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.652215 28599 consensus_queue.cc:260] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.652691 28598 tablet_bootstrap.cc:654] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.653026 28600 tablet_bootstrap.cc:654] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.662901 28599 ts_tablet_manager.cc:1434] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:22:19.664057 28599 tablet_bootstrap.cc:492] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.664525 28598 tablet_bootstrap.cc:492] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.665057 28598 ts_tablet_manager.cc:1403] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:22:19.665200 28600 tablet_bootstrap.cc:492] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.665789 28600 ts_tablet_manager.cc:1403] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:22:19.668119 28598 raft_consensus.cc:359] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.668932 28598 raft_consensus.cc:385] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.668819 28600 raft_consensus.cc:359] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.669435 28598 raft_consensus.cc:740] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.669772 28600 raft_consensus.cc:385] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.670132 28600 raft_consensus.cc:740] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.670631 28599 tablet_bootstrap.cc:654] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.670253 28598 consensus_queue.cc:260] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.671032 28600 consensus_queue.cc:260] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.672703 28598 ts_tablet_manager.cc:1434] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:19.673936 28600 ts_tablet_manager.cc:1434] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:19.675300 28600 tablet_bootstrap.cc:492] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.677312 28598 tablet_bootstrap.cc:492] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.684340 28600 tablet_bootstrap.cc:654] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.688444 28599 tablet_bootstrap.cc:492] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.689040 28599 ts_tablet_manager.cc:1403] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260709 13:22:19.690256 28598 tablet_bootstrap.cc:654] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.694936 28599 raft_consensus.cc:359] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.696007 28599 raft_consensus.cc:385] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.696385 28599 raft_consensus.cc:740] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.697305 28599 consensus_queue.cc:260] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.699879 28599 ts_tablet_manager.cc:1434] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:22:19.700855 28599 tablet_bootstrap.cc:492] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.705551 28598 tablet_bootstrap.cc:492] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.706117 28598 ts_tablet_manager.cc:1403] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.008s
I20260709 13:22:19.707577 28599 tablet_bootstrap.cc:654] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:19.690374 28278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:42347, user_credentials={real_user=slave}} blocked reactor thread for 108607us
I20260709 13:22:19.709095 28598 raft_consensus.cc:359] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.709933 28598 raft_consensus.cc:385] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.710253 28598 raft_consensus.cc:740] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.711161 28598 consensus_queue.cc:260] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.714244 28598 ts_tablet_manager.cc:1434] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:19.715543 28598 tablet_bootstrap.cc:492] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.719276 28599 tablet_bootstrap.cc:492] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.719830 28599 ts_tablet_manager.cc:1403] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.019s	user 0.000s	sys 0.016s
I20260709 13:22:19.722364 28598 tablet_bootstrap.cc:654] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.723078 28599 raft_consensus.cc:359] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.723902 28599 raft_consensus.cc:385] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.724195 28599 raft_consensus.cc:740] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.724951 28599 consensus_queue.cc:260] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.727953 28599 ts_tablet_manager.cc:1434] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:19.729161 28599 tablet_bootstrap.cc:492] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.738636 28599 tablet_bootstrap.cc:654] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.739447 28598 tablet_bootstrap.cc:492] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.740047 28598 ts_tablet_manager.cc:1403] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:22:19.743670 28598 raft_consensus.cc:359] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.744617 28598 raft_consensus.cc:385] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.745019 28598 raft_consensus.cc:740] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.746559 28598 consensus_queue.cc:260] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.748548 28598 ts_tablet_manager.cc:1434] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:22:19.749517 28598 tablet_bootstrap.cc:492] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.750160 28599 tablet_bootstrap.cc:492] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.750689 28599 ts_tablet_manager.cc:1403] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:22:19.754029 28600 tablet_bootstrap.cc:492] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.754611 28600 ts_tablet_manager.cc:1403] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.030s
I20260709 13:22:19.753626 28599 raft_consensus.cc:359] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.755121 28599 raft_consensus.cc:385] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.755437 28599 raft_consensus.cc:740] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.756156 28599 consensus_queue.cc:260] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.758582 28599 ts_tablet_manager.cc:1434] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:19.759531 28599 tablet_bootstrap.cc:492] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.760100 28598 tablet_bootstrap.cc:654] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.760794 28600 raft_consensus.cc:359] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.761627 28600 raft_consensus.cc:385] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.761969 28600 raft_consensus.cc:740] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.762727 28600 consensus_queue.cc:260] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.765050 28600 ts_tablet_manager.cc:1434] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:19.766047 28600 tablet_bootstrap.cc:492] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.766510 28599 tablet_bootstrap.cc:654] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.770931 28544 raft_consensus.cc:493] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.771471 28544 raft_consensus.cc:515] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.772835 28600 tablet_bootstrap.cc:654] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.773737 28544 leader_election.cc:290] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.775630 28599 tablet_bootstrap.cc:492] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.775861 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8031e23012f64b8f9931a64f390499e8" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:19.776098 28599 ts_tablet_manager.cc:1403] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:22:19.776520 28388 raft_consensus.cc:2468] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:19.777650 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8031e23012f64b8f9931a64f390499e8" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:19.778266 28462 raft_consensus.cc:2468] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:19.778957 28599 raft_consensus.cc:359] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.779649 28599 raft_consensus.cc:385] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.779525 28280 leader_election.cc:304] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:19.780088 28599 raft_consensus.cc:740] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.780965 28607 raft_consensus.cc:2804] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.781196 28598 tablet_bootstrap.cc:492] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.781373 28607 raft_consensus.cc:493] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.781659 28598 ts_tablet_manager.cc:1403] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.006s
I20260709 13:22:19.781705 28607 raft_consensus.cc:3060] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.782238 28544 raft_consensus.cc:493] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.783037 28544 raft_consensus.cc:515] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.784443 28598 raft_consensus.cc:359] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.785224 28598 raft_consensus.cc:385] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.785534 28598 raft_consensus.cc:740] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.785322 28599 consensus_queue.cc:260] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.786340 28598 consensus_queue.cc:260] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.788748 28598 ts_tablet_manager.cc:1434] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:22:19.790406 28599 ts_tablet_manager.cc:1434] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260709 13:22:19.791326 28599 tablet_bootstrap.cc:492] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b: Bootstrap starting.
I20260709 13:22:19.792002 28598 tablet_bootstrap.cc:492] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: Bootstrap starting.
I20260709 13:22:19.795516 28611 raft_consensus.cc:493] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.796078 28611 raft_consensus.cc:515] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.798117 28611 leader_election.cc:290] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.798370 28599 tablet_bootstrap.cc:654] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.798975 28312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:19.799831 28312 raft_consensus.cc:2468] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:19.801205 28353 leader_election.cc:304] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.802040 28611 raft_consensus.cc:2804] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.802371 28611 raft_consensus.cc:493] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.802678 28611 raft_consensus.cc:3060] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.804665 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
W20260709 13:22:19.806183 28278 leader_election.cc:343] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.806622 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:19.807512 28462 raft_consensus.cc:2468] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:19.808264 28554 raft_consensus.cc:493] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.806203 28510 raft_consensus.cc:493] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.808791 28554 raft_consensus.cc:515] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.809180 28510 raft_consensus.cc:515] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.808480 28544 leader_election.cc:290] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.810946 28554 leader_election.cc:290] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.811713 28510 leader_election.cc:290] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:19.815871 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:19.816548 28314 raft_consensus.cc:2468] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:19.817564 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58307189141944e29874da9302d7f6e2" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:19.817416 28312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58307189141944e29874da9302d7f6e2" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:19.818365 28600 tablet_bootstrap.cc:492] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.821946 28600 ts_tablet_manager.cc:1403] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.010s
I20260709 13:22:19.819185 28353 leader_election.cc:304] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
W20260709 13:22:19.819258 28427 leader_election.cc:343] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.825776 28600 raft_consensus.cc:359] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.826529 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:19.823491 28554 raft_consensus.cc:2804] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.826555 28600 raft_consensus.cc:385] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.827405 28554 raft_consensus.cc:493] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.827576 28600 raft_consensus.cc:740] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.822259 28510 raft_consensus.cc:493] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.827826 28554 raft_consensus.cc:3060] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.822196 28611 raft_consensus.cc:515] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.835590 28600 consensus_queue.cc:260] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.836850 28611 leader_election.cc:290] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.837718 28598 tablet_bootstrap.cc:654] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.821714 28312 raft_consensus.cc:2468] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 0.
I20260709 13:22:19.826169 28607 raft_consensus.cc:515] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.842031 28427 leader_election.cc:304] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:19.842464 28607 leader_election.cc:290] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.842306 28554 raft_consensus.cc:515] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.843981 28312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:19.834203 28599 tablet_bootstrap.cc:492] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b: No bootstrap required, opened a new log
I20260709 13:22:19.818557 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:19.844713 28554 leader_election.cc:290] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.847658 28462 raft_consensus.cc:2468] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:19.844677 28312 raft_consensus.cc:3060] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.848090 28629 raft_consensus.cc:2804] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.848294 28599 ts_tablet_manager.cc:1403] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.019s
I20260709 13:22:19.848590 28629 raft_consensus.cc:493] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.849027 28629 raft_consensus.cc:3060] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.849363 28280 leader_election.cc:304] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:19.846066 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:19.850483 28607 raft_consensus.cc:2804] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.850901 28607 raft_consensus.cc:493] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.850920 28314 raft_consensus.cc:3060] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.851280 28599 raft_consensus.cc:359] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.852049 28599 raft_consensus.cc:385] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.852352 28599 raft_consensus.cc:740] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.853040 28599 consensus_queue.cc:260] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.846451 28600 ts_tablet_manager.cc:1434] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:22:19.854967 28600 tablet_bootstrap.cc:492] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.855183 28599 ts_tablet_manager.cc:1434] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:19.855700 28510 raft_consensus.cc:515] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.856644 28463 raft_consensus.cc:2468] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:19.858924 28314 raft_consensus.cc:2468] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:19.860082 28353 leader_election.cc:304] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.860216 28510 leader_election.cc:290] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:19.861145 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8031e23012f64b8f9931a64f390499e8" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:19.861742 28388 raft_consensus.cc:3060] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.861783 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8031e23012f64b8f9931a64f390499e8" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:19.862480 28463 raft_consensus.cc:3060] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.862746 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
W20260709 13:22:19.863197 28260 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:19.863512 28313 raft_consensus.cc:2393] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 238ba152154c47ca9d461295041ff4cb in current term 1: Already voted for candidate b3cbce46d4d34801b930867d57fd971a in this term.
I20260709 13:22:19.851255 28607 raft_consensus.cc:3060] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.869517 28554 raft_consensus.cc:2804] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.870042 28554 raft_consensus.cc:697] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:19.870160 28628 raft_consensus.cc:493] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.870252 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:19.870779 28628 raft_consensus.cc:515] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.870858 28554 consensus_queue.cc:237] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.873293 28628 leader_election.cc:290] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.873946 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c38ba4d9d441681a2f9688d4e13ee" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:19.874563 28313 raft_consensus.cc:2468] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:19.875204 28600 tablet_bootstrap.cc:654] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.870937 28463 raft_consensus.cc:2468] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:19.875872 28353 leader_election.cc:304] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.868420 28629 raft_consensus.cc:515] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.876854 28628 raft_consensus.cc:2804] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.877393 28628 raft_consensus.cc:493] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.877823 28628 raft_consensus.cc:3060] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.878417 28629 leader_election.cc:290] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:19.875088 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:19.881691 28462 raft_consensus.cc:3060] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.882145 28388 raft_consensus.cc:2468] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:19.889333 28278 leader_election.cc:304] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.890306 28544 raft_consensus.cc:2804] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.890882 28544 raft_consensus.cc:697] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:19.891829 28544 consensus_queue.cc:237] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.900429 28629 raft_consensus.cc:493] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.900995 28629 raft_consensus.cc:515] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.903079 28629 leader_election.cc:290] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:19.902983 28312 raft_consensus.cc:2468] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:19.904110 28600 tablet_bootstrap.cc:492] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.904395 28353 leader_election.cc:304] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.904663 28600 ts_tablet_manager.cc:1403] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.010s
I20260709 13:22:19.905267 28554 raft_consensus.cc:2804] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.905504 28614 raft_consensus.cc:493] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.906061 28554 raft_consensus.cc:697] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:19.906024 28614 raft_consensus.cc:515] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.907148 28554 consensus_queue.cc:237] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.907831 28600 raft_consensus.cc:359] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.908241 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:19.908610 28600 raft_consensus.cc:385] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.908911 28463 raft_consensus.cc:3060] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.908999 28600 raft_consensus.cc:740] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.909821 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66827369c92b4c86b27ae62411e30511" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:19.910495 28388 raft_consensus.cc:2468] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:19.910108 28600 consensus_queue.cc:260] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.911936 28278 leader_election.cc:304] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.912212 28600 ts_tablet_manager.cc:1434] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:22:19.908272 28614 leader_election.cc:290] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.913590 28614 raft_consensus.cc:2804] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.913920 28614 raft_consensus.cc:493] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.914198 28614 raft_consensus.cc:3060] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.920707 28463 raft_consensus.cc:2468] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:19.925594 28628 raft_consensus.cc:515] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.931469 28600 tablet_bootstrap.cc:492] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:19.925947 28614 raft_consensus.cc:515] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.933570 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c38ba4d9d441681a2f9688d4e13ee" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:19.934201 28313 raft_consensus.cc:3060] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.935333 28614 leader_election.cc:290] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.936266 28211 catalog_manager.cc:5697] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:19.929272 28312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c38ba4d9d441681a2f9688d4e13ee" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:19.930267 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c38ba4d9d441681a2f9688d4e13ee" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:19.928134 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58307189141944e29874da9302d7f6e2" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:19.938822 28389 raft_consensus.cc:2393] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 238ba152154c47ca9d461295041ff4cb in current term 1: Already voted for candidate b3cbce46d4d34801b930867d57fd971a in this term.
I20260709 13:22:19.927166 28314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58307189141944e29874da9302d7f6e2" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:19.940351 28314 raft_consensus.cc:3060] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.930083 28212 catalog_manager.cc:5697] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 1 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:19.941223 28313 raft_consensus.cc:2468] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:19.941859 28628 leader_election.cc:290] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.941936 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66827369c92b4c86b27ae62411e30511" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:19.942396 28353 leader_election.cc:304] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.940362 28600 tablet_bootstrap.cc:654] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:19.942596 28389 raft_consensus.cc:3060] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.943681 28628 raft_consensus.cc:2804] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.944188 28628 raft_consensus.cc:697] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:19.920866 28607 raft_consensus.cc:515] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.945166 28628 consensus_queue.cc:237] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.947852 28607 leader_election.cc:290] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.948487 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:19.949306 28388 raft_consensus.cc:3060] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.952806 28314 raft_consensus.cc:2468] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 1.
I20260709 13:22:19.955853 28461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66827369c92b4c86b27ae62411e30511" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:19.956527 28461 raft_consensus.cc:2468] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 0.
I20260709 13:22:19.957288 28460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66827369c92b4c86b27ae62411e30511" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:19.958014 28460 raft_consensus.cc:3060] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.958333 28598 tablet_bootstrap.cc:492] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: No bootstrap required, opened a new log
I20260709 13:22:19.958600 28388 raft_consensus.cc:2468] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:19.958863 28598 ts_tablet_manager.cc:1403] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: Time spent bootstrapping tablet: real 0.167s	user 0.013s	sys 0.006s
I20260709 13:22:19.959844 28278 leader_election.cc:304] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.961773 28598 raft_consensus.cc:359] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.928311 28462 raft_consensus.cc:2468] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:19.962474 28598 raft_consensus.cc:385] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:19.962807 28598 raft_consensus.cc:740] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Initialized, Role: FOLLOWER
I20260709 13:22:19.963053 28607 raft_consensus.cc:2804] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.963634 28607 raft_consensus.cc:697] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:19.964735 28607 consensus_queue.cc:237] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.965857 28598 consensus_queue.cc:260] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.967331 28460 raft_consensus.cc:2468] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:19.954690 28389 raft_consensus.cc:2468] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
W20260709 13:22:19.971932 28427 leader_election.cc:343] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:19.972355 28278 leader_election.cc:304] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.929183 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c38ba4d9d441681a2f9688d4e13ee" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:19.973203 28463 raft_consensus.cc:2468] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:19.973309 28614 raft_consensus.cc:2804] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.974043 28614 raft_consensus.cc:697] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:19.972186 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:19.974890 28614 consensus_queue.cc:237] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.975359 28598 ts_tablet_manager.cc:1434] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:22:19.975705 28462 raft_consensus.cc:3060] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.976446 28627 raft_consensus.cc:493] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:19.975898 28427 leader_election.cc:304] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb; no voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:19.981592 28627 raft_consensus.cc:515] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.982331 28629 raft_consensus.cc:2749] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.982792 28427 leader_election.cc:304] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb; no voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:19.983532 28629 raft_consensus.cc:3060] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.983958 28427 leader_election.cc:304] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:19.984755 28510 raft_consensus.cc:2804] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:19.985648 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:19.986560 28313 raft_consensus.cc:2468] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:19.987903 28353 leader_election.cc:304] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:19.988862 28554 raft_consensus.cc:2804] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:19.989296 28554 raft_consensus.cc:493] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:19.989652 28554 raft_consensus.cc:3060] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:19.992210 28600 tablet_bootstrap.cc:492] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:19.992738 28600 ts_tablet_manager.cc:1403] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.009s
I20260709 13:22:19.995682 28600 raft_consensus.cc:359] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.996857 28629 raft_consensus.cc:2749] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:19.996997 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5c38ba4d9d441681a2f9688d4e13ee" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:19.997933 28510 raft_consensus.cc:697] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:20.002957 28510 consensus_queue.cc:237] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.998165 28627 leader_election.cc:290] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:19.998646 28554 raft_consensus.cc:515] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:19.999027 28461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb" is_pre_election: true
I20260709 13:22:20.005988 28461 raft_consensus.cc:2468] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 0.
I20260709 13:22:20.007041 28462 raft_consensus.cc:2468] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 1.
I20260709 13:22:20.009052 28554 leader_election.cc:290] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:20.009799 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:20.010437 28313 raft_consensus.cc:3060] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.011564 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:20.012809 28600 raft_consensus.cc:385] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.013127 28600 raft_consensus.cc:740] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.013796 28600 consensus_queue.cc:260] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.016204 28600 ts_tablet_manager.cc:1434] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:22:20.015504 28211 catalog_manager.cc:5697] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.017413 28211 catalog_manager.cc:5697] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.018256 28600 tablet_bootstrap.cc:492] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a: Bootstrap starting.
I20260709 13:22:20.019999 28313 raft_consensus.cc:2468] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:20.021445 28463 raft_consensus.cc:2468] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:20.021405 28353 leader_election.cc:304] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:20.022665 28554 raft_consensus.cc:2804] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.023132 28554 raft_consensus.cc:697] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:20.024255 28462 raft_consensus.cc:3060] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.023939 28554 consensus_queue.cc:237] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.028586 28600 tablet_bootstrap.cc:654] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.031635 28462 raft_consensus.cc:2468] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 1.
I20260709 13:22:20.039299 28207 catalog_manager.cc:5697] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 1 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.045703 28600 tablet_bootstrap.cc:492] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a: No bootstrap required, opened a new log
I20260709 13:22:20.046216 28600 ts_tablet_manager.cc:1403] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.003s
I20260709 13:22:20.046833 28212 catalog_manager.cc:5697] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 1 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.048144 28212 catalog_manager.cc:5697] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 1 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.048965 28600 raft_consensus.cc:359] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.049641 28600 raft_consensus.cc:385] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.049860 28600 raft_consensus.cc:740] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.050540 28600 consensus_queue.cc:260] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.052834 28600 ts_tablet_manager.cc:1434] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:22:20.055019 28211 catalog_manager.cc:5697] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 1 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.061275 28510 raft_consensus.cc:493] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.061806 28510 raft_consensus.cc:515] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.063923 28510 leader_election.cc:290] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:20.064608 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b" is_pre_election: true
I20260709 13:22:20.065136 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a" is_pre_election: true
I20260709 13:22:20.065313 28313 raft_consensus.cc:2468] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 0.
I20260709 13:22:20.065812 28388 raft_consensus.cc:2468] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 0.
I20260709 13:22:20.066613 28427 leader_election.cc:304] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:20.067371 28510 raft_consensus.cc:2804] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.067735 28510 raft_consensus.cc:493] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.068070 28510 raft_consensus.cc:3060] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.073591 28510 raft_consensus.cc:515] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.075024 28510 leader_election.cc:290] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:20.075825 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:20.076068 28388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:20.076335 28313 raft_consensus.cc:3060] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.076699 28388 raft_consensus.cc:3060] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.082261 28388 raft_consensus.cc:2468] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 1.
I20260709 13:22:20.082942 28313 raft_consensus.cc:2468] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 1.
I20260709 13:22:20.083137 28427 leader_election.cc:304] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:20.083957 28510 raft_consensus.cc:2804] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:20.084419 28510 raft_consensus.cc:697] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:20.085213 28510 consensus_queue.cc:237] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.093149 28212 catalog_manager.cc:5697] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 1 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:20.160499 28388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
mode: GRACEFUL
new_leader_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:50876
I20260709 13:22:20.161010 28388 raft_consensus.cc:606] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Received request to transfer leadership to TS 2b5c647a9d774626be162778d230192b
I20260709 13:22:20.165429 28388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
mode: GRACEFUL
new_leader_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:50876
I20260709 13:22:20.166028 28388 raft_consensus.cc:606] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Received request to transfer leadership to TS 2b5c647a9d774626be162778d230192b
I20260709 13:22:20.177932 28313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e"
dest_uuid: "2b5c647a9d774626be162778d230192b"
mode: GRACEFUL
new_leader_uuid: "b3cbce46d4d34801b930867d57fd971a"
 from {username='slave'} at 127.0.0.1:55366
I20260709 13:22:20.178442 28313 raft_consensus.cc:606] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Received request to transfer leadership to TS b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:20.186008 28462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
mode: GRACEFUL
new_leader_uuid: "b3cbce46d4d34801b930867d57fd971a"
 from {username='slave'} at 127.0.0.1:47306
I20260709 13:22:20.186506 28462 raft_consensus.cc:606] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Received request to transfer leadership to TS b3cbce46d4d34801b930867d57fd971a
I20260709 13:22:20.260535 28554 consensus_queue.cc:1048] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.270291 28627 raft_consensus.cc:993] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: : Instructing follower 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:20.270787 28627 raft_consensus.cc:1081] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Signalling peer 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:20.273345 28628 consensus_queue.cc:1048] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.278906 28312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694"
dest_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:22:20.279562 28312 raft_consensus.cc:493] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:20.279953 28312 raft_consensus.cc:3060] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.292114 28312 raft_consensus.cc:515] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.298236 28312 leader_election.cc:290] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:20.301337 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:20.303961 28462 raft_consensus.cc:3060] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.304009 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b579cd7832a44ede9f3a4388b6cea694" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:20.305210 28389 raft_consensus.cc:3055] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:20.305514 28389 raft_consensus.cc:740] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:20.306228 28389 consensus_queue.cc:260] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.307425 28389 raft_consensus.cc:3060] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.309013 28628 consensus_queue.cc:1048] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.311611 28462 raft_consensus.cc:2468] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:20.312662 28280 leader_election.cc:304] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:20.313501 28607 raft_consensus.cc:2804] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:20.314028 28607 raft_consensus.cc:697] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:20.314822 28607 consensus_queue.cc:237] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.324520 28611 consensus_queue.cc:1048] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.328078 28212 catalog_manager.cc:5697] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 1 to 2, leader changed from b3cbce46d4d34801b930867d57fd971a (127.17.139.2) to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 2 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.330258 28389 raft_consensus.cc:2468] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:20.338403 28607 consensus_queue.cc:1048] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.352358 28633 consensus_queue.cc:1048] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.354015 28554 raft_consensus.cc:993] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: : Instructing follower 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:20.354552 28554 raft_consensus.cc:1081] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Signalling peer 2b5c647a9d774626be162778d230192b to start an election
I20260709 13:22:20.356426 28312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed"
dest_uuid: "2b5c647a9d774626be162778d230192b"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:22:20.357071 28312 raft_consensus.cc:493] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:20.357522 28312 raft_consensus.cc:3060] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.364984 28614 consensus_queue.cc:1048] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.369320 28312 raft_consensus.cc:515] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.372540 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:20.372844 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d05d0393bba84ec6a83709942c5ff1ed" candidate_uuid: "2b5c647a9d774626be162778d230192b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:20.373206 28389 raft_consensus.cc:3055] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:20.373502 28463 raft_consensus.cc:3060] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.373548 28389 raft_consensus.cc:740] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:20.374505 28389 consensus_queue.cc:260] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.375651 28389 raft_consensus.cc:3060] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.378250 28614 raft_consensus.cc:993] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: : Instructing follower b3cbce46d4d34801b930867d57fd971a to start an election
I20260709 13:22:20.378713 28614 raft_consensus.cc:1081] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Signalling peer b3cbce46d4d34801b930867d57fd971a to start an election
I20260709 13:22:20.381974 28387 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
 from {username='slave'} at 127.0.0.1:50860
I20260709 13:22:20.382529 28387 raft_consensus.cc:493] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:20.382889 28389 raft_consensus.cc:2468] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:20.382905 28387 raft_consensus.cc:3060] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.386389 28463 raft_consensus.cc:2468] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5c647a9d774626be162778d230192b in term 2.
I20260709 13:22:20.387339 28607 consensus_queue.cc:1048] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.389094 28312 leader_election.cc:290] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:20.389624 28278 leader_election.cc:304] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:20.392587 28544 raft_consensus.cc:2804] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:20.393152 28544 raft_consensus.cc:697] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Becoming Leader. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:20.393548 28614 consensus_queue.cc:1048] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.394009 28544 consensus_queue.cc:237] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.399050 28387 raft_consensus.cc:515] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.400126 28388 raft_consensus.cc:1240] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Rejecting Update request from peer 2b5c647a9d774626be162778d230192b for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:20.404436 28211 catalog_manager.cc:5697] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b reported cstate change: term changed from 1 to 2, leader changed from b3cbce46d4d34801b930867d57fd971a (127.17.139.2) to 2b5c647a9d774626be162778d230192b (127.17.139.1). New cstate: current_term: 2 leader_uuid: "2b5c647a9d774626be162778d230192b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.404832 28544 consensus_queue.cc:1059] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:22:20.410575 28614 raft_consensus.cc:3055] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:20.410928 28614 raft_consensus.cc:740] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:20.411597 28614 consensus_queue.cc:260] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.412222 28614 raft_consensus.cc:3060] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.417538 28389 raft_consensus.cc:3060] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.420544 28614 consensus_queue.cc:1048] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.424044 28312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:20.426131 28510 consensus_queue.cc:1048] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.426894 28387 leader_election.cc:290] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 2 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:20.429155 28462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b28b7727a5a453a9288ec80b960df8e" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:20.431545 28312 raft_consensus.cc:2468] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 2.
I20260709 13:22:20.433458 28353 leader_election.cc:304] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:20.434743 28611 raft_consensus.cc:2804] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:20.435393 28611 raft_consensus.cc:697] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 2 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:20.436429 28611 consensus_queue.cc:237] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.440398 28628 consensus_queue.cc:1048] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.442179 28628 consensus_queue.cc:1048] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:20.464035 28629 consensus_queue.cc:1048] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.479497 28212 catalog_manager.cc:5697] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 1 to 2, leader changed from 2b5c647a9d774626be162778d230192b (127.17.139.1) to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 2 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.551450 28611 consensus_queue.cc:1048] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.562423 28554 consensus_queue.cc:1048] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.654151 28629 consensus_queue.cc:1048] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.660215 28642 raft_consensus.cc:993] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: : Instructing follower b3cbce46d4d34801b930867d57fd971a to start an election
I20260709 13:22:20.660773 28510 raft_consensus.cc:1081] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Signalling peer b3cbce46d4d34801b930867d57fd971a to start an election
I20260709 13:22:20.662395 28387 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
 from {username='slave'} at 127.0.0.1:50866
I20260709 13:22:20.662966 28387 raft_consensus.cc:493] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:20.663345 28387 raft_consensus.cc:3060] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.667631 28629 consensus_queue.cc:1048] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:20.670708 28387 raft_consensus.cc:515] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.673799 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:20.674347 28313 raft_consensus.cc:3060] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.675838 28463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58b425795f3a4879a3b6c8a158ccbf9b" candidate_uuid: "b3cbce46d4d34801b930867d57fd971a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "238ba152154c47ca9d461295041ff4cb"
I20260709 13:22:20.676445 28463 raft_consensus.cc:3055] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:20.676738 28463 raft_consensus.cc:740] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:20.677557 28463 consensus_queue.cc:260] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.678658 28463 raft_consensus.cc:3060] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.679330 28387 leader_election.cc:290] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 2 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), 238ba152154c47ca9d461295041ff4cb (127.17.139.3:40815)
I20260709 13:22:20.681588 28313 raft_consensus.cc:2468] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 2.
I20260709 13:22:20.682854 28353 leader_election.cc:304] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5c647a9d774626be162778d230192b, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:20.683724 28554 raft_consensus.cc:2804] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:20.684188 28554 raft_consensus.cc:697] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 2 LEADER]: Becoming Leader. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:20.684988 28554 consensus_queue.cc:237] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:20.685773 28463 raft_consensus.cc:2468] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbce46d4d34801b930867d57fd971a in term 2.
I20260709 13:22:20.693481 28212 catalog_manager.cc:5697] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a reported cstate change: term changed from 1 to 2, leader changed from 238ba152154c47ca9d461295041ff4cb (127.17.139.3) to b3cbce46d4d34801b930867d57fd971a (127.17.139.2). New cstate: current_term: 2 leader_uuid: "b3cbce46d4d34801b930867d57fd971a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:20.775661 28463 raft_consensus.cc:1275] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.776850 28614 consensus_queue.cc:1048] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:20.784247 28387 raft_consensus.cc:1275] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.786499 28607 consensus_queue.cc:1048] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:20.833644 28463 raft_consensus.cc:1275] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.835189 28607 consensus_queue.cc:1048] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:20.842826 28387 raft_consensus.cc:1275] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 2b5c647a9d774626be162778d230192b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.844481 28607 consensus_queue.cc:1048] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:20.904927 28313 raft_consensus.cc:1275] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Refusing update from remote peer b3cbce46d4d34801b930867d57fd971a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.906170 28627 consensus_queue.cc:1048] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:20.911653 28463 raft_consensus.cc:3060] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:20.919513 28463 raft_consensus.cc:1275] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer b3cbce46d4d34801b930867d57fd971a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:20.920775 28628 consensus_queue.cc:1048] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:21.165133 28313 raft_consensus.cc:1275] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Refusing update from remote peer b3cbce46d4d34801b930867d57fd971a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:21.166531 28554 consensus_queue.cc:1048] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:21.176386 28463 raft_consensus.cc:1275] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Refusing update from remote peer b3cbce46d4d34801b930867d57fd971a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:21.178596 28611 consensus_queue.cc:1048] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [LEADER]: Connected to new peer: Peer: permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.192662 28211 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54978:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:23.218480 28211 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54978:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:23.244122 17964 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:22:23.501720 28353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:38227, user_credentials={real_user=slave}} blocked reactor thread for 44553us
I20260709 13:22:23.507356 28388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
mode: GRACEFUL
new_leader_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:59376
I20260709 13:22:23.530129 28721 tablet.cc:1724] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.541772 28717 tablet.cc:1724] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.562388 28388 raft_consensus.cc:606] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Received request to transfer leadership to TS 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:23.562942 28728 tablet.cc:1724] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.589187 28611 raft_consensus.cc:993] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: : Instructing follower 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:23.589859 28611 raft_consensus.cc:1081] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Signalling peer 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:23.606875 28731 tablet.cc:1724] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.619302 28730 tablet.cc:1724] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:23.632332 28278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:42347, user_credentials={real_user=slave}} blocked reactor thread for 50028us
I20260709 13:22:23.637410 28732 tablet.cc:1724] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:23.640801 28415 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1d5c38ba4d9d441681a2f9688d4e13ee)
W20260709 13:22:23.643857 28415 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1d5c38ba4d9d441681a2f9688d4e13ee)
I20260709 13:22:23.540771 28719 tablet.cc:1724] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:23.681141 28489 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1d5c38ba4d9d441681a2f9688d4e13ee)
W20260709 13:22:23.684916 28280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:40815, user_credentials={real_user=slave}} blocked reactor thread for 53127.4us
I20260709 13:22:23.706650 28736 tablet.cc:1724] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.725111 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:47304
I20260709 13:22:23.726157 28459 raft_consensus.cc:493] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.726697 28459 raft_consensus.cc:3060] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.741853 28717 tablet.cc:1724] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.749702 28740 tablet.cc:1724] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:23.753429 28427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:42347, user_credentials={real_user=slave}} blocked reactor thread for 74427.5us
I20260709 13:22:23.736841 28721 tablet.cc:1724] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.780120 28739 tablet.cc:1724] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:23.771709 28278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:42347, user_credentials={real_user=slave}} blocked reactor thread for 70258.2us
I20260709 13:22:23.781505 28732 tablet.cc:1724] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.809523 28743 tablet.cc:1724] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.815544 28721 tablet.cc:1724] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.818270 28717 tablet.cc:1724] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.819590 28740 tablet.cc:1724] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.821125 28728 tablet.cc:1724] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.824160 28746 tablet.cc:1724] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.779559 28731 tablet.cc:1724] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.829618 28459 raft_consensus.cc:515] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:23.843951 28719 tablet.cc:1724] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.844250 28730 tablet.cc:1724] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.857936 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:23.858688 28313 raft_consensus.cc:3060] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.836190 28736 tablet.cc:1724] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.857395 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378dc6cba506434a9b67aa6bf6310ca4" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:23.861809 28389 raft_consensus.cc:3055] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.862229 28389 raft_consensus.cc:740] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:23.862697 28459 leader_election.cc:290] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:23.867679 28312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66827369c92b4c86b27ae62411e30511"
dest_uuid: "2b5c647a9d774626be162778d230192b"
mode: GRACEFUL
new_leader_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:52666
I20260709 13:22:23.869329 28312 raft_consensus.cc:606] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Received request to transfer leadership to TS 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:23.870353 28389 consensus_queue.cc:260] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:23.873040 17964 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:22:23.873746 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:23.873824 28389 raft_consensus.cc:3060] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.885380 28389 raft_consensus.cc:2468] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:23.885550 28388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545"
dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
mode: GRACEFUL
new_leader_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:59376
I20260709 13:22:23.886694 28388 raft_consensus.cc:606] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Received request to transfer leadership to TS 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:23.887457 28427 leader_election.cc:304] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:23.888528 28738 raft_consensus.cc:2804] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.889813 28312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5"
dest_uuid: "2b5c647a9d774626be162778d230192b"
mode: GRACEFUL
new_leader_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:52666
I20260709 13:22:23.890451 28312 raft_consensus.cc:606] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Received request to transfer leadership to TS 238ba152154c47ca9d461295041ff4cb
I20260709 13:22:23.891921 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:23.899155 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:23.901592 28739 tablet.cc:1724] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.901834 28740 tablet.cc:1724] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.892462 28738 raft_consensus.cc:697] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:23.893779 28743 tablet.cc:1724] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.904817 28738 consensus_queue.cc:237] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:23.897363 28746 tablet.cc:1724] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:23.910079 28670 raft_consensus.cc:993] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b: : Instructing follower 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:23.910514 28670 raft_consensus.cc:1081] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Signalling peer 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:23.912389 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:47300
I20260709 13:22:23.912930 28459 raft_consensus.cc:493] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.913317 28459 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:23.918008 28207 catalog_manager.cc:5697] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 1 to 2, leader changed from b3cbce46d4d34801b930867d57fd971a (127.17.139.2) to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:23.896682 28313 raft_consensus.cc:2468] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:23.924151 28459 raft_consensus.cc:515] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:23.927249 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:23.927856 28389 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:23.927927 28459 leader_election.cc:290] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 3 election: Requested vote from peers b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347), 2b5c647a9d774626be162778d230192b (127.17.139.1:38227)
I20260709 13:22:23.928848 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef5f9b8141a4dd49ee1ff50783020f5" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:23.929498 28313 raft_consensus.cc:3055] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:23.930469 28313 raft_consensus.cc:740] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:23.931425 28313 consensus_queue.cc:260] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:23.932716 28313 raft_consensus.cc:3060] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:23.935034 28389 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 3.
I20260709 13:22:23.936350 28427 leader_election.cc:304] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:23.937228 28738 raft_consensus.cc:2804] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:23.937876 28738 raft_consensus.cc:697] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 3 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:23.938954 28738 consensus_queue.cc:237] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:23.939651 28313 raft_consensus.cc:2468] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 3.
I20260709 13:22:23.965973 28207 catalog_manager.cc:6242] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f: soft_deleted_table [id=1fdb25a7693448559b0dad664604cebc] alter complete (version 1)
I20260709 13:22:23.972652 28207 catalog_manager.cc:5697] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 2 to 3, leader changed from 2b5c647a9d774626be162778d230192b (127.17.139.1) to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 3 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:24.104101 28724 raft_consensus.cc:993] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: : Instructing follower 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:24.104665 28729 raft_consensus.cc:1081] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Signalling peer 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:24.106077 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66827369c92b4c86b27ae62411e30511"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:47300
I20260709 13:22:24.106499 28459 raft_consensus.cc:493] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:24.106738 28459 raft_consensus.cc:3060] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:24.111930 28459 raft_consensus.cc:515] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:24.113520 28459 leader_election.cc:290] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:24.114365 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66827369c92b4c86b27ae62411e30511" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:24.114756 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66827369c92b4c86b27ae62411e30511" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:24.115039 28313 raft_consensus.cc:3055] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:24.115355 28313 raft_consensus.cc:740] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b5c647a9d774626be162778d230192b, State: Running, Role: LEADER
I20260709 13:22:24.115391 28389 raft_consensus.cc:3060] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:24.116271 28313 consensus_queue.cc:260] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:24.117563 28313 raft_consensus.cc:3060] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:24.123188 28389 raft_consensus.cc:2468] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:24.124359 28427 leader_election.cc:304] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, b3cbce46d4d34801b930867d57fd971a; no voters: 
I20260709 13:22:24.124522 28313 raft_consensus.cc:2468] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:24.125123 28738 raft_consensus.cc:2804] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:24.125571 28738 raft_consensus.cc:697] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:24.126457 28738 consensus_queue.cc:237] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:24.130759 28718 raft_consensus.cc:993] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a: : Instructing follower 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:24.131309 28710 raft_consensus.cc:1081] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Signalling peer 238ba152154c47ca9d461295041ff4cb to start an election
I20260709 13:22:24.132907 28459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545"
dest_uuid: "238ba152154c47ca9d461295041ff4cb"
 from {username='slave'} at 127.0.0.1:47304
I20260709 13:22:24.133427 28459 raft_consensus.cc:493] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:24.133778 28459 raft_consensus.cc:3060] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:24.135262 28207 catalog_manager.cc:5697] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 1 to 2, leader changed from 2b5c647a9d774626be162778d230192b (127.17.139.1) to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:24.140200 28459 raft_consensus.cc:515] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:24.142143 28459 leader_election.cc:290] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Requested vote from peers 2b5c647a9d774626be162778d230192b (127.17.139.1:38227), b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347)
I20260709 13:22:24.142839 28313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b5c647a9d774626be162778d230192b"
I20260709 13:22:24.143237 28389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd18235ba6304fdd9b8365620bc31545" candidate_uuid: "238ba152154c47ca9d461295041ff4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3cbce46d4d34801b930867d57fd971a"
I20260709 13:22:24.143572 28313 raft_consensus.cc:3060] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:24.143874 28389 raft_consensus.cc:3055] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:24.144205 28389 raft_consensus.cc:740] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3cbce46d4d34801b930867d57fd971a, State: Running, Role: LEADER
I20260709 13:22:24.145080 28389 consensus_queue.cc:260] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:24.146433 28389 raft_consensus.cc:3060] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:24.150257 28313 raft_consensus.cc:2468] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:24.151484 28427 leader_election.cc:304] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 238ba152154c47ca9d461295041ff4cb, 2b5c647a9d774626be162778d230192b; no voters: 
I20260709 13:22:24.152117 28738 raft_consensus.cc:2804] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:24.152566 28738 raft_consensus.cc:697] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Becoming Leader. State: Replica: 238ba152154c47ca9d461295041ff4cb, State: Running, Role: LEADER
I20260709 13:22:24.152812 28389 raft_consensus.cc:2468] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 238ba152154c47ca9d461295041ff4cb in term 2.
I20260709 13:22:24.153553 28738 consensus_queue.cc:237] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } }
I20260709 13:22:24.161809 28207 catalog_manager.cc:5697] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb reported cstate change: term changed from 1 to 2, leader changed from b3cbce46d4d34801b930867d57fd971a (127.17.139.2) to 238ba152154c47ca9d461295041ff4cb (127.17.139.3). New cstate: current_term: 2 leader_uuid: "238ba152154c47ca9d461295041ff4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "238ba152154c47ca9d461295041ff4cb" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 40815 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:24.360314 28313 raft_consensus.cc:1275] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 3 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:24.361465 28738 consensus_queue.cc:1048] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:24.374665 28389 raft_consensus.cc:1275] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 3 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:24.377393 28313 raft_consensus.cc:1275] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:24.378949 28629 consensus_queue.cc:1048] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:24.380555 28754 consensus_queue.cc:1048] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:24.381659 28389 raft_consensus.cc:1275] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:24.386816 28738 consensus_queue.cc:1048] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:24.568596 28388 raft_consensus.cc:1275] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:24.569854 28629 consensus_queue.cc:1048] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:24.577744 28313 raft_consensus.cc:1275] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:24.579137 28629 consensus_queue.cc:1048] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:24.614068 28388 raft_consensus.cc:1275] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:24.615243 28629 consensus_queue.cc:1048] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbce46d4d34801b930867d57fd971a" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:24.623476 28313 raft_consensus.cc:1275] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Refusing update from remote peer 238ba152154c47ca9d461295041ff4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:24.625743 28738 consensus_queue.cc:1048] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5c647a9d774626be162778d230192b" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 38227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:24.957361 17964 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:24.962409 17964 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:22:24.962857 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:24.968394 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:22:24.968804 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:25.999845 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
I20260709 13:22:26.033490 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:26.034214 17964 tablet_replica.cc:333] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.034994 17964 raft_consensus.cc:2243] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.035580 17964 raft_consensus.cc:2272] T 378dc6cba506434a9b67aa6bf6310ca4 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.037834 17964 tablet_replica.cc:333] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.038419 17964 raft_consensus.cc:2243] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.039430 17964 raft_consensus.cc:2272] T b579cd7832a44ede9f3a4388b6cea694 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.042174 17964 tablet_replica.cc:333] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.042800 17964 raft_consensus.cc:2243] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.043596 17964 raft_consensus.cc:2272] T 8031e23012f64b8f9931a64f390499e8 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.046084 17964 tablet_replica.cc:333] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.047024 17964 raft_consensus.cc:2243] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.047482 17964 raft_consensus.cc:2272] T 66827369c92b4c86b27ae62411e30511 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.049588 17964 tablet_replica.cc:333] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.050132 17964 raft_consensus.cc:2243] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.050578 17964 raft_consensus.cc:2272] T 8b28b7727a5a453a9288ec80b960df8e P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.052574 17964 tablet_replica.cc:333] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.053234 17964 raft_consensus.cc:2243] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.053675 17964 raft_consensus.cc:2272] T 8d655cb4c3c84af58e4a6fad1f289c40 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.055893 17964 tablet_replica.cc:333] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.056488 17964 raft_consensus.cc:2243] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.057240 17964 raft_consensus.cc:2272] T d05d0393bba84ec6a83709942c5ff1ed P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.059237 17964 tablet_replica.cc:333] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.059769 17964 raft_consensus.cc:2243] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.060237 17964 raft_consensus.cc:2272] T 80bbdc1e691947f0aa4edd44f98f217f P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.062407 17964 tablet_replica.cc:333] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.063007 17964 raft_consensus.cc:2243] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.063457 17964 raft_consensus.cc:2272] T 1d5c38ba4d9d441681a2f9688d4e13ee P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.065546 17964 tablet_replica.cc:333] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.066125 17964 raft_consensus.cc:2243] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.066591 17964 raft_consensus.cc:2272] T 5ba96465c2fa41848022f2ead1233c34 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.068717 17964 tablet_replica.cc:333] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.069298 17964 raft_consensus.cc:2243] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.069845 17964 raft_consensus.cc:2272] T 58307189141944e29874da9302d7f6e2 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.072336 17964 tablet_replica.cc:333] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.073025 17964 raft_consensus.cc:2243] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.073464 17964 raft_consensus.cc:2272] T fef5f9b8141a4dd49ee1ff50783020f5 P 2b5c647a9d774626be162778d230192b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.075775 17964 tablet_replica.cc:333] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.076505 17964 raft_consensus.cc:2243] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.077013 17964 raft_consensus.cc:2272] T 58b425795f3a4879a3b6c8a158ccbf9b P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.079668 17964 tablet_replica.cc:333] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.080127 17964 raft_consensus.cc:2243] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.080895 17964 raft_consensus.cc:2272] T 8418cdfa88484445a1973deb11358a64 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.082824 17964 tablet_replica.cc:333] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.083283 17964 raft_consensus.cc:2243] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.083675 17964 raft_consensus.cc:2272] T 0aa85e395a184869b2b6bb699647d534 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.085608 17964 tablet_replica.cc:333] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.086051 17964 raft_consensus.cc:2243] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.086776 17964 raft_consensus.cc:2272] T 76a02b35be0345f2962b1d827e15e1ce P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.088661 17964 tablet_replica.cc:333] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.089113 17964 raft_consensus.cc:2243] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.089857 17964 raft_consensus.cc:2272] T a111e1284a664153bf0e70987a47e7a9 P 2b5c647a9d774626be162778d230192b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.091835 17964 tablet_replica.cc:333] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b: stopping tablet replica
I20260709 13:22:26.092245 17964 raft_consensus.cc:2243] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.092609 17964 raft_consensus.cc:2272] T fd18235ba6304fdd9b8365620bc31545 P 2b5c647a9d774626be162778d230192b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:26.110021 28353 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 20 similar messages]
W20260709 13:22:26.113059 28353 consensus_peers.cc:597] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:26.123958 28353 consensus_peers.cc:597] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:38227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.127168 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
W20260709 13:22:26.130686 28427 consensus_peers.cc:597] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:38227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:26.132772 28427 consensus_peers.cc:597] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:38227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.163520 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
W20260709 13:22:26.170568 28427 consensus_peers.cc:597] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:38227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:26.176384 28427 consensus_peers.cc:597] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:38227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.202620 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:26.203482 17964 tablet_replica.cc:333] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
W20260709 13:22:26.203943 28427 consensus_peers.cc:597] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb -> Peer b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347): Couldn't send request to peer b3cbce46d4d34801b930867d57fd971a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.204689 17964 raft_consensus.cc:2243] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.205348 17964 raft_consensus.cc:2272] T 378dc6cba506434a9b67aa6bf6310ca4 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.207656 17964 tablet_replica.cc:333] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.208442 17964 raft_consensus.cc:2243] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.209407 17964 raft_consensus.cc:2272] T 8b28b7727a5a453a9288ec80b960df8e P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.211407 17964 tablet_replica.cc:333] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.212033 17964 raft_consensus.cc:2243] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.212474 17964 raft_consensus.cc:2272] T 8031e23012f64b8f9931a64f390499e8 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.214534 17964 tablet_replica.cc:333] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.215083 17964 raft_consensus.cc:2243] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.215528 17964 raft_consensus.cc:2272] T b579cd7832a44ede9f3a4388b6cea694 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.217626 17964 tablet_replica.cc:333] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.218235 17964 raft_consensus.cc:2243] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.218688 17964 raft_consensus.cc:2272] T 66827369c92b4c86b27ae62411e30511 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:26.220109 28427 consensus_peers.cc:597] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb -> Peer b3cbce46d4d34801b930867d57fd971a (127.17.139.2:42347): Couldn't send request to peer b3cbce46d4d34801b930867d57fd971a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.220927 17964 tablet_replica.cc:333] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.221537 17964 raft_consensus.cc:2243] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.222528 17964 raft_consensus.cc:2272] T 8d655cb4c3c84af58e4a6fad1f289c40 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.224649 17964 tablet_replica.cc:333] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.225299 17964 raft_consensus.cc:2243] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.225739 17964 raft_consensus.cc:2272] T d05d0393bba84ec6a83709942c5ff1ed P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.227888 17964 tablet_replica.cc:333] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.228438 17964 raft_consensus.cc:2243] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.229270 17964 raft_consensus.cc:2272] T 80bbdc1e691947f0aa4edd44f98f217f P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.231555 17964 tablet_replica.cc:333] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.232196 17964 raft_consensus.cc:2243] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.232678 17964 raft_consensus.cc:2272] T a111e1284a664153bf0e70987a47e7a9 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.234877 17964 tablet_replica.cc:333] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.235430 17964 raft_consensus.cc:2243] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.235862 17964 raft_consensus.cc:2272] T fd18235ba6304fdd9b8365620bc31545 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.237833 17964 tablet_replica.cc:333] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.238361 17964 raft_consensus.cc:2243] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.239099 17964 raft_consensus.cc:2272] T 58b425795f3a4879a3b6c8a158ccbf9b P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.241509 17964 tablet_replica.cc:333] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.242182 17964 raft_consensus.cc:2243] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.242755 17964 raft_consensus.cc:2272] T 8418cdfa88484445a1973deb11358a64 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.245826 17964 tablet_replica.cc:333] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
W20260709 13:22:26.245838 28427 consensus_peers.cc:597] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:38227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.246542 17964 raft_consensus.cc:2243] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.247323 17964 raft_consensus.cc:2272] T 1d5c38ba4d9d441681a2f9688d4e13ee P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.249486 17964 tablet_replica.cc:333] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.250010 17964 raft_consensus.cc:2243] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.250748 17964 raft_consensus.cc:2272] T 5ba96465c2fa41848022f2ead1233c34 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.252667 17964 tablet_replica.cc:333] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.253273 17964 raft_consensus.cc:2243] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.253716 17964 raft_consensus.cc:2272] T 58307189141944e29874da9302d7f6e2 P b3cbce46d4d34801b930867d57fd971a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.255613 17964 tablet_replica.cc:333] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.256139 17964 raft_consensus.cc:2243] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.256595 17964 raft_consensus.cc:2272] T fef5f9b8141a4dd49ee1ff50783020f5 P b3cbce46d4d34801b930867d57fd971a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.258481 17964 tablet_replica.cc:333] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.258956 17964 raft_consensus.cc:2243] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.259428 17964 raft_consensus.cc:2272] T 76a02b35be0345f2962b1d827e15e1ce P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.261512 17964 tablet_replica.cc:333] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a: stopping tablet replica
I20260709 13:22:26.261962 17964 raft_consensus.cc:2243] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.262413 17964 raft_consensus.cc:2272] T 0aa85e395a184869b2b6bb699647d534 P b3cbce46d4d34801b930867d57fd971a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.304406 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
I20260709 13:22:26.339843 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
W20260709 13:22:26.347867 28427 consensus_peers.cc:597] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb -> Peer 2b5c647a9d774626be162778d230192b (127.17.139.1:38227): Couldn't send request to peer 2b5c647a9d774626be162778d230192b. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:38227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.370256 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:26.371028 17964 tablet_replica.cc:333] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.371748 17964 raft_consensus.cc:2243] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.372553 17964 raft_consensus.cc:2272] T 378dc6cba506434a9b67aa6bf6310ca4 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.374577 17964 tablet_replica.cc:333] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.375190 17964 raft_consensus.cc:2243] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.375640 17964 raft_consensus.cc:2272] T 8b28b7727a5a453a9288ec80b960df8e P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.377553 17964 tablet_replica.cc:333] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.378124 17964 raft_consensus.cc:2243] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.378541 17964 raft_consensus.cc:2272] T b579cd7832a44ede9f3a4388b6cea694 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.380307 17964 tablet_replica.cc:333] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.380827 17964 raft_consensus.cc:2243] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.381273 17964 raft_consensus.cc:2272] T 8031e23012f64b8f9931a64f390499e8 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.383111 17964 tablet_replica.cc:333] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.383670 17964 raft_consensus.cc:2243] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.384382 17964 raft_consensus.cc:2272] T 66827369c92b4c86b27ae62411e30511 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.386366 17964 tablet_replica.cc:333] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.386869 17964 raft_consensus.cc:2243] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.387295 17964 raft_consensus.cc:2272] T 8d655cb4c3c84af58e4a6fad1f289c40 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.389369 17964 tablet_replica.cc:333] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.389873 17964 raft_consensus.cc:2243] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.390288 17964 raft_consensus.cc:2272] T d05d0393bba84ec6a83709942c5ff1ed P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.392087 17964 tablet_replica.cc:333] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.392596 17964 raft_consensus.cc:2243] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.393030 17964 raft_consensus.cc:2272] T 80bbdc1e691947f0aa4edd44f98f217f P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.394942 17964 tablet_replica.cc:333] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.395457 17964 raft_consensus.cc:2243] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.396229 17964 raft_consensus.cc:2272] T 0aa85e395a184869b2b6bb699647d534 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.398108 17964 tablet_replica.cc:333] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.398624 17964 raft_consensus.cc:2243] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.399135 17964 raft_consensus.cc:2272] T 76a02b35be0345f2962b1d827e15e1ce P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.401688 17964 tablet_replica.cc:333] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.402362 17964 raft_consensus.cc:2243] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.403311 17964 raft_consensus.cc:2272] T fd18235ba6304fdd9b8365620bc31545 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.405316 17964 tablet_replica.cc:333] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.405925 17964 raft_consensus.cc:2243] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.406371 17964 raft_consensus.cc:2272] T a111e1284a664153bf0e70987a47e7a9 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.408352 17964 tablet_replica.cc:333] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.408850 17964 raft_consensus.cc:2243] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.409310 17964 raft_consensus.cc:2272] T 1d5c38ba4d9d441681a2f9688d4e13ee P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.411042 17964 tablet_replica.cc:333] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.411545 17964 raft_consensus.cc:2243] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.411953 17964 raft_consensus.cc:2272] T 5ba96465c2fa41848022f2ead1233c34 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.414109 17964 tablet_replica.cc:333] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.414703 17964 raft_consensus.cc:2243] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.415469 17964 raft_consensus.cc:2272] T 58307189141944e29874da9302d7f6e2 P 238ba152154c47ca9d461295041ff4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.417421 17964 tablet_replica.cc:333] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.417907 17964 raft_consensus.cc:2243] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.418603 17964 raft_consensus.cc:2272] T fef5f9b8141a4dd49ee1ff50783020f5 P 238ba152154c47ca9d461295041ff4cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.420481 17964 tablet_replica.cc:333] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.421036 17964 raft_consensus.cc:2243] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.421489 17964 raft_consensus.cc:2272] T 58b425795f3a4879a3b6c8a158ccbf9b P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.423388 17964 tablet_replica.cc:333] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb: stopping tablet replica
I20260709 13:22:26.423852 17964 raft_consensus.cc:2243] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.424273 17964 raft_consensus.cc:2272] T 8418cdfa88484445a1973deb11358a64 P 238ba152154c47ca9d461295041ff4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.463263 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
I20260709 13:22:26.498148 17964 master.cc:562] Master@127.17.139.62:33385 shutting down...
I20260709 13:22:26.517971 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.518465 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.518752 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P af33ebd91dbe449d954e3d9fd17d794f: stopping tablet replica
I20260709 13:22:26.539480 17964 master.cc:584] Master@127.17.139.62:33385 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (11893 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:22:26.591228 17964 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.139.62:35973
I20260709 13:22:26.592530 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:26.598421 28769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:26.598474 28768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:26.599226 28771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:26.601488 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:26.602375 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:26.602559 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:26.602748 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603346602715 us; error 0 us; skew 500 ppm
I20260709 13:22:26.603295 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:26.605908 17964 webserver.cc:533] Webserver started at http://127.17.139.62:43307/ using document root <none> and password file <none>
I20260709 13:22:26.606405 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:26.606591 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:26.606881 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:26.607949 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/master-0-root/instance:
uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d"
format_stamp: "Formatted at 2026-07-09 13:22:26 on dist-test-slave-z675"
I20260709 13:22:26.612258 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:22:26.615698 28776 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:26.616626 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:26.616868 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/master-0-root
uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d"
format_stamp: "Formatted at 2026-07-09 13:22:26 on dist-test-slave-z675"
I20260709 13:22:26.617168 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:26.642351 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:26.643550 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:26.682190 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.62:35973
I20260709 13:22:26.682304 28827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.62:35973 every 8 connection(s)
I20260709 13:22:26.686196 28828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.696838 28828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d: Bootstrap starting.
I20260709 13:22:26.701795 28828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.706076 28828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d: No bootstrap required, opened a new log
I20260709 13:22:26.708218 28828 raft_consensus.cc:359] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" member_type: VOTER }
I20260709 13:22:26.708585 28828 raft_consensus.cc:385] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.708767 28828 raft_consensus.cc:740] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aad5cf689a6b4c6cab1bf72846e1ea1d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.709371 28828 consensus_queue.cc:260] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" member_type: VOTER }
I20260709 13:22:26.709805 28828 raft_consensus.cc:399] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:26.709991 28828 raft_consensus.cc:493] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:26.710193 28828 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.714757 28828 raft_consensus.cc:515] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" member_type: VOTER }
I20260709 13:22:26.715190 28828 leader_election.cc:304] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aad5cf689a6b4c6cab1bf72846e1ea1d; no voters: 
I20260709 13:22:26.716223 28828 leader_election.cc:290] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:26.716531 28831 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.717909 28831 raft_consensus.cc:697] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 1 LEADER]: Becoming Leader. State: Replica: aad5cf689a6b4c6cab1bf72846e1ea1d, State: Running, Role: LEADER
I20260709 13:22:26.718637 28831 consensus_queue.cc:237] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" member_type: VOTER }
I20260709 13:22:26.719413 28828 sys_catalog.cc:565] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:26.723099 28833 sys_catalog.cc:455] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader aad5cf689a6b4c6cab1bf72846e1ea1d. Latest consensus state: current_term: 1 leader_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" member_type: VOTER } }
I20260709 13:22:26.723863 28833 sys_catalog.cc:458] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:26.724776 28832 sys_catalog.cc:455] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aad5cf689a6b4c6cab1bf72846e1ea1d" member_type: VOTER } }
I20260709 13:22:26.725422 28832 sys_catalog.cc:458] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:26.726794 28838 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:26.731540 28838 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:26.734997 17964 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:26.740178 28838 catalog_manager.cc:1383] Generated new cluster ID: 2080790c65e349a8bf83b91e23c664c4
I20260709 13:22:26.740443 28838 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:26.759622 28838 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:26.760932 28838 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:26.775616 28838 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d: Generated new TSK 0
I20260709 13:22:26.776243 28838 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:26.801725 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:26.808018 28849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:26.809441 28850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:26.810947 28852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:26.811388 17964 server_base.cc:1061] running on GCE node
I20260709 13:22:26.812389 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:26.812570 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:26.812779 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603346812762 us; error 0 us; skew 500 ppm
I20260709 13:22:26.813410 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:26.815869 17964 webserver.cc:533] Webserver started at http://127.17.139.1:42117/ using document root <none> and password file <none>
I20260709 13:22:26.816376 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:26.816571 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:26.816928 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:26.818080 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-0-root/instance:
uuid: "11ff4453d5684688997cb71f55cccc32"
format_stamp: "Formatted at 2026-07-09 13:22:26 on dist-test-slave-z675"
I20260709 13:22:26.823081 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:26.826519 28857 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:26.827232 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:22:26.827535 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-0-root
uuid: "11ff4453d5684688997cb71f55cccc32"
format_stamp: "Formatted at 2026-07-09 13:22:26 on dist-test-slave-z675"
I20260709 13:22:26.827778 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:26.846717 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:26.847968 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:26.849489 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:26.851806 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:26.851984 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:26.852159 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:26.852322 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:26.895928 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.1:37935
I20260709 13:22:26.896091 28919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.1:37935 every 8 connection(s)
I20260709 13:22:26.901057 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:26.907676 28924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:26.910785 28925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:26.911473 17964 server_base.cc:1061] running on GCE node
W20260709 13:22:26.912746 28927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:26.913846 28920 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35973
I20260709 13:22:26.914247 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:26.914327 28920 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:26.914635 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:26.914857 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603346914841 us; error 0 us; skew 500 ppm
I20260709 13:22:26.915381 28920 heartbeater.cc:507] Master 127.17.139.62:35973 requested a full tablet report, sending...
I20260709 13:22:26.915655 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:26.917847 28793 ts_manager.cc:194] Registered new tserver with Master: 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935)
I20260709 13:22:26.918401 17964 webserver.cc:533] Webserver started at http://127.17.139.2:45753/ using document root <none> and password file <none>
I20260709 13:22:26.919035 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:26.919234 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:26.919525 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:26.919955 28793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51676
I20260709 13:22:26.920826 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-1-root/instance:
uuid: "a3dcaa525ce54903a0606732f37b73e9"
format_stamp: "Formatted at 2026-07-09 13:22:26 on dist-test-slave-z675"
I20260709 13:22:26.925740 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:22:26.929170 28932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:26.930119 17964 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:22:26.930405 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-1-root
uuid: "a3dcaa525ce54903a0606732f37b73e9"
format_stamp: "Formatted at 2026-07-09 13:22:26 on dist-test-slave-z675"
I20260709 13:22:26.930667 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:26.959429 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:26.960701 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:26.962178 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:26.964303 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:26.964502 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:26.964754 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:26.964908 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:22:27.004079 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.2:43357
I20260709 13:22:27.004269 28994 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.2:43357 every 8 connection(s)
I20260709 13:22:27.008800 17964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:27.015857 28998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:27.017693 28999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:27.020279 17964 server_base.cc:1061] running on GCE node
W20260709 13:22:27.020530 29001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:27.021651 28995 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35973
I20260709 13:22:27.021876 17964 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:27.022045 28995 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:27.022198 17964 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:27.022528 17964 hybrid_clock.cc:648] HybridClock initialized: now 1783603347022502 us; error 0 us; skew 500 ppm
I20260709 13:22:27.022959 28995 heartbeater.cc:507] Master 127.17.139.62:35973 requested a full tablet report, sending...
I20260709 13:22:27.023133 17964 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:27.025413 28793 ts_manager.cc:194] Registered new tserver with Master: a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:27.026041 17964 webserver.cc:533] Webserver started at http://127.17.139.3:34955/ using document root <none> and password file <none>
I20260709 13:22:27.026731 17964 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:27.026975 17964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:27.027298 17964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:27.027354 28793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51688
I20260709 13:22:27.028854 17964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-2-root/instance:
uuid: "f2ce0eedd00d45a192030ea417d443b5"
format_stamp: "Formatted at 2026-07-09 13:22:27 on dist-test-slave-z675"
I20260709 13:22:27.033550 17964 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:22:27.036818 29006 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:27.037551 17964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:27.037860 17964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-2-root
uuid: "f2ce0eedd00d45a192030ea417d443b5"
format_stamp: "Formatted at 2026-07-09 13:22:27 on dist-test-slave-z675"
I20260709 13:22:27.038151 17964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGcpJpS/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603053220357-17964-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:27.057305 17964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:27.058522 17964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:27.060024 17964 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:27.062341 17964 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:27.062572 17964 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:27.062822 17964 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:27.063004 17964 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:27.103106 17964 rpc_server.cc:307] RPC server started. Bound to: 127.17.139.3:35415
I20260709 13:22:27.103243 29068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.139.3:35415 every 8 connection(s)
I20260709 13:22:27.117161 29069 heartbeater.cc:344] Connected to a master server at 127.17.139.62:35973
I20260709 13:22:27.117592 29069 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:27.118368 29069 heartbeater.cc:507] Master 127.17.139.62:35973 requested a full tablet report, sending...
I20260709 13:22:27.120433 28793 ts_manager.cc:194] Registered new tserver with Master: f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.121141 17964 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014847033s
I20260709 13:22:27.122174 28793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51700
I20260709 13:22:27.146541 28793 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51710:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:27.149294 28793 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:27.227795 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 5c50f0e89e544afba188260ee500d39c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:27.230759 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 429ac41e709040e998620c3a56a58850 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:27.231441 28959 tablet_service.cc:1511] Processing CreateTablet for tablet e1c8f576269d4ed29c53a2796f2f8e0d (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:27.232144 28956 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7891141834dca92babab10936feef (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:27.225492 28960 tablet_service.cc:1511] Processing CreateTablet for tablet bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:27.233579 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c50f0e89e544afba188260ee500d39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.237335 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429ac41e709040e998620c3a56a58850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.247445 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 219494f6cc934fc88823c3632f8e3526 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:27.245217 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7891141834dca92babab10936feef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.250917 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219494f6cc934fc88823c3632f8e3526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.251561 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c8f576269d4ed29c53a2796f2f8e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.254081 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.257993 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 9113e3ed155c482897a96e7e916fc938 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:27.260531 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9113e3ed155c482897a96e7e916fc938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.268507 28884 tablet_service.cc:1511] Processing CreateTablet for tablet e1c8f576269d4ed29c53a2796f2f8e0d (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:27.270018 28882 tablet_service.cc:1511] Processing CreateTablet for tablet 5c50f0e89e544afba188260ee500d39c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:27.271023 28885 tablet_service.cc:1511] Processing CreateTablet for tablet bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:27.270006 28884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c8f576269d4ed29c53a2796f2f8e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.272271 28881 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7891141834dca92babab10936feef (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:27.273625 28881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7891141834dca92babab10936feef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.274655 28885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.275633 28880 tablet_service.cc:1511] Processing CreateTablet for tablet 219494f6cc934fc88823c3632f8e3526 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:27.278010 28879 tablet_service.cc:1511] Processing CreateTablet for tablet 9113e3ed155c482897a96e7e916fc938 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:27.276860 28880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219494f6cc934fc88823c3632f8e3526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.281055 28883 tablet_service.cc:1511] Processing CreateTablet for tablet 429ac41e709040e998620c3a56a58850 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:27.281114 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9113e3ed155c482897a96e7e916fc938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.284631 28883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429ac41e709040e998620c3a56a58850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.286660 28878 tablet_service.cc:1511] Processing CreateTablet for tablet 35b4f5cead3f4f38854f8cb658043a5c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:27.287955 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b4f5cead3f4f38854f8cb658043a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.290473 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 35b4f5cead3f4f38854f8cb658043a5c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:27.292285 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b4f5cead3f4f38854f8cb658043a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.293190 28882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c50f0e89e544afba188260ee500d39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.305888 28877 tablet_service.cc:1511] Processing CreateTablet for tablet 7506074b98eb4862871e0e77c6314e0c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:27.307292 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7506074b98eb4862871e0e77c6314e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.308724 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 7506074b98eb4862871e0e77c6314e0c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:27.310062 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7506074b98eb4862871e0e77c6314e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.319382 29034 tablet_service.cc:1511] Processing CreateTablet for tablet bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:27.320792 29034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.321798 29033 tablet_service.cc:1511] Processing CreateTablet for tablet e1c8f576269d4ed29c53a2796f2f8e0d (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:27.323138 29033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c8f576269d4ed29c53a2796f2f8e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.329185 29027 tablet_service.cc:1511] Processing CreateTablet for tablet 35b4f5cead3f4f38854f8cb658043a5c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:27.330148 29028 tablet_service.cc:1511] Processing CreateTablet for tablet 9113e3ed155c482897a96e7e916fc938 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:27.330684 29027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b4f5cead3f4f38854f8cb658043a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.331518 29028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9113e3ed155c482897a96e7e916fc938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.332125 29032 tablet_service.cc:1511] Processing CreateTablet for tablet 429ac41e709040e998620c3a56a58850 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:27.333427 29032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429ac41e709040e998620c3a56a58850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.333844 29029 tablet_service.cc:1511] Processing CreateTablet for tablet 219494f6cc934fc88823c3632f8e3526 (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:27.335155 29029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219494f6cc934fc88823c3632f8e3526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.337949 29030 tablet_service.cc:1511] Processing CreateTablet for tablet b7e7891141834dca92babab10936feef (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:27.339315 29030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e7891141834dca92babab10936feef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.345852 29084 tablet_bootstrap.cc:492] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.346359 29026 tablet_service.cc:1511] Processing CreateTablet for tablet 7506074b98eb4862871e0e77c6314e0c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:27.347645 29026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7506074b98eb4862871e0e77c6314e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.329209 29031 tablet_service.cc:1511] Processing CreateTablet for tablet 5c50f0e89e544afba188260ee500d39c (DEFAULT_TABLE table=test-workload [id=25c507774c374411a001fd046c3c2cce]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:27.359472 29031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c50f0e89e544afba188260ee500d39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:27.427479 29084 tablet_bootstrap.cc:654] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.448647 29085 tablet_bootstrap.cc:492] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.461757 29086 tablet_bootstrap.cc:492] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.465549 29085 tablet_bootstrap.cc:654] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.466883 29084 tablet_bootstrap.cc:492] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.470103 29084 ts_tablet_manager.cc:1403] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.012s
I20260709 13:22:27.473565 29086 tablet_bootstrap.cc:654] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.473279 29084 raft_consensus.cc:359] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.474050 29084 raft_consensus.cc:385] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.474368 29084 raft_consensus.cc:740] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.475239 29084 consensus_queue.cc:260] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.477479 28995 heartbeater.cc:499] Master 127.17.139.62:35973 was elected leader, sending a full tablet report...
I20260709 13:22:27.480473 29084 ts_tablet_manager.cc:1434] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:22:27.481772 29084 tablet_bootstrap.cc:492] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.485704 29085 tablet_bootstrap.cc:492] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.486346 29085 ts_tablet_manager.cc:1403] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.003s
I20260709 13:22:27.489298 29085 raft_consensus.cc:359] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.489562 29084 tablet_bootstrap.cc:654] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.489892 29085 raft_consensus.cc:385] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.490200 29085 raft_consensus.cc:740] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.490854 29085 consensus_queue.cc:260] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.492988 28920 heartbeater.cc:499] Master 127.17.139.62:35973 was elected leader, sending a full tablet report...
I20260709 13:22:27.493968 29086 tablet_bootstrap.cc:492] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.494474 29086 ts_tablet_manager.cc:1403] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.009s
I20260709 13:22:27.497530 29086 raft_consensus.cc:359] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.498241 29086 raft_consensus.cc:385] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.498517 29086 raft_consensus.cc:740] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.500406 29085 ts_tablet_manager.cc:1434] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:22:27.501199 29084 tablet_bootstrap.cc:492] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.501471 29085 tablet_bootstrap.cc:492] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.501734 29084 ts_tablet_manager.cc:1403] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:22:27.504567 29084 raft_consensus.cc:359] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.505179 29084 raft_consensus.cc:385] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.504798 29086 consensus_queue.cc:260] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.507449 29069 heartbeater.cc:499] Master 127.17.139.62:35973 was elected leader, sending a full tablet report...
W20260709 13:22:27.508263 28996 tablet.cc:2406] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:27.507943 29086 ts_tablet_manager.cc:1434] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:22:27.510066 29085 tablet_bootstrap.cc:654] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.510197 29086 tablet_bootstrap.cc:492] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.505376 29084 raft_consensus.cc:740] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.513715 29084 consensus_queue.cc:260] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.516125 29084 ts_tablet_manager.cc:1434] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:22:27.517092 29084 tablet_bootstrap.cc:492] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.517460 29086 tablet_bootstrap.cc:654] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.523862 29084 tablet_bootstrap.cc:654] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.525332 29085 tablet_bootstrap.cc:492] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.525904 29085 ts_tablet_manager.cc:1403] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 13:22:27.535406 29084 tablet_bootstrap.cc:492] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.536000 29084 ts_tablet_manager.cc:1403] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:22:27.529590 29085 raft_consensus.cc:359] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.537575 29085 raft_consensus.cc:385] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.537880 29085 raft_consensus.cc:740] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.538623 29085 consensus_queue.cc:260] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.540114 29084 raft_consensus.cc:359] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.540735 29085 ts_tablet_manager.cc:1434] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:22:27.540920 29084 raft_consensus.cc:385] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.541268 29084 raft_consensus.cc:740] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.542147 29084 consensus_queue.cc:260] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.544778 29093 raft_consensus.cc:493] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.545378 29093 raft_consensus.cc:515] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.545933 29084 ts_tablet_manager.cc:1434] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:22:27.547058 29084 tablet_bootstrap.cc:492] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.547959 29093 leader_election.cc:290] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:27.553536 29084 tablet_bootstrap.cc:654] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.561012 29085 tablet_bootstrap.cc:492] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.561865 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
W20260709 13:22:27.564021 29008 leader_election.cc:343] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.567837 29086 tablet_bootstrap.cc:492] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.568581 29086 ts_tablet_manager.cc:1403] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.020s
I20260709 13:22:27.570196 29085 tablet_bootstrap.cc:654] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.572626 29086 raft_consensus.cc:359] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.574538 29086 raft_consensus.cc:385] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.574849 29086 raft_consensus.cc:740] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.575580 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:27.575610 29084 tablet_bootstrap.cc:492] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.576237 29085 tablet_bootstrap.cc:492] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.575762 29086 consensus_queue.cc:260] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.576678 29084 ts_tablet_manager.cc:1403] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.007s
W20260709 13:22:27.577417 29007 leader_election.cc:343] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.577893 29007 leader_election.cc:304] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:27.576730 29085 ts_tablet_manager.cc:1403] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:22:27.578655 29093 raft_consensus.cc:2749] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.580605 29084 raft_consensus.cc:359] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.578418 29086 ts_tablet_manager.cc:1434] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:22:27.585525 29084 raft_consensus.cc:385] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.585897 29084 raft_consensus.cc:740] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.586431 29086 tablet_bootstrap.cc:492] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.586759 29084 consensus_queue.cc:260] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.587414 29085 raft_consensus.cc:359] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.588160 29085 raft_consensus.cc:385] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.588429 29085 raft_consensus.cc:740] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.589286 29085 consensus_queue.cc:260] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.591822 29084 ts_tablet_manager.cc:1434] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:22:27.592936 29084 tablet_bootstrap.cc:492] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.593519 29086 tablet_bootstrap.cc:654] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.594172 29085 ts_tablet_manager.cc:1434] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:22:27.596694 29085 tablet_bootstrap.cc:492] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.599328 29084 tablet_bootstrap.cc:654] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.599794 29086 tablet_bootstrap.cc:492] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.600310 29086 ts_tablet_manager.cc:1403] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:22:27.603229 29086 raft_consensus.cc:359] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.603761 29085 tablet_bootstrap.cc:654] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.603951 29086 raft_consensus.cc:385] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.604444 29086 raft_consensus.cc:740] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.605209 29086 consensus_queue.cc:260] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.613248 29084 tablet_bootstrap.cc:492] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.613997 29086 ts_tablet_manager.cc:1434] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:22:27.614048 29084 ts_tablet_manager.cc:1403] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.002s
I20260709 13:22:27.616087 29086 tablet_bootstrap.cc:492] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.617730 29085 tablet_bootstrap.cc:492] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.617784 29084 raft_consensus.cc:359] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.618583 29085 ts_tablet_manager.cc:1403] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.014s
I20260709 13:22:27.618777 29084 raft_consensus.cc:385] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.619238 29084 raft_consensus.cc:740] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.620182 29084 consensus_queue.cc:260] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.622128 29085 raft_consensus.cc:359] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.622532 29084 ts_tablet_manager.cc:1434] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:22:27.622924 29085 raft_consensus.cc:385] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.623195 29086 tablet_bootstrap.cc:654] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.623257 29085 raft_consensus.cc:740] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.623739 29084 tablet_bootstrap.cc:492] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.624439 29085 consensus_queue.cc:260] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.629716 29085 ts_tablet_manager.cc:1434] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:27.630765 29085 tablet_bootstrap.cc:492] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.632962 29084 tablet_bootstrap.cc:654] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.637163 29085 tablet_bootstrap.cc:654] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.642773 29086 tablet_bootstrap.cc:492] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.643548 29086 ts_tablet_manager.cc:1403] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.003s
I20260709 13:22:27.647264 29086 raft_consensus.cc:359] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.648303 29086 raft_consensus.cc:385] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.648741 29086 raft_consensus.cc:740] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.649801 29086 consensus_queue.cc:260] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.652002 29084 tablet_bootstrap.cc:492] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.652649 29084 ts_tablet_manager.cc:1403] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 13:22:27.654074 29085 tablet_bootstrap.cc:492] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.654613 29085 ts_tablet_manager.cc:1403] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 13:22:27.654937 29084 raft_consensus.cc:359] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.655552 29084 raft_consensus.cc:385] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.655797 29084 raft_consensus.cc:740] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.656490 29084 consensus_queue.cc:260] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.657665 29085 raft_consensus.cc:359] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.658435 29085 raft_consensus.cc:385] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.658706 29084 ts_tablet_manager.cc:1434] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:27.658735 29086 ts_tablet_manager.cc:1434] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:22:27.658708 29085 raft_consensus.cc:740] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.659825 29084 tablet_bootstrap.cc:492] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.659924 29085 consensus_queue.cc:260] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.666541 29086 tablet_bootstrap.cc:492] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.666951 29084 tablet_bootstrap.cc:654] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.668781 29093 raft_consensus.cc:493] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.669098 29085 ts_tablet_manager.cc:1434] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:22:27.669343 29093 raft_consensus.cc:515] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.671561 29093 leader_election.cc:290] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:27.673514 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:27.673928 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:27.674785 28970 raft_consensus.cc:2468] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
W20260709 13:22:27.674988 29008 leader_election.cc:343] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.675694 29090 raft_consensus.cc:493] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.676260 29085 tablet_bootstrap.cc:492] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.676292 29090 raft_consensus.cc:515] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.680706 29086 tablet_bootstrap.cc:654] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.683616 29085 tablet_bootstrap.cc:654] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.684247 29007 leader_election.cc:304] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:27.686012 29093 raft_consensus.cc:2804] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.686494 29093 raft_consensus.cc:493] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.686892 29093 raft_consensus.cc:3060] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.691035 29084 tablet_bootstrap.cc:492] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.691651 29084 ts_tablet_manager.cc:1403] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.008s
I20260709 13:22:27.691890 29090 leader_election.cc:290] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.693578 29085 tablet_bootstrap.cc:492] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.694361 29085 ts_tablet_manager.cc:1403] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 13:22:27.694796 29084 raft_consensus.cc:359] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.695598 29084 raft_consensus.cc:385] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.695886 29084 raft_consensus.cc:740] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.696763 29084 consensus_queue.cc:260] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.698650 29085 raft_consensus.cc:359] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.699657 29084 ts_tablet_manager.cc:1434] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:27.699741 29085 raft_consensus.cc:385] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.700453 29085 raft_consensus.cc:740] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.700771 29084 tablet_bootstrap.cc:492] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.701686 29085 consensus_queue.cc:260] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.706276 29085 ts_tablet_manager.cc:1434] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:22:27.707295 29085 tablet_bootstrap.cc:492] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.707656 29084 tablet_bootstrap.cc:654] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.713579 29085 tablet_bootstrap.cc:654] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.714183 29093 raft_consensus.cc:515] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.727577 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
W20260709 13:22:27.729643 29008 leader_election.cc:343] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:27.730288 28841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:27.734511 29093 leader_election.cc:290] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:27.735942 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:27.736661 28970 raft_consensus.cc:3060] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.739133 29090 raft_consensus.cc:493] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.739730 29090 raft_consensus.cc:515] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.742009 29090 leader_election.cc:290] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.744808 29093 raft_consensus.cc:493] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.745347 29093 raft_consensus.cc:515] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.748068 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:27.748679 28895 raft_consensus.cc:2468] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:27.748970 28970 raft_consensus.cc:2468] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:27.749928 29008 leader_election.cc:304] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:27.750165 29007 leader_election.cc:304] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:27.751678 29113 raft_consensus.cc:2804] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.752110 29093 leader_election.cc:290] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:27.752900 29093 raft_consensus.cc:2804] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.752146 29113 raft_consensus.cc:493] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.754297 29113 raft_consensus.cc:3060] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.756738 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:27.757503 28969 raft_consensus.cc:2468] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:27.753803 29093 raft_consensus.cc:697] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:27.763556 29093 consensus_queue.cc:237] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.765480 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:27.767688 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
W20260709 13:22:27.769474 28934 leader_election.cc:343] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:27.770139 28934 leader_election.cc:343] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.774072 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.774319 29086 tablet_bootstrap.cc:492] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.774572 29084 tablet_bootstrap.cc:492] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.775065 29086 ts_tablet_manager.cc:1403] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.109s	user 0.031s	sys 0.049s
I20260709 13:22:27.775121 29084 ts_tablet_manager.cc:1403] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.016s
I20260709 13:22:27.775377 29113 raft_consensus.cc:515] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.776247 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.775853 28934 leader_election.cc:304] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9; no voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:27.778337 29090 raft_consensus.cc:2749] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.778776 29086 raft_consensus.cc:359] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
W20260709 13:22:27.778815 28934 leader_election.cc:343] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.779953 28934 leader_election.cc:304] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9; no voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:27.779565 29086 raft_consensus.cc:385] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.780586 29113 leader_election.cc:290] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:27.781026 29086 raft_consensus.cc:740] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.780615 29084 raft_consensus.cc:359] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.781591 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:27.781905 29084 raft_consensus.cc:385] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.781988 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:27.781821 29086 consensus_queue.cc:260] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.782275 28969 raft_consensus.cc:3060] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.782452 29084 raft_consensus.cc:740] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.783491 29084 consensus_queue.cc:260] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.784605 29086 ts_tablet_manager.cc:1434] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:27.785463 29084 ts_tablet_manager.cc:1434] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:27.785645 29086 tablet_bootstrap.cc:492] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.785627 29091 raft_consensus.cc:493] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.786557 29084 tablet_bootstrap.cc:492] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:27.786311 29091 raft_consensus.cc:515] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.789875 28790 catalog_manager.cc:5697] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:27.792708 29086 tablet_bootstrap.cc:654] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.782791 28895 raft_consensus.cc:3060] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.792708 29084 tablet_bootstrap.cc:654] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.799042 29091 leader_election.cc:290] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.815840 28895 raft_consensus.cc:2468] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:27.817505 29008 leader_election.cc:304] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:27.818414 29113 raft_consensus.cc:2804] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.818574 29085 tablet_bootstrap.cc:492] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.818976 29113 raft_consensus.cc:697] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:27.819177 29085 ts_tablet_manager.cc:1403] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.028s
I20260709 13:22:27.819865 29113 consensus_queue.cc:237] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.822841 29085 raft_consensus.cc:359] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.823678 29085 raft_consensus.cc:385] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.823990 29085 raft_consensus.cc:740] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.825074 29085 consensus_queue.cc:260] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.828138 29085 ts_tablet_manager.cc:1434] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:27.830154 29090 raft_consensus.cc:2749] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:27.830386 28934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.139.3:35415, user_credentials={real_user=slave}} blocked reactor thread for 51599.8us
I20260709 13:22:27.831581 28969 raft_consensus.cc:2468] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:27.834172 29085 tablet_bootstrap.cc:492] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.841439 29091 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.842013 29091 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.844280 29091 leader_election.cc:290] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.848359 29084 tablet_bootstrap.cc:492] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:27.848927 29084 ts_tablet_manager.cc:1403] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.028s
I20260709 13:22:27.851613 29084 raft_consensus.cc:359] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.852236 29084 raft_consensus.cc:385] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.852516 29084 raft_consensus.cc:740] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.853206 29084 consensus_queue.cc:260] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.855646 29084 ts_tablet_manager.cc:1434] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:27.859108 29090 raft_consensus.cc:493] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.859663 29090 raft_consensus.cc:515] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.861230 29085 tablet_bootstrap.cc:654] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.861778 29090 leader_election.cc:290] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.862676 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:27.863693 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.868606 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.868788 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.869272 29044 raft_consensus.cc:2468] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
W20260709 13:22:27.870290 28934 leader_election.cc:343] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.870563 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
W20260709 13:22:27.870622 28859 leader_election.cc:343] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:27.870947 28934 leader_election.cc:343] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.871318 28970 raft_consensus.cc:2468] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
I20260709 13:22:27.871384 28934 leader_election.cc:304] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9; no voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:27.871516 28859 leader_election.cc:304] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:27.873030 29090 raft_consensus.cc:2749] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.873804 29091 raft_consensus.cc:2804] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.874037 29086 tablet_bootstrap.cc:492] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.874202 29091 raft_consensus.cc:493] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.874565 29091 raft_consensus.cc:3060] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.875154 28790 catalog_manager.cc:5697] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:27.872956 28858 leader_election.cc:304] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:27.881506 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:27.882138 28969 raft_consensus.cc:2468] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
I20260709 13:22:27.885442 29091 raft_consensus.cc:515] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.888228 29091 leader_election.cc:290] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.874552 29086 ts_tablet_manager.cc:1403] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.047s
I20260709 13:22:27.893112 29086 raft_consensus.cc:359] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.894065 29086 raft_consensus.cc:385] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.894361 29085 tablet_bootstrap.cc:492] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.894467 29091 raft_consensus.cc:493] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.895025 29085 ts_tablet_manager.cc:1403] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.001s
I20260709 13:22:27.895427 29126 raft_consensus.cc:2804] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.895224 29091 raft_consensus.cc:515] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.895993 29126 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.897099 29126 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.894436 29086 raft_consensus.cc:740] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.897830 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:27.898689 29044 raft_consensus.cc:3060] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.899071 29086 consensus_queue.cc:260] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.900240 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:27.901655 28970 raft_consensus.cc:2468] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
I20260709 13:22:27.904985 29126 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.905923 28858 leader_election.cc:304] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:27.906155 29044 raft_consensus.cc:2468] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:27.906858 29125 raft_consensus.cc:2804] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.907232 29125 raft_consensus.cc:493] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.907413 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:27.907527 29125 raft_consensus.cc:3060] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.908051 28969 raft_consensus.cc:3060] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.907862 29085 raft_consensus.cc:359] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.908605 29085 raft_consensus.cc:385] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.908911 29085 raft_consensus.cc:740] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.909022 29091 leader_election.cc:290] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.908419 29086 ts_tablet_manager.cc:1434] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:22:27.909751 29085 consensus_queue.cc:260] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.911761 29085 ts_tablet_manager.cc:1434] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:22:27.915086 28969 raft_consensus.cc:2468] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:27.916766 28858 leader_election.cc:304] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:27.916954 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.917532 29126 leader_election.cc:290] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.917690 29091 raft_consensus.cc:2804] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.918344 29091 raft_consensus.cc:697] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:27.915093 29125 raft_consensus.cc:515] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
W20260709 13:22:27.919116 28859 leader_election.cc:343] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.919324 29091 consensus_queue.cc:237] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.916997 29085 tablet_bootstrap.cc:492] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:27.921721 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:27.922307 29086 tablet_bootstrap.cc:492] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.922441 29125 leader_election.cc:290] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.922622 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:27.923233 28970 raft_consensus.cc:3060] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.926745 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
W20260709 13:22:27.928100 28859 leader_election.cc:343] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.928594 29086 tablet_bootstrap.cc:654] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:27.929001 28859 leader_election.cc:343] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.932859 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:27.933182 28970 raft_consensus.cc:2468] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:27.933759 28969 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.934777 28858 leader_election.cc:304] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:27.936403 29125 raft_consensus.cc:2804] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.937045 29125 raft_consensus.cc:697] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:27.938053 29125 consensus_queue.cc:237] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.940500 29085 tablet_bootstrap.cc:654] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.940639 29086 tablet_bootstrap.cc:492] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.941143 29086 ts_tablet_manager.cc:1403] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:22:27.944159 29086 raft_consensus.cc:359] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.944824 29086 raft_consensus.cc:385] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.945231 29086 raft_consensus.cc:740] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.945554 28969 raft_consensus.cc:2468] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:27.946120 29086 consensus_queue.cc:260] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.946803 28858 leader_election.cc:304] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:27.947672 29126 raft_consensus.cc:2804] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.948237 29126 raft_consensus.cc:697] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:27.949244 29126 consensus_queue.cc:237] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.950423 29125 raft_consensus.cc:493] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.950954 29125 raft_consensus.cc:515] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.953161 29125 leader_election.cc:290] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.954352 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.954631 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:27.955586 28969 raft_consensus.cc:2393] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11ff4453d5684688997cb71f55cccc32 in current term 1: Already voted for candidate f2ce0eedd00d45a192030ea417d443b5 in this term.
I20260709 13:22:27.956619 28858 leader_election.cc:304] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32; no voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:27.959195 29126 raft_consensus.cc:3060] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.964291 28790 catalog_manager.cc:5697] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.966861 29085 tablet_bootstrap.cc:492] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:27.967370 29085 ts_tablet_manager.cc:1403] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.007s
I20260709 13:22:27.967496 29126 raft_consensus.cc:2749] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.968479 29086 ts_tablet_manager.cc:1434] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:22:27.969576 29086 tablet_bootstrap.cc:492] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.970067 29085 raft_consensus.cc:359] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.970739 29085 raft_consensus.cc:385] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.970985 29085 raft_consensus.cc:740] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.973412 29126 raft_consensus.cc:493] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.973948 29126 raft_consensus.cc:515] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.974941 29090 raft_consensus.cc:493] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.975431 29090 raft_consensus.cc:515] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.975961 29126 leader_election.cc:290] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.977093 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.977321 29086 tablet_bootstrap.cc:654] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:27.977389 29090 leader_election.cc:290] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.977821 29044 raft_consensus.cc:2468] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
I20260709 13:22:27.978976 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:27.979511 28969 raft_consensus.cc:2468] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
I20260709 13:22:27.980391 28859 leader_election.cc:304] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:27.971637 29085 consensus_queue.cc:260] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.981758 29131 raft_consensus.cc:2804] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.981877 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:27.982191 29131 raft_consensus.cc:493] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.982431 29085 ts_tablet_manager.cc:1434] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:22:27.982728 29086 tablet_bootstrap.cc:492] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:27.982594 28895 raft_consensus.cc:2468] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 0.
I20260709 13:22:27.983377 29086 ts_tablet_manager.cc:1403] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:22:27.982591 29131 raft_consensus.cc:3060] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.984037 28934 leader_election.cc:304] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:27.984067 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:27.985514 29044 raft_consensus.cc:2468] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 0.
I20260709 13:22:27.986969 29090 raft_consensus.cc:2804] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.986726 29086 raft_consensus.cc:359] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.987355 29090 raft_consensus.cc:493] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.986408 28790 catalog_manager.cc:5697] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.987581 29086 raft_consensus.cc:385] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.987809 29090 raft_consensus.cc:3060] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.988202 29086 raft_consensus.cc:740] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.988552 28790 catalog_manager.cc:5697] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.989137 29086 consensus_queue.cc:260] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.992563 29131 raft_consensus.cc:515] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.995352 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:27.995548 29131 leader_election.cc:290] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:27.995664 29086 ts_tablet_manager.cc:1434] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:22:27.995958 28969 raft_consensus.cc:3060] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.996928 29086 tablet_bootstrap.cc:492] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:27.997887 29090 raft_consensus.cc:515] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:27.998730 29044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:27.999308 29044 raft_consensus.cc:3060] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.001173 29090 leader_election.cc:290] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.002242 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.002805 28895 raft_consensus.cc:3060] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.003072 29131 raft_consensus.cc:493] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:28.003528 29131 raft_consensus.cc:515] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.006567 29131 leader_election.cc:290] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.006726 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:28.007314 29086 tablet_bootstrap.cc:654] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:28.007386 29043 raft_consensus.cc:3060] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.008194 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429ac41e709040e998620c3a56a58850" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:28.008838 28970 raft_consensus.cc:2468] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
I20260709 13:22:28.010035 29090 raft_consensus.cc:493] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:28.010536 28858 leader_election.cc:304] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:28.011477 29131 raft_consensus.cc:2804] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:28.011857 29131 raft_consensus.cc:493] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:28.012187 29131 raft_consensus.cc:3060] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.013295 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429ac41e709040e998620c3a56a58850" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:28.014009 29042 raft_consensus.cc:2468] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 0.
I20260709 13:22:28.016127 28969 raft_consensus.cc:2468] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:28.010497 29090 raft_consensus.cc:515] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.019160 29131 raft_consensus.cc:515] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.019563 28858 leader_election.cc:304] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:28.020466 29126 raft_consensus.cc:2804] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:28.020969 29126 raft_consensus.cc:697] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:28.021224 29131 leader_election.cc:290] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.021768 29126 consensus_queue.cc:237] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.022276 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429ac41e709040e998620c3a56a58850" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:28.022637 29090 leader_election.cc:290] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.018281 28895 raft_consensus.cc:2468] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 1.
I20260709 13:22:28.022853 29042 raft_consensus.cc:3060] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.024910 28934 leader_election.cc:304] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:28.025063 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429ac41e709040e998620c3a56a58850" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:28.025295 29044 raft_consensus.cc:2468] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:28.023605 29041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429ac41e709040e998620c3a56a58850" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:28.025919 28894 raft_consensus.cc:2393] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3dcaa525ce54903a0606732f37b73e9 in current term 1: Already voted for candidate 11ff4453d5684688997cb71f55cccc32 in this term.
I20260709 13:22:28.027679 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429ac41e709040e998620c3a56a58850" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:28.028239 28969 raft_consensus.cc:3060] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.028354 29043 raft_consensus.cc:2468] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 1.
I20260709 13:22:28.029340 29090 raft_consensus.cc:2804] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:28.028554 28934 leader_election.cc:304] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9; no voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:28.050041 29042 raft_consensus.cc:2468] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:28.052661 28969 raft_consensus.cc:2468] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 1.
I20260709 13:22:28.053201 28859 leader_election.cc:304] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:28.051928 29090 raft_consensus.cc:697] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:28.054611 29136 raft_consensus.cc:2749] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:28.055251 29126 raft_consensus.cc:2804] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:28.055874 29126 raft_consensus.cc:697] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:28.056770 29126 consensus_queue.cc:237] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.058168 29086 tablet_bootstrap.cc:492] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:28.058696 29086 ts_tablet_manager.cc:1403] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.021s
I20260709 13:22:28.060102 28790 catalog_manager.cc:5697] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.062110 29086 raft_consensus.cc:359] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.062083 29090 consensus_queue.cc:237] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.062954 29086 raft_consensus.cc:385] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:28.063279 29086 raft_consensus.cc:740] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:28.063907 29086 consensus_queue.cc:260] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.065905 29086 ts_tablet_manager.cc:1434] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:28.067902 29113 raft_consensus.cc:493] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:28.068401 29113 raft_consensus.cc:515] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.070585 29113 leader_election.cc:290] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:28.071430 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:28.071976 28894 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:28.072085 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:28.072762 28969 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:28.072863 29008 leader_election.cc:304] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:28.075848 29113 raft_consensus.cc:2804] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:28.076236 29113 raft_consensus.cc:493] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:28.076536 29113 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.078168 28791 catalog_manager.cc:5697] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 1 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.079101 28790 catalog_manager.cc:5697] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.083941 29113 raft_consensus.cc:515] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.086740 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.086930 29113 leader_election.cc:290] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:28.087339 28894 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.088171 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:28.088770 28969 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.095090 28894 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:28.095464 28969 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:28.096295 29008 leader_election.cc:304] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:28.097128 29113 raft_consensus.cc:2804] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:28.097527 29113 raft_consensus.cc:697] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:28.098272 29113 consensus_queue.cc:237] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.104854 28793 catalog_manager.cc:5697] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:28.185369 29113 consensus_queue.cc:1048] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.197615 29113 consensus_queue.cc:1048] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.208102 29113 consensus_queue.cc:1048] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.218600 29093 consensus_queue.cc:1048] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.249027 29042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:28.249495 29042 raft_consensus.cc:606] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:28.257119 29042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:28.257575 29042 raft_consensus.cc:606] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:28.273105 28894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7e7891141834dca92babab10936feef"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:37608
I20260709 13:22:28.273821 28894 raft_consensus.cc:606] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:28.278978 28894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:37608
I20260709 13:22:28.279409 28894 raft_consensus.cc:606] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:28.283988 28894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:37608
I20260709 13:22:28.284402 28894 raft_consensus.cc:606] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:28.289048 29042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:28.289490 29042 raft_consensus.cc:606] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:28.301573 28969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
mode: GRACEFUL
new_leader_uuid: "f2ce0eedd00d45a192030ea417d443b5"
 from {username='slave'} at 127.0.0.1:48748
I20260709 13:22:28.302084 28969 raft_consensus.cc:606] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Received request to transfer leadership to TS f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:28.321360 29126 consensus_queue.cc:1048] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.328045 29091 raft_consensus.cc:993] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32: : Instructing follower a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:28.328516 29091 raft_consensus.cc:1081] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Signalling peer a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:28.330345 28970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:48736
I20260709 13:22:28.330945 28970 raft_consensus.cc:493] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:28.331305 28970 raft_consensus.cc:3060] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.333217 29126 consensus_queue.cc:1048] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.338006 28970 raft_consensus.cc:515] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.339032 29043 raft_consensus.cc:3060] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.339171 28969 raft_consensus.cc:1240] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Rejecting Update request from peer 11ff4453d5684688997cb71f55cccc32 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:28.340353 28970 leader_election.cc:290] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.341432 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.342460 28894 raft_consensus.cc:3055] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:28.342813 28894 raft_consensus.cc:740] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:28.343528 28894 consensus_queue.cc:260] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.344455 28894 raft_consensus.cc:3060] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.345781 29041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9113e3ed155c482897a96e7e916fc938" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:28.348002 29126 consensus_queue.cc:1048] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.351480 29043 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:28.351886 28894 raft_consensus.cc:2468] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:28.353031 28934 leader_election.cc:304] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:28.354276 29090 raft_consensus.cc:2804] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:28.354755 29090 raft_consensus.cc:697] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:28.355434 29090 consensus_queue.cc:237] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.356216 29093 raft_consensus.cc:493] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 11ff4453d5684688997cb71f55cccc32)
I20260709 13:22:28.356997 29093 raft_consensus.cc:515] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.361038 29093 leader_election.cc:290] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:28.364818 29126 consensus_queue.cc:1048] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.367162 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:28.367849 28969 raft_consensus.cc:2468] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:28.368160 29131 consensus_queue.cc:1048] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.369084 29007 leader_election.cc:304] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:28.370406 29114 raft_consensus.cc:2804] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:28.370769 29114 raft_consensus.cc:493] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 11ff4453d5684688997cb71f55cccc32)
I20260709 13:22:28.371145 29114 raft_consensus.cc:3060] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.373311 29113 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:28.373821 29113 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.375602 29125 raft_consensus.cc:993] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32: : Instructing follower a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:28.375838 29113 leader_election.cc:290] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:28.376085 29125 raft_consensus.cc:1081] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Signalling peer a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:28.377367 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:28.378082 28969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:48736
I20260709 13:22:28.378629 28969 raft_consensus.cc:493] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:28.378994 28969 raft_consensus.cc:3060] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.380405 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:28.381078 28970 raft_consensus.cc:2468] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:28.381429 29114 raft_consensus.cc:515] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.382582 29007 leader_election.cc:304] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:28.366200 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:28.387537 29114 leader_election.cc:290] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:28.389322 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:28.391860 29113 raft_consensus.cc:2804] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:28.393523 28790 catalog_manager.cc:5697] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from 11ff4453d5684688997cb71f55cccc32 (127.17.139.1) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.394615 28969 raft_consensus.cc:515] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.397380 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.397552 28969 leader_election.cc:290] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.398046 28895 raft_consensus.cc:3055] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:28.398394 28895 raft_consensus.cc:740] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:28.399210 28895 consensus_queue.cc:260] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.400260 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:28.400542 28895 raft_consensus.cc:3060] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.401050 29043 raft_consensus.cc:2393] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3dcaa525ce54903a0606732f37b73e9 in current term 2: Already voted for candidate f2ce0eedd00d45a192030ea417d443b5 in this term.
I20260709 13:22:28.397320 29113 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 11ff4453d5684688997cb71f55cccc32)
I20260709 13:22:28.407639 29113 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.403545 29126 consensus_queue.cc:1048] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.417217 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219494f6cc934fc88823c3632f8e3526" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.417565 28895 raft_consensus.cc:2468] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:28.417598 29113 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.419078 28934 leader_election.cc:304] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:28.419351 29008 leader_election.cc:304] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:28.419778 29113 leader_election.cc:290] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:28.420255 29090 raft_consensus.cc:2804] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:28.420550 29042 raft_consensus.cc:1240] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Rejecting Update request from peer 11ff4453d5684688997cb71f55cccc32 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:28.420783 29090 raft_consensus.cc:697] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:28.421868 29113 raft_consensus.cc:2749] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:28.421999 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.421343 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:28.423741 29090 consensus_queue.cc:237] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.423763 29126 consensus_queue.cc:1059] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:28.424894 29007 leader_election.cc:304] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:28.425194 29126 raft_consensus.cc:3055] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:28.425555 29126 raft_consensus.cc:740] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:28.426324 29113 raft_consensus.cc:2749] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:22:28.426333 29126 consensus_queue.cc:260] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.428190 29126 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.437506 28790 catalog_manager.cc:5697] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from 11ff4453d5684688997cb71f55cccc32 (127.17.139.1) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.447706 29126 consensus_queue.cc:1048] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.457945 29125 consensus_queue.cc:1048] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.470451 29125 consensus_queue.cc:1048] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.481012 29126 consensus_queue.cc:1048] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.514246 29090 consensus_queue.cc:1048] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.520517 29136 raft_consensus.cc:993] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9: : Instructing follower f2ce0eedd00d45a192030ea417d443b5 to start an election
I20260709 13:22:28.521111 29135 raft_consensus.cc:1081] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Signalling peer f2ce0eedd00d45a192030ea417d443b5 to start an election
I20260709 13:22:28.522749 29043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:22:28.523417 29043 raft_consensus.cc:493] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:28.523821 29043 raft_consensus.cc:3060] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.528228 29090 consensus_queue.cc:1048] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.531862 29043 raft_consensus.cc:515] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.537011 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.537256 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7506074b98eb4862871e0e77c6314e0c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:28.537633 28895 raft_consensus.cc:3060] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.537899 28970 raft_consensus.cc:3055] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:28.538254 28970 raft_consensus.cc:740] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:28.538520 29043 leader_election.cc:290] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:28.539055 28970 consensus_queue.cc:260] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.540560 28970 raft_consensus.cc:3060] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.545104 28895 raft_consensus.cc:2468] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 2.
I20260709 13:22:28.546339 29008 leader_election.cc:304] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:28.547201 29113 raft_consensus.cc:2804] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:28.547618 28970 raft_consensus.cc:2468] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 2.
I20260709 13:22:28.547722 29113 raft_consensus.cc:697] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 2 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:28.548617 29113 consensus_queue.cc:237] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.555024 28790 catalog_manager.cc:5697] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 1 to 2, leader changed from a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2) to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:28.612056 29113 consensus_queue.cc:1048] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.623158 29093 consensus_queue.cc:1048] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:28.630403 29114 raft_consensus.cc:993] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:28.630928 29093 raft_consensus.cc:1081] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:28.632560 28895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:37586
I20260709 13:22:28.633116 28895 raft_consensus.cc:493] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:28.633498 28895 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.638532 28895 raft_consensus.cc:515] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.640791 28895 leader_election.cc:290] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.641224 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:28.641461 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:28.641975 28970 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.642009 29043 raft_consensus.cc:3055] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:28.642465 29043 raft_consensus.cc:740] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:28.643319 29043 consensus_queue.cc:260] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.644594 29043 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.646575 29114 raft_consensus.cc:993] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:28.647073 29093 raft_consensus.cc:1081] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:28.648512 28969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:48726
I20260709 13:22:28.649003 28969 raft_consensus.cc:493] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:28.649305 28969 raft_consensus.cc:3060] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.649189 28970 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:28.650573 28858 leader_election.cc:304] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:28.651368 29126 raft_consensus.cc:2804] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:28.651845 29126 raft_consensus.cc:697] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:28.651922 29043 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:28.652714 29126 consensus_queue.cc:237] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.655831 28969 raft_consensus.cc:515] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.657635 28969 leader_election.cc:290] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.658282 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:28.658676 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b4f5cead3f4f38854f8cb658043a5c" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:28.658895 28895 raft_consensus.cc:3060] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.659320 29043 raft_consensus.cc:3055] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:28.659627 29043 raft_consensus.cc:740] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:28.660341 29043 consensus_queue.cc:260] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.660060 28793 catalog_manager.cc:5697] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.661463 29043 raft_consensus.cc:3060] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.665758 28895 raft_consensus.cc:2468] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:28.667151 28934 leader_election.cc:304] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:28.668016 29090 raft_consensus.cc:2804] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:28.668500 29090 raft_consensus.cc:697] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:28.669494 29043 raft_consensus.cc:2468] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:28.669368 29090 consensus_queue.cc:237] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.675207 28793 catalog_manager.cc:5697] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.754755 29114 raft_consensus.cc:993] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:28.755250 29093 raft_consensus.cc:1081] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:28.756631 28895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:37586
I20260709 13:22:28.757211 28895 raft_consensus.cc:493] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:28.757520 28895 raft_consensus.cc:3060] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.763495 28895 raft_consensus.cc:515] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.765282 28895 leader_election.cc:290] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:28.766019 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:28.766328 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c8f576269d4ed29c53a2796f2f8e0d" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:28.766701 28969 raft_consensus.cc:3060] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.766918 29043 raft_consensus.cc:3055] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:28.767259 29043 raft_consensus.cc:740] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:28.768071 29043 consensus_queue.cc:260] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.769327 29043 raft_consensus.cc:3060] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.773689 28969 raft_consensus.cc:2468] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:28.774827 28858 leader_election.cc:304] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:28.775614 29126 raft_consensus.cc:2804] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:28.776100 29126 raft_consensus.cc:697] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:28.776119 29043 raft_consensus.cc:2468] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:28.776965 29126 consensus_queue.cc:237] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:28.781682 28895 raft_consensus.cc:1275] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.782878 29090 consensus_queue.cc:1048] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.783661 28793 catalog_manager.cc:5697] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:28.790661 29043 raft_consensus.cc:3060] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:28.797201 29043 raft_consensus.cc:1275] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.798700 29090 consensus_queue.cc:1048] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.804391 28895 raft_consensus.cc:1275] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.806109 29136 consensus_queue.cc:1048] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.814045 29043 raft_consensus.cc:1275] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.815786 29090 consensus_queue.cc:1048] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.971206 28895 raft_consensus.cc:1275] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.972579 29093 consensus_queue.cc:1048] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.981284 28969 raft_consensus.cc:1275] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.983451 29114 consensus_queue.cc:1048] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:29.073418 28895 raft_consensus.cc:1275] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:29.074601 29090 consensus_queue.cc:1048] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:29.082667 29042 raft_consensus.cc:1275] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:29.084354 29135 consensus_queue.cc:1048] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:29.105374 29042 raft_consensus.cc:1275] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:29.106670 29126 consensus_queue.cc:1048] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:29.116806 28969 raft_consensus.cc:1275] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:29.118157 29165 consensus_queue.cc:1048] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:29.230518 29042 raft_consensus.cc:1275] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:29.231886 29165 consensus_queue.cc:1048] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:29.240639 28969 raft_consensus.cc:1275] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:29.242566 29126 consensus_queue.cc:1048] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:29.913444 29090 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 11ff4453d5684688997cb71f55cccc32)
I20260709 13:22:29.913867 29090 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:29.915417 29090 leader_election.cc:290] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:29.916224 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:29.916409 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:29.916855 28895 raft_consensus.cc:2468] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:29.917135 29043 raft_consensus.cc:2393] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3dcaa525ce54903a0606732f37b73e9 in current term 2: Already voted for candidate f2ce0eedd00d45a192030ea417d443b5 in this term.
I20260709 13:22:29.918022 28934 leader_election.cc:304] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:29.918861 29090 raft_consensus.cc:2804] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:29.919185 29090 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 11ff4453d5684688997cb71f55cccc32)
I20260709 13:22:29.919497 29090 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:29.924589 29090 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:29.926132 29090 leader_election.cc:290] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:29.926921 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:29.927052 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:29.927845 29043 raft_consensus.cc:2393] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a3dcaa525ce54903a0606732f37b73e9 in current term 2: Already voted for candidate f2ce0eedd00d45a192030ea417d443b5 in this term.
I20260709 13:22:29.933754 28895 raft_consensus.cc:2468] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:29.934871 28934 leader_election.cc:304] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:29.935714 29090 raft_consensus.cc:2804] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:29.936249 29090 raft_consensus.cc:697] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:29.937006 29090 consensus_queue.cc:237] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:29.943861 28790 catalog_manager.cc:5697] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from 11ff4453d5684688997cb71f55cccc32 (127.17.139.1) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.225972 29169 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:30.226363 29169 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:30.227855 29169 leader_election.cc:290] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:30.228507 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:30.228920 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:30.229275 28895 raft_consensus.cc:2468] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 2.
I20260709 13:22:30.230398 29008 leader_election.cc:304] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:30.231047 29169 raft_consensus.cc:2804] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:22:30.231336 29169 raft_consensus.cc:493] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:30.231588 29169 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.236517 29169 raft_consensus.cc:515] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:30.237959 29169 leader_election.cc:290] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 3 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:30.238777 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:30.239090 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e7891141834dca92babab10936feef" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:30.239522 28895 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.244624 28895 raft_consensus.cc:2468] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 3.
I20260709 13:22:30.245589 29008 leader_election.cc:304] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:30.246256 29169 raft_consensus.cc:2804] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:30.247107 29169 raft_consensus.cc:697] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 3 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:30.247778 29169 consensus_queue.cc:237] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:30.254212 28790 catalog_manager.cc:5697] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 2 to 3, leader changed from a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2) to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:30.359683 29042 raft_consensus.cc:1240] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 3 LEADER]: Rejecting Update request from peer a3dcaa525ce54903a0606732f37b73e9 for earlier term 2. Current term is 3. Ops: []
I20260709 13:22:30.361047 29090 consensus_queue.cc:1059] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:30.361614 29090 consensus_queue.cc:1243] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Peer f2ce0eedd00d45a192030ea417d443b5 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:22:30.362028 29136 raft_consensus.cc:3055] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:30.362298 29136 raft_consensus.cc:740] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:30.362917 29136 consensus_queue.cc:260] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:30.363755 29136 raft_consensus.cc:3060] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.718787 28969 raft_consensus.cc:1275] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:22:30.719133 28969 pending_rounds.cc:85] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: Aborting all ops after (but not including) 1
I20260709 13:22:30.719399 28969 pending_rounds.cc:107] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:22:30.719583 28969 raft_consensus.cc:2889] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:30.720834 29169 consensus_queue.cc:1048] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:30.732311 28895 raft_consensus.cc:1275] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:30.734376 29169 consensus_queue.cc:1048] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:31.333112 28790 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53780:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:31.335302 28790 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:31.381646 28882 tablet_service.cc:1511] Processing CreateTablet for tablet e04c4746d8534435827a84740aad69d4 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:31.382887 28882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04c4746d8534435827a84740aad69d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.382696 28952 tablet_service.cc:1511] Processing CreateTablet for tablet e04c4746d8534435827a84740aad69d4 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:31.383937 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04c4746d8534435827a84740aad69d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.384487 29029 tablet_service.cc:1511] Processing CreateTablet for tablet e04c4746d8534435827a84740aad69d4 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:31.385690 29029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04c4746d8534435827a84740aad69d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.387660 28885 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2ae21e44ea4b09a37018ccfe51012d (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:31.387933 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2ae21e44ea4b09a37018ccfe51012d (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:31.388913 28885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2ae21e44ea4b09a37018ccfe51012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.389189 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2ae21e44ea4b09a37018ccfe51012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.393091 29030 tablet_service.cc:1511] Processing CreateTablet for tablet 7b50b06233fe41c0a67cfa0d081cc140 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:31.394385 29030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b50b06233fe41c0a67cfa0d081cc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.394255 29031 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2ae21e44ea4b09a37018ccfe51012d (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:31.394644 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 7b50b06233fe41c0a67cfa0d081cc140 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:31.395905 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b50b06233fe41c0a67cfa0d081cc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.398496 29031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2ae21e44ea4b09a37018ccfe51012d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.399549 28878 tablet_service.cc:1511] Processing CreateTablet for tablet 7b50b06233fe41c0a67cfa0d081cc140 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:31.400799 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b50b06233fe41c0a67cfa0d081cc140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.422228 28877 tablet_service.cc:1511] Processing CreateTablet for tablet 6817e34308ca436cb9d321894e5d64e9 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:31.423696 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817e34308ca436cb9d321894e5d64e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.423972 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 6817e34308ca436cb9d321894e5d64e9 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:31.425246 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817e34308ca436cb9d321894e5d64e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.427048 29028 tablet_service.cc:1511] Processing CreateTablet for tablet 6817e34308ca436cb9d321894e5d64e9 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:31.428362 29028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6817e34308ca436cb9d321894e5d64e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.437289 28884 tablet_service.cc:1511] Processing CreateTablet for tablet aeeeaf8fbc5e43e6a37784a02f7ac391 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:31.438620 28884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeeeaf8fbc5e43e6a37784a02f7ac391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.442080 28956 tablet_service.cc:1511] Processing CreateTablet for tablet aeeeaf8fbc5e43e6a37784a02f7ac391 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:31.442385 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 861dcf06cce340dab580232182854959 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:31.443456 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeeeaf8fbc5e43e6a37784a02f7ac391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.445415 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861dcf06cce340dab580232182854959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.446236 29034 tablet_service.cc:1511] Processing CreateTablet for tablet 861dcf06cce340dab580232182854959 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:31.447510 29034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861dcf06cce340dab580232182854959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.449234 28880 tablet_service.cc:1511] Processing CreateTablet for tablet 861dcf06cce340dab580232182854959 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:31.449841 28883 tablet_service.cc:1511] Processing CreateTablet for tablet ddd380a58d404c148eafbc64a8f91c84 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:31.449841 28955 tablet_service.cc:1511] Processing CreateTablet for tablet ddd380a58d404c148eafbc64a8f91c84 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:31.450532 28880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861dcf06cce340dab580232182854959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.451756 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd380a58d404c148eafbc64a8f91c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.453583 29192 tablet_bootstrap.cc:492] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.457223 28883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd380a58d404c148eafbc64a8f91c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.457446 29029 tablet_service.cc:1511] Processing CreateTablet for tablet aeeeaf8fbc5e43e6a37784a02f7ac391 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:31.459380 29029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeeeaf8fbc5e43e6a37784a02f7ac391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.485749 28879 tablet_service.cc:1511] Processing CreateTablet for tablet 7c66185aca6b4b3c8210c61ac9b6a09f (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:31.487165 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c66185aca6b4b3c8210c61ac9b6a09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.491318 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 7c66185aca6b4b3c8210c61ac9b6a09f (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:31.495147 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c66185aca6b4b3c8210c61ac9b6a09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.495859 29192 tablet_bootstrap.cc:654] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.513049 29031 tablet_service.cc:1511] Processing CreateTablet for tablet ddd380a58d404c148eafbc64a8f91c84 (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:31.517251 29193 tablet_bootstrap.cc:492] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:31.526818 29194 tablet_bootstrap.cc:492] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.534140 29193 tablet_bootstrap.cc:654] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.538357 29028 tablet_service.cc:1511] Processing CreateTablet for tablet 7c66185aca6b4b3c8210c61ac9b6a09f (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:31.538398 29031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd380a58d404c148eafbc64a8f91c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.543534 28877 tablet_service.cc:1511] Processing CreateTablet for tablet 724b577974364738b3f5dfd308dec95b (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:31.544715 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724b577974364738b3f5dfd308dec95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.547044 29030 tablet_service.cc:1511] Processing CreateTablet for tablet 724b577974364738b3f5dfd308dec95b (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:31.547097 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 724b577974364738b3f5dfd308dec95b (DEFAULT_TABLE table=soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:31.553747 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724b577974364738b3f5dfd308dec95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.557226 29030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724b577974364738b3f5dfd308dec95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.556762 29194 tablet_bootstrap.cc:654] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.557934 29028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c66185aca6b4b3c8210c61ac9b6a09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:31.562712 29192 tablet_bootstrap.cc:492] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.563223 29192 ts_tablet_manager.cc:1403] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.110s	user 0.024s	sys 0.013s
I20260709 13:22:31.568470 29192 raft_consensus.cc:359] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.569465 29192 raft_consensus.cc:385] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.569933 29192 raft_consensus.cc:740] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.570663 29192 consensus_queue.cc:260] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.573429 29192 ts_tablet_manager.cc:1434] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:22:31.574386 29192 tablet_bootstrap.cc:492] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.583230 29192 tablet_bootstrap.cc:654] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.587888 29193 tablet_bootstrap.cc:492] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:31.588451 29193 ts_tablet_manager.cc:1403] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.011s
I20260709 13:22:31.591307 29193 raft_consensus.cc:359] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.592068 29193 raft_consensus.cc:385] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.592399 29193 raft_consensus.cc:740] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.593160 29193 consensus_queue.cc:260] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.595794 29192 tablet_bootstrap.cc:492] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.596066 29193 ts_tablet_manager.cc:1434] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:31.596369 29192 ts_tablet_manager.cc:1403] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.002s
I20260709 13:22:31.597335 29193 tablet_bootstrap.cc:492] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:31.599884 29192 raft_consensus.cc:359] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.600296 29194 tablet_bootstrap.cc:492] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.600631 29192 raft_consensus.cc:385] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.601028 29194 ts_tablet_manager.cc:1403] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.004s
I20260709 13:22:31.601013 29192 raft_consensus.cc:740] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.602008 29192 consensus_queue.cc:260] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.604259 29192 ts_tablet_manager.cc:1434] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:31.604269 29193 tablet_bootstrap.cc:654] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.605501 29192 tablet_bootstrap.cc:492] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.606545 29194 raft_consensus.cc:359] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.607347 29194 raft_consensus.cc:385] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.607683 29194 raft_consensus.cc:740] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.608454 29194 consensus_queue.cc:260] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.613300 29192 tablet_bootstrap.cc:654] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.615350 29194 ts_tablet_manager.cc:1434] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:22:31.616603 29194 tablet_bootstrap.cc:492] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.620558 29193 tablet_bootstrap.cc:492] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:31.621162 29193 ts_tablet_manager.cc:1403] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 13:22:31.624169 29193 raft_consensus.cc:359] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.624948 29193 raft_consensus.cc:385] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.625348 29193 raft_consensus.cc:740] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.625810 29194 tablet_bootstrap.cc:654] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.626196 29193 consensus_queue.cc:260] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.631887 29193 ts_tablet_manager.cc:1434] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:22:31.632925 29193 tablet_bootstrap.cc:492] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:31.634606 29192 tablet_bootstrap.cc:492] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.635367 29192 ts_tablet_manager.cc:1403] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 13:22:31.639190 29193 tablet_bootstrap.cc:654] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.639175 29192 raft_consensus.cc:359] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.640007 29192 raft_consensus.cc:385] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.640365 29192 raft_consensus.cc:740] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.640870 29194 tablet_bootstrap.cc:492] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.641476 29194 ts_tablet_manager.cc:1403] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:22:31.641245 29192 consensus_queue.cc:260] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.643594 29192 ts_tablet_manager.cc:1434] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:31.644547 29192 tablet_bootstrap.cc:492] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.646883 29194 raft_consensus.cc:359] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.647603 29194 raft_consensus.cc:385] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.648087 29194 raft_consensus.cc:740] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.650739 29192 tablet_bootstrap.cc:654] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.651202 29194 consensus_queue.cc:260] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.659348 29169 raft_consensus.cc:493] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:31.660497 29169 raft_consensus.cc:515] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.662555 29169 leader_election.cc:290] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.664546 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:31.664784 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:31.665313 28895 raft_consensus.cc:2468] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:31.666779 29008 leader_election.cc:304] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.667068 29192 tablet_bootstrap.cc:492] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.667604 29192 ts_tablet_manager.cc:1403] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:22:31.667717 29169 raft_consensus.cc:2804] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:31.668172 29169 raft_consensus.cc:493] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:22:31.668066 29007 leader_election.cc:343] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:31.668841 29169 raft_consensus.cc:3060] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.670848 29192 raft_consensus.cc:359] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.671698 29192 raft_consensus.cc:385] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.672032 29192 raft_consensus.cc:740] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.672919 29192 consensus_queue.cc:260] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.675969 29192 ts_tablet_manager.cc:1434] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:31.677161 29192 tablet_bootstrap.cc:492] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.653751 29194 ts_tablet_manager.cc:1434] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 13:22:31.682053 29194 tablet_bootstrap.cc:492] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.683946 29192 tablet_bootstrap.cc:654] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.680369 29169 raft_consensus.cc:515] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.696405 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:31.697153 28895 raft_consensus.cc:3060] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.697414 29193 tablet_bootstrap.cc:492] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:31.702129 29204 raft_consensus.cc:493] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:31.703260 29204 raft_consensus.cc:515] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.698140 29193 ts_tablet_manager.cc:1403] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.065s	user 0.031s	sys 0.020s
I20260709 13:22:31.706044 28895 raft_consensus.cc:2468] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:31.707242 29204 leader_election.cc:290] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.708016 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:31.709192 29192 tablet_bootstrap.cc:492] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.708662 29169 leader_election.cc:290] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.708284 29193 raft_consensus.cc:359] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.709478 28894 raft_consensus.cc:2468] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:31.709757 29192 ts_tablet_manager.cc:1403] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.010s
I20260709 13:22:31.710004 29193 raft_consensus.cc:385] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.709934 29008 leader_election.cc:304] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.710549 29193 raft_consensus.cc:740] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.711028 29207 raft_consensus.cc:2804] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:31.711154 29008 leader_election.cc:304] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.711360 29193 consensus_queue.cc:260] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.714417 29193 ts_tablet_manager.cc:1434] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:22:31.715431 29193 tablet_bootstrap.cc:492] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:31.716454 29194 tablet_bootstrap.cc:654] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.719316 29192 raft_consensus.cc:359] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.720621 29192 raft_consensus.cc:385] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.721124 29169 raft_consensus.cc:2804] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:31.721076 29192 raft_consensus.cc:740] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.721710 29169 raft_consensus.cc:493] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:31.725288 29192 consensus_queue.cc:260] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.726819 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:31.728717 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:31.729863 29193 tablet_bootstrap.cc:654] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.728175 29192 ts_tablet_manager.cc:1434] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:22:31.733043 29169 raft_consensus.cc:3060] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:31.728237 29007 leader_election.cc:343] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:31.736009 29192 tablet_bootstrap.cc:492] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.741168 29194 tablet_bootstrap.cc:492] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.743127 29194 ts_tablet_manager.cc:1403] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.009s
W20260709 13:22:31.738318 29007 leader_election.cc:343] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:31.733985 29207 raft_consensus.cc:697] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:31.746381 29194 raft_consensus.cc:359] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.746368 29207 consensus_queue.cc:237] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.747422 29194 raft_consensus.cc:385] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.747913 29194 raft_consensus.cc:740] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.748711 29194 consensus_queue.cc:260] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.749423 29192 tablet_bootstrap.cc:654] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.751246 29194 ts_tablet_manager.cc:1434] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:31.752213 29194 tablet_bootstrap.cc:492] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.756177 29169 raft_consensus.cc:515] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.759840 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:31.760552 28895 raft_consensus.cc:3060] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.760726 29194 tablet_bootstrap.cc:654] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:31.768599 28841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:31.770358 28895 raft_consensus.cc:2468] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:31.771989 29008 leader_election.cc:304] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.773296 29209 raft_consensus.cc:2804] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:31.774258 29209 raft_consensus.cc:697] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:31.775447 29209 consensus_queue.cc:237] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.777516 29194 tablet_bootstrap.cc:492] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.778203 29194 ts_tablet_manager.cc:1403] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 13:22:31.781666 29194 raft_consensus.cc:359] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.782949 29193 tablet_bootstrap.cc:492] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:31.783417 29194 raft_consensus.cc:385] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.783118 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:31.783849 29194 raft_consensus.cc:740] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.784109 28969 raft_consensus.cc:3060] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.785851 29194 consensus_queue.cc:260] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.786460 28790 catalog_manager.cc:5697] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:31.788151 29194 ts_tablet_manager.cc:1434] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:22:31.789131 29194 tablet_bootstrap.cc:492] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.794827 29194 tablet_bootstrap.cc:654] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.795889 28969 raft_consensus.cc:2468] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:31.784423 29169 leader_election.cc:290] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.784791 29192 tablet_bootstrap.cc:492] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.785038 29193 ts_tablet_manager.cc:1403] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.033s
I20260709 13:22:31.799849 29193 raft_consensus.cc:359] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.800387 29193 raft_consensus.cc:385] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.800565 29193 raft_consensus.cc:740] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.801141 29193 consensus_queue.cc:260] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.801388 29194 tablet_bootstrap.cc:492] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.801921 29194 ts_tablet_manager.cc:1403] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:22:31.803165 29193 ts_tablet_manager.cc:1434] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:31.804212 29193 tablet_bootstrap.cc:492] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:31.804739 29194 raft_consensus.cc:359] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.805600 29194 raft_consensus.cc:385] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.805950 29194 raft_consensus.cc:740] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.806313 29192 ts_tablet_manager.cc:1403] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.071s	user 0.021s	sys 0.005s
I20260709 13:22:31.806743 29194 consensus_queue.cc:260] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.809181 29194 ts_tablet_manager.cc:1434] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:22:31.809298 28790 catalog_manager.cc:5697] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:31.810197 29194 tablet_bootstrap.cc:492] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.810503 29193 tablet_bootstrap.cc:654] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.812268 29192 raft_consensus.cc:359] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.813068 29192 raft_consensus.cc:385] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.813376 29192 raft_consensus.cc:740] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.814172 29192 consensus_queue.cc:260] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.816545 29192 ts_tablet_manager.cc:1434] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:31.817574 29192 tablet_bootstrap.cc:492] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.827034 29192 tablet_bootstrap.cc:654] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.832019 29193 tablet_bootstrap.cc:492] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:31.832842 29193 ts_tablet_manager.cc:1403] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.001s
I20260709 13:22:31.833431 29194 tablet_bootstrap.cc:654] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.834420 29136 raft_consensus.cc:493] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:31.834929 29136 raft_consensus.cc:515] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.835834 29193 raft_consensus.cc:359] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.836536 29193 raft_consensus.cc:385] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.836803 29193 raft_consensus.cc:740] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.837016 29136 leader_election.cc:290] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:31.837592 29193 consensus_queue.cc:260] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.838945 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:31.840121 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:31.840240 28895 raft_consensus.cc:2468] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 0.
I20260709 13:22:31.840919 29194 tablet_bootstrap.cc:492] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.840830 29042 raft_consensus.cc:2468] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 0.
I20260709 13:22:31.841518 29194 ts_tablet_manager.cc:1403] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.002s
I20260709 13:22:31.841684 29193 ts_tablet_manager.cc:1434] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:22:31.842010 28934 leader_election.cc:304] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:31.842779 29193 tablet_bootstrap.cc:492] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:31.844652 29194 raft_consensus.cc:359] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.845407 29194 raft_consensus.cc:385] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.845520 29136 raft_consensus.cc:2804] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:31.845773 29194 raft_consensus.cc:740] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.846124 29136 raft_consensus.cc:493] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:31.846969 29136 raft_consensus.cc:3060] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.846737 29194 consensus_queue.cc:260] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.849192 29194 ts_tablet_manager.cc:1434] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:31.849869 29193 tablet_bootstrap.cc:654] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.850284 29194 tablet_bootstrap.cc:492] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.854524 29192 tablet_bootstrap.cc:492] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.855053 29192 ts_tablet_manager.cc:1403] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.004s
I20260709 13:22:31.858130 29192 raft_consensus.cc:359] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.858820 29192 raft_consensus.cc:385] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.859120 29192 raft_consensus.cc:740] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.859817 29192 consensus_queue.cc:260] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.862020 29194 tablet_bootstrap.cc:654] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.862200 29192 ts_tablet_manager.cc:1434] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:31.863202 29192 tablet_bootstrap.cc:492] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.864012 29136 raft_consensus.cc:515] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.866617 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:31.867133 28895 raft_consensus.cc:3060] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.867285 29136 leader_election.cc:290] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:31.869397 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:31.869958 29042 raft_consensus.cc:3060] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.872697 29192 tablet_bootstrap.cc:654] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.877549 29042 raft_consensus.cc:2468] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 1.
I20260709 13:22:31.878753 28934 leader_election.cc:304] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.879597 29136 raft_consensus.cc:2804] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:31.879743 28895 raft_consensus.cc:2468] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 1.
I20260709 13:22:31.883303 29136 raft_consensus.cc:697] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:31.884215 29194 tablet_bootstrap.cc:492] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.884317 29136 consensus_queue.cc:237] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.884902 29192 tablet_bootstrap.cc:492] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.884851 29194 ts_tablet_manager.cc:1403] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.008s
I20260709 13:22:31.886005 29192 ts_tablet_manager.cc:1403] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:22:31.887310 29193 tablet_bootstrap.cc:492] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:31.887856 29193 ts_tablet_manager.cc:1403] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.002s
I20260709 13:22:31.888693 29194 raft_consensus.cc:359] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.889432 29194 raft_consensus.cc:385] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.889328 29192 raft_consensus.cc:359] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.889808 29194 raft_consensus.cc:740] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.890074 29192 raft_consensus.cc:385] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.890352 29192 raft_consensus.cc:740] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.890659 29194 consensus_queue.cc:260] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.891090 29192 consensus_queue.cc:260] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.891664 29169 raft_consensus.cc:493] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:31.891148 29193 raft_consensus.cc:359] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.893065 29169 raft_consensus.cc:515] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.893458 29192 ts_tablet_manager.cc:1434] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:31.893687 29193 raft_consensus.cc:385] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.894428 29192 tablet_bootstrap.cc:492] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5: Bootstrap starting.
I20260709 13:22:31.896150 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:31.896332 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:31.897183 28895 raft_consensus.cc:2468] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:31.898469 29008 leader_election.cc:304] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.899340 29209 raft_consensus.cc:2804] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:31.899712 29209 raft_consensus.cc:493] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:31.900040 29209 raft_consensus.cc:3060] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.900131 29169 leader_election.cc:290] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
W20260709 13:22:31.900171 29007 leader_election.cc:343] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:31.900720 29169 raft_consensus.cc:493] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:31.900962 29192 tablet_bootstrap.cc:654] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.901268 29169 raft_consensus.cc:515] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.894234 29193 raft_consensus.cc:740] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.903330 29169 leader_election.cc:290] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.904575 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:31.905260 28969 raft_consensus.cc:2468] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:31.904606 29193 consensus_queue.cc:260] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.905371 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:31.905625 29194 ts_tablet_manager.cc:1434] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:22:31.905982 28895 raft_consensus.cc:2468] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:31.906500 29007 leader_election.cc:304] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.906953 29194 tablet_bootstrap.cc:492] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:31.907356 29169 raft_consensus.cc:2804] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:31.907737 29169 raft_consensus.cc:493] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:31.908090 29169 raft_consensus.cc:3060] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.911674 29209 raft_consensus.cc:515] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.913432 29194 tablet_bootstrap.cc:654] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.914466 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:31.915066 28895 raft_consensus.cc:3060] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.914623 29220 raft_consensus.cc:493] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:31.917167 29220 raft_consensus.cc:515] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.919200 29220 leader_election.cc:290] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:31.919255 29169 raft_consensus.cc:515] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.921301 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:31.922111 28894 raft_consensus.cc:2393] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3dcaa525ce54903a0606732f37b73e9 in current term 1: Already voted for candidate f2ce0eedd00d45a192030ea417d443b5 in this term.
I20260709 13:22:31.922091 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:31.925787 28934 leader_election.cc:304] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9; no voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:31.932423 28895 raft_consensus.cc:2468] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:31.925896 29193 ts_tablet_manager.cc:1434] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:22:31.933849 29220 raft_consensus.cc:3060] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.941423 29193 tablet_bootstrap.cc:492] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:31.941934 29008 leader_election.cc:304] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.942003 29209 leader_election.cc:290] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.943660 29169 leader_election.cc:290] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.943221 29192 tablet_bootstrap.cc:492] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5: No bootstrap required, opened a new log
I20260709 13:22:31.944432 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:31.944450 29192 ts_tablet_manager.cc:1403] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.004s
I20260709 13:22:31.943673 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:31.945775 28895 raft_consensus.cc:3060] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.944037 29207 raft_consensus.cc:2804] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:31.947089 29007 leader_election.cc:343] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:31.946830 29207 raft_consensus.cc:697] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:31.948210 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:31.948776 28969 raft_consensus.cc:3060] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.948485 29207 consensus_queue.cc:237] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.950178 29192 raft_consensus.cc:359] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.951000 29192 raft_consensus.cc:385] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.957170 29209 raft_consensus.cc:493] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:31.958396 29193 tablet_bootstrap.cc:654] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:31.957906 29209 raft_consensus.cc:515] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.951553 29192 raft_consensus.cc:740] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.961416 29192 consensus_queue.cc:260] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.961669 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
W20260709 13:22:31.964835 29008 leader_election.cc:343] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:31.965729 29194 tablet_bootstrap.cc:492] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:31.967116 29194 ts_tablet_manager.cc:1403] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.060s	user 0.027s	sys 0.009s
I20260709 13:22:31.969509 29209 leader_election.cc:290] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.969784 29194 raft_consensus.cc:359] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.970714 29192 ts_tablet_manager.cc:1434] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 13:22:31.971513 29194 raft_consensus.cc:385] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:31.971848 29194 raft_consensus.cc:740] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:31.972546 29194 consensus_queue.cc:260] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.974082 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:31.974884 28970 raft_consensus.cc:2468] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:31.976467 29007 leader_election.cc:304] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:31.980901 29207 raft_consensus.cc:2804] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:31.981463 29207 raft_consensus.cc:493] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:31.981948 29207 raft_consensus.cc:3060] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:31.984654 28791 catalog_manager.cc:5697] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:31.987015 28934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.3:35415, user_credentials={real_user=slave}} blocked reactor thread for 51030.5us
I20260709 13:22:31.989368 29220 raft_consensus.cc:2749] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:31.991947 28895 raft_consensus.cc:2468] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:31.968576 28969 raft_consensus.cc:2468] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:31.993610 29207 raft_consensus.cc:515] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:31.993825 29007 leader_election.cc:304] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:31.995016 29209 raft_consensus.cc:2804] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:31.995925 29209 raft_consensus.cc:697] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:31.996660 29207 leader_election.cc:290] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:31.997467 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
W20260709 13:22:31.998667 29008 leader_election.cc:343] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:31.998814 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:31.999609 28970 raft_consensus.cc:3060] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.009416 29209 consensus_queue.cc:237] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.015318 29207 raft_consensus.cc:493] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.016193 29207 raft_consensus.cc:515] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.018637 28791 catalog_manager.cc:5697] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.019371 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:32.020828 29207 leader_election.cc:290] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
W20260709 13:22:32.022106 29008 leader_election.cc:343] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:32.022161 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:32.023471 28969 raft_consensus.cc:2468] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:32.024355 28970 raft_consensus.cc:2468] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:32.024829 29007 leader_election.cc:304] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:32.026317 29169 raft_consensus.cc:2804] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:32.026682 29169 raft_consensus.cc:493] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:32.026906 29194 ts_tablet_manager.cc:1434] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.060s	user 0.025s	sys 0.013s
I20260709 13:22:32.026998 29169 raft_consensus.cc:3060] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.028002 29194 tablet_bootstrap.cc:492] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: Bootstrap starting.
I20260709 13:22:32.028868 29193 tablet_bootstrap.cc:492] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:32.029524 29007 leader_election.cc:304] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:32.030263 29193 ts_tablet_manager.cc:1403] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.014s
I20260709 13:22:32.030488 29208 raft_consensus.cc:493] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.031037 29208 raft_consensus.cc:515] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.033926 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:32.034194 29194 tablet_bootstrap.cc:654] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:32.034551 28895 raft_consensus.cc:2468] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:32.035786 29008 leader_election.cc:304] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:32.036655 29206 raft_consensus.cc:2804] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:32.037256 29206 raft_consensus.cc:697] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.037482 29169 raft_consensus.cc:515] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.038358 29206 consensus_queue.cc:237] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.040218 29204 raft_consensus.cc:2804] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:32.040766 29204 raft_consensus.cc:493] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:32.044353 29204 raft_consensus.cc:3060] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.044001 29193 raft_consensus.cc:359] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.045141 29193 raft_consensus.cc:385] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:32.045495 29193 raft_consensus.cc:740] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:32.046277 29193 consensus_queue.cc:260] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.048735 29193 ts_tablet_manager.cc:1434] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:22:32.049445 29208 leader_election.cc:290] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:32.052009 29193 tablet_bootstrap.cc:492] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:32.052552 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:32.054903 28895 raft_consensus.cc:3060] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.063110 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:32.063671 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:32.064436 28970 raft_consensus.cc:3060] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.063688 28969 raft_consensus.cc:2468] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 0.
I20260709 13:22:32.068136 28895 raft_consensus.cc:2468] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:32.078099 29204 raft_consensus.cc:515] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.080915 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:32.081297 28968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:32.081518 28894 raft_consensus.cc:3060] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.081956 28968 raft_consensus.cc:3060] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.062704 29169 leader_election.cc:290] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:32.084766 29193 tablet_bootstrap.cc:654] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:32.087453 29204 leader_election.cc:290] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:32.088704 29008 leader_election.cc:304] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:32.089715 29204 raft_consensus.cc:2804] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:32.090528 29204 raft_consensus.cc:697] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.091357 29204 consensus_queue.cc:237] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.096451 28968 raft_consensus.cc:2468] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:32.097399 29193 tablet_bootstrap.cc:492] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:32.098133 29193 ts_tablet_manager.cc:1403] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:22:32.098089 29007 leader_election.cc:304] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:32.088804 28894 raft_consensus.cc:2468] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:32.099380 29169 raft_consensus.cc:2804] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:32.099853 29169 raft_consensus.cc:697] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.100068 28970 raft_consensus.cc:2468] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 1.
I20260709 13:22:32.100731 29169 consensus_queue.cc:237] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.103118 29193 raft_consensus.cc:359] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.104125 29193 raft_consensus.cc:385] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:32.104522 29193 raft_consensus.cc:740] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:32.112614 29193 consensus_queue.cc:260] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.115736 29193 ts_tablet_manager.cc:1434] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:22:32.117076 29193 tablet_bootstrap.cc:492] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32: Bootstrap starting.
I20260709 13:22:32.116675 28790 catalog_manager.cc:5697] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.125655 29193 tablet_bootstrap.cc:654] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:32.131557 29209 raft_consensus.cc:493] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.132097 29209 raft_consensus.cc:515] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.134131 29209 leader_election.cc:290] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:32.136029 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:32.136336 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
W20260709 13:22:32.137329 29008 leader_election.cc:343] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:32.138075 29007 leader_election.cc:343] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:32.138646 29007 leader_election.cc:304] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2ce0eedd00d45a192030ea417d443b5; no voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:32.139561 29209 raft_consensus.cc:2749] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:32.148494 29194 tablet_bootstrap.cc:492] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: No bootstrap required, opened a new log
I20260709 13:22:32.149159 29194 ts_tablet_manager.cc:1403] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: Time spent bootstrapping tablet: real 0.121s	user 0.048s	sys 0.052s
I20260709 13:22:32.149247 29193 tablet_bootstrap.cc:492] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32: No bootstrap required, opened a new log
I20260709 13:22:32.149876 29193 ts_tablet_manager.cc:1403] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.006s
I20260709 13:22:32.152022 29194 raft_consensus.cc:359] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.152459 29193 raft_consensus.cc:359] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.152935 29194 raft_consensus.cc:385] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:32.153159 29193 raft_consensus.cc:385] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:32.153400 29194 raft_consensus.cc:740] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Initialized, Role: FOLLOWER
I20260709 13:22:32.153736 29193 raft_consensus.cc:740] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Initialized, Role: FOLLOWER
I20260709 13:22:32.154552 29193 consensus_queue.cc:260] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.154651 29194 consensus_queue.cc:260] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.156839 29193 ts_tablet_manager.cc:1434] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:32.157730 29194 ts_tablet_manager.cc:1434] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:32.167629 28790 catalog_manager.cc:5697] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.169569 28790 catalog_manager.cc:5697] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.173636 28790 catalog_manager.cc:5697] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 1 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.255738 29204 consensus_queue.cc:1048] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.266644 29204 consensus_queue.cc:1048] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.299758 29230 raft_consensus.cc:493] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.300354 29230 raft_consensus.cc:515] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.302568 29230 leader_election.cc:290] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.303135 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:32.303478 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:32.303869 28894 raft_consensus.cc:2393] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3dcaa525ce54903a0606732f37b73e9 in current term 1: Already voted for candidate f2ce0eedd00d45a192030ea417d443b5 in this term.
I20260709 13:22:32.305116 28934 leader_election.cc:304] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9; no voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:32.305824 29230 raft_consensus.cc:3060] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.310742 29230 raft_consensus.cc:2749] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:32.342460 29204 consensus_queue.cc:1048] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.352185 29206 consensus_queue.cc:1048] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.382591 29204 consensus_queue.cc:1048] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.387533 29204 consensus_queue.cc:1048] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:32.393311 29230 raft_consensus.cc:493] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.393784 29230 raft_consensus.cc:515] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.395798 29230 leader_election.cc:290] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.397209 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32" is_pre_election: true
I20260709 13:22:32.398066 28894 raft_consensus.cc:2468] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 0.
I20260709 13:22:32.398131 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:32.398856 29042 raft_consensus.cc:2468] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 0.
I20260709 13:22:32.400132 28934 leader_election.cc:304] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:32.401031 29230 raft_consensus.cc:2804] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:32.401484 29230 raft_consensus.cc:493] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:32.401881 29230 raft_consensus.cc:3060] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.407179 29238 raft_consensus.cc:493] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:32.407696 29238 raft_consensus.cc:515] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.409075 29230 raft_consensus.cc:515] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.409771 29238 leader_election.cc:290] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.411165 28969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3dcaa525ce54903a0606732f37b73e9" is_pre_election: true
I20260709 13:22:32.410832 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5" is_pre_election: true
I20260709 13:22:32.411998 28969 raft_consensus.cc:2393] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11ff4453d5684688997cb71f55cccc32 in current term 1: Already voted for candidate f2ce0eedd00d45a192030ea417d443b5 in this term.
I20260709 13:22:32.413038 28858 leader_election.cc:304] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32; no voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:32.413786 29238 raft_consensus.cc:3060] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.415855 29230 leader_election.cc:290] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.416751 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:32.416718 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:32.417582 29042 raft_consensus.cc:3060] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.417703 28894 raft_consensus.cc:3060] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:32.423664 28894 raft_consensus.cc:2468] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 1.
I20260709 13:22:32.424816 28934 leader_election.cc:304] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:32.425539 29238 raft_consensus.cc:2749] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:32.425737 29230 raft_consensus.cc:2804] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:32.425550 29042 raft_consensus.cc:2468] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 1.
I20260709 13:22:32.426535 29230 raft_consensus.cc:697] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:32.427429 29230 consensus_queue.cc:237] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.428767 29204 consensus_queue.cc:1048] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.437476 28790 catalog_manager.cc:5697] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 1 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.440641 29206 consensus_queue.cc:1048] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.443761 29206 consensus_queue.cc:1048] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.453361 29206 consensus_queue.cc:1048] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.494086 29206 consensus_queue.cc:1048] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.503677 29206 consensus_queue.cc:1048] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.514420 29206 consensus_queue.cc:1048] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.522388 29042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e04c4746d8534435827a84740aad69d4"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:32.522706 29136 consensus_queue.cc:1048] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.522976 29042 raft_consensus.cc:606] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:32.529888 29043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:32.530514 29043 raft_consensus.cc:606] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:32.538919 28970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
mode: GRACEFUL
new_leader_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:48748
I20260709 13:22:32.539582 28970 raft_consensus.cc:606] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Received request to transfer leadership to TS 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:32.540517 29209 consensus_queue.cc:1048] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:32.547279 29230 consensus_queue.cc:1048] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:32.550105 29043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:32.550884 29043 raft_consensus.cc:606] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS 11ff4453d5684688997cb71f55cccc32
I20260709 13:22:32.560115 29043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:32.560665 29043 raft_consensus.cc:606] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:32.561372 29230 raft_consensus.cc:993] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: : Instructing follower 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:32.561899 29258 raft_consensus.cc:1081] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Signalling peer 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:32.563349 28895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:37598
I20260709 13:22:32.563815 28895 raft_consensus.cc:493] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:32.564141 28895 raft_consensus.cc:3060] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.569730 28895 raft_consensus.cc:515] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.569792 29043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "861dcf06cce340dab580232182854959"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:32.570564 29043 raft_consensus.cc:606] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:32.572422 28895 leader_election.cc:290] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.572655 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:32.573313 29043 raft_consensus.cc:3060] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.573856 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b50b06233fe41c0a67cfa0d081cc140" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:32.574430 28970 raft_consensus.cc:3055] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:32.574745 28970 raft_consensus.cc:740] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:32.575541 28970 consensus_queue.cc:260] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.576188 29042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:32.576768 29042 raft_consensus.cc:606] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:32.576818 28970 raft_consensus.cc:3060] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.580597 29043 raft_consensus.cc:2468] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:32.581722 28859 leader_election.cc:304] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:32.582316 29043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
mode: GRACEFUL
new_leader_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:44478
I20260709 13:22:32.582506 29164 raft_consensus.cc:2804] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.582914 29043 raft_consensus.cc:606] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Received request to transfer leadership to TS a3dcaa525ce54903a0606732f37b73e9
I20260709 13:22:32.583031 29164 raft_consensus.cc:697] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:32.583890 29164 consensus_queue.cc:237] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.584141 28970 raft_consensus.cc:2468] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:32.589144 28970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724b577974364738b3f5dfd308dec95b"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
mode: GRACEFUL
new_leader_uuid: "f2ce0eedd00d45a192030ea417d443b5"
 from {username='slave'} at 127.0.0.1:48748
I20260709 13:22:32.589680 28970 raft_consensus.cc:606] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Received request to transfer leadership to TS f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:32.591306 28791 catalog_manager.cc:5697] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 1 to 2, leader changed from a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2) to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.799412 29209 raft_consensus.cc:993] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:32.800371 29207 raft_consensus.cc:1081] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:32.801434 29206 raft_consensus.cc:993] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:32.802143 29207 raft_consensus.cc:1081] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:32.802809 28969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "861dcf06cce340dab580232182854959"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:48726
I20260709 13:22:32.803668 28969 raft_consensus.cc:493] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:32.804107 28969 raft_consensus.cc:3060] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.804119 28895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e04c4746d8534435827a84740aad69d4"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:37586
I20260709 13:22:32.804787 28895 raft_consensus.cc:493] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:32.805217 28895 raft_consensus.cc:3060] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.812347 28969 raft_consensus.cc:515] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.812316 28895 raft_consensus.cc:515] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.814394 28969 leader_election.cc:290] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.814406 28895 leader_election.cc:290] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.816040 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:32.816896 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:32.817082 29043 raft_consensus.cc:3055] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:32.817222 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04c4746d8534435827a84740aad69d4" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:32.817500 29043 raft_consensus.cc:740] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.818161 28970 raft_consensus.cc:3060] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.819340 29042 raft_consensus.cc:3055] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:32.818971 29043 consensus_queue.cc:260] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.819693 29042 raft_consensus.cc:740] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.821022 29043 raft_consensus.cc:3060] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.821000 29042 consensus_queue.cc:260] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.823119 29042 raft_consensus.cc:3060] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.823674 29207 raft_consensus.cc:993] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:32.824280 29207 raft_consensus.cc:1081] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:32.824499 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861dcf06cce340dab580232182854959" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:32.824599 29258 consensus_queue.cc:1048] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:32.825321 28895 raft_consensus.cc:3060] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.826359 28969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:48726
I20260709 13:22:32.826931 28969 raft_consensus.cc:493] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:32.827289 28969 raft_consensus.cc:3060] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.833986 28895 raft_consensus.cc:2468] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:32.835711 28934 leader_election.cc:304] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:32.836661 29043 raft_consensus.cc:2468] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:32.836678 29258 raft_consensus.cc:2804] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.837695 29258 raft_consensus.cc:697] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:32.838913 29258 consensus_queue.cc:237] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.840333 28969 raft_consensus.cc:515] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.843917 29042 raft_consensus.cc:2468] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:32.848657 28859 leader_election.cc:304] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:32.849383 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:32.850250 28895 raft_consensus.cc:3060] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.851290 29164 raft_consensus.cc:2804] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.851895 29164 raft_consensus.cc:697] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:32.853075 29164 consensus_queue.cc:237] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.847177 28969 leader_election.cc:290] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.845150 28970 raft_consensus.cc:2468] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:32.859069 28895 raft_consensus.cc:2468] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:32.860435 28934 leader_election.cc:304] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:32.861559 29136 raft_consensus.cc:2804] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.861464 29042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c66185aca6b4b3c8210c61ac9b6a09f" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:32.862412 29042 raft_consensus.cc:3055] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:32.862735 29042 raft_consensus.cc:740] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.863837 29042 consensus_queue.cc:260] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.865975 29042 raft_consensus.cc:3060] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.868793 28791 catalog_manager.cc:5697] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.875600 29042 raft_consensus.cc:2468] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:32.880610 29136 raft_consensus.cc:697] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:32.881899 29136 consensus_queue.cc:237] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.882920 28792 catalog_manager.cc:5697] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.887912 29262 consensus_queue.cc:1048] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:32.894420 29207 raft_consensus.cc:993] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:32.895104 29207 raft_consensus.cc:1081] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:32.897408 28970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:48726
I20260709 13:22:32.898249 28970 raft_consensus.cc:493] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:32.898698 28970 raft_consensus.cc:3060] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.908491 28970 raft_consensus.cc:515] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.911809 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:32.912416 28894 raft_consensus.cc:3060] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.912813 28970 leader_election.cc:290] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.914399 28791 catalog_manager.cc:5697] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.917948 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeeeaf8fbc5e43e6a37784a02f7ac391" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:32.918565 29043 raft_consensus.cc:3055] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:32.918676 29136 raft_consensus.cc:993] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: : Instructing follower f2ce0eedd00d45a192030ea417d443b5 to start an election
I20260709 13:22:32.919013 29043 raft_consensus.cc:740] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.919476 29136 raft_consensus.cc:1081] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Signalling peer f2ce0eedd00d45a192030ea417d443b5 to start an election
I20260709 13:22:32.920198 29043 consensus_queue.cc:260] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.921406 29042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "724b577974364738b3f5dfd308dec95b"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
 from {username='slave'} at 127.0.0.1:44446
I20260709 13:22:32.922029 29042 raft_consensus.cc:493] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:32.922066 29043 raft_consensus.cc:3060] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.922508 29042 raft_consensus.cc:3060] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.925019 28894 raft_consensus.cc:2468] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:32.926329 28934 leader_election.cc:304] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:32.927263 29136 raft_consensus.cc:2804] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.930341 29136 raft_consensus.cc:697] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:32.931417 29136 consensus_queue.cc:237] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.931737 29043 raft_consensus.cc:2468] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:32.931648 29042 raft_consensus.cc:515] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.933979 29042 leader_election.cc:290] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:32.936281 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:32.936867 28894 raft_consensus.cc:3060] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.936861 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724b577974364738b3f5dfd308dec95b" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:32.939208 28970 raft_consensus.cc:3055] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:32.939534 28970 raft_consensus.cc:740] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:32.940806 29209 raft_consensus.cc:993] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:32.940450 28970 consensus_queue.cc:260] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.941398 29209 raft_consensus.cc:1081] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:32.941934 28970 raft_consensus.cc:3060] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.943001 28895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:37586
I20260709 13:22:32.943544 28895 raft_consensus.cc:493] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:32.943879 28895 raft_consensus.cc:3060] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.944655 28894 raft_consensus.cc:2468] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 2.
I20260709 13:22:32.945112 28790 catalog_manager.cc:5697] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.946251 29008 leader_election.cc:304] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:32.947211 29209 raft_consensus.cc:2804] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.947676 29209 raft_consensus.cc:697] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 2 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.948838 28970 raft_consensus.cc:2468] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 2.
I20260709 13:22:32.948565 29209 consensus_queue.cc:237] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.953935 28895 raft_consensus.cc:515] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.956576 28895 leader_election.cc:290] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:32.956761 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:32.957348 28970 raft_consensus.cc:3060] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.958340 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2ae21e44ea4b09a37018ccfe51012d" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:32.958928 29043 raft_consensus.cc:3055] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:32.959232 29043 raft_consensus.cc:740] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:32.960228 29043 consensus_queue.cc:260] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.962007 29043 raft_consensus.cc:3060] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:32.964210 28970 raft_consensus.cc:2468] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:32.965621 28858 leader_election.cc:304] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:32.965392 28792 catalog_manager.cc:5697] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 1 to 2, leader changed from a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2) to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 2 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:32.966580 29164 raft_consensus.cc:2804] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:32.967118 29164 raft_consensus.cc:697] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:32.968240 29164 consensus_queue.cc:237] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:32.968998 29043 raft_consensus.cc:2468] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:32.976420 28790 catalog_manager.cc:5697] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:32.999408 29043 raft_consensus.cc:1275] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.000577 29164 consensus_queue.cc:1048] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.011816 28970 raft_consensus.cc:1275] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.013147 29238 consensus_queue.cc:1048] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.119299 29169 raft_consensus.cc:993] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:33.119741 29209 raft_consensus.cc:1081] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer 11ff4453d5684688997cb71f55cccc32 to start an election
I20260709 13:22:33.121174 28895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
 from {username='slave'} at 127.0.0.1:37586
I20260709 13:22:33.121732 28895 raft_consensus.cc:493] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:33.122009 28895 raft_consensus.cc:3060] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:33.126572 28895 raft_consensus.cc:515] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:33.127983 28895 leader_election.cc:290] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Requested vote from peers a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:33.128823 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:33.129019 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6817e34308ca436cb9d321894e5d64e9" candidate_uuid: "11ff4453d5684688997cb71f55cccc32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:33.129429 28970 raft_consensus.cc:3060] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:33.129679 29043 raft_consensus.cc:3055] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:33.130080 29043 raft_consensus.cc:740] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:33.130736 29043 consensus_queue.cc:260] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:33.131691 29043 raft_consensus.cc:3060] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:33.134442 28970 raft_consensus.cc:2468] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:33.135422 28858 leader_election.cc:304] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:33.136119 29238 raft_consensus.cc:2804] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:33.136528 29043 raft_consensus.cc:2468] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11ff4453d5684688997cb71f55cccc32 in term 2.
I20260709 13:22:33.136636 29238 raft_consensus.cc:697] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Becoming Leader. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:33.137923 29238 consensus_queue.cc:237] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:33.143253 29204 raft_consensus.cc:993] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: : Instructing follower a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:33.143867 29209 raft_consensus.cc:1081] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Signalling peer a3dcaa525ce54903a0606732f37b73e9 to start an election
I20260709 13:22:33.146798 28970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84"
dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
 from {username='slave'} at 127.0.0.1:48726
I20260709 13:22:33.147656 28970 raft_consensus.cc:493] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:33.147982 28970 raft_consensus.cc:3060] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:33.150255 28792 catalog_manager.cc:5697] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to 11ff4453d5684688997cb71f55cccc32 (127.17.139.1). New cstate: current_term: 2 leader_uuid: "11ff4453d5684688997cb71f55cccc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:33.153995 28970 raft_consensus.cc:515] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:33.155613 28970 leader_election.cc:290] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3:35415)
I20260709 13:22:33.156541 28895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:33.156839 29043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd380a58d404c148eafbc64a8f91c84" candidate_uuid: "a3dcaa525ce54903a0606732f37b73e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
I20260709 13:22:33.157191 28895 raft_consensus.cc:3060] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:33.157510 29043 raft_consensus.cc:3055] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:33.157866 29043 raft_consensus.cc:740] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:33.158597 29043 consensus_queue.cc:260] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:33.159672 29043 raft_consensus.cc:3060] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:33.162309 28895 raft_consensus.cc:2468] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:33.163272 28934 leader_election.cc:304] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11ff4453d5684688997cb71f55cccc32, a3dcaa525ce54903a0606732f37b73e9; no voters: 
I20260709 13:22:33.164021 29136 raft_consensus.cc:2804] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:33.164417 29136 raft_consensus.cc:697] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Becoming Leader. State: Replica: a3dcaa525ce54903a0606732f37b73e9, State: Running, Role: LEADER
I20260709 13:22:33.164485 29043 raft_consensus.cc:2468] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3dcaa525ce54903a0606732f37b73e9 in term 2.
I20260709 13:22:33.165450 29136 consensus_queue.cc:237] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:33.172278 28792 catalog_manager.cc:5697] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 reported cstate change: term changed from 1 to 2, leader changed from f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3) to a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2). New cstate: current_term: 2 leader_uuid: "a3dcaa525ce54903a0606732f37b73e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:33.326864 28895 raft_consensus.cc:1275] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.328135 29262 consensus_queue.cc:1048] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.334594 28894 raft_consensus.cc:1275] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.337575 29043 raft_consensus.cc:1275] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.339239 29262 consensus_queue.cc:1048] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.339792 29136 consensus_queue.cc:1048] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.349809 29042 raft_consensus.cc:1275] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.351756 28894 raft_consensus.cc:1275] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.357237 29262 consensus_queue.cc:1048] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.358620 29263 consensus_queue.cc:1048] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:33.369997 29042 raft_consensus.cc:1275] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.374541 29136 consensus_queue.cc:1048] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.401120 29042 raft_consensus.cc:1275] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.402410 29265 consensus_queue.cc:1048] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.412290 28970 raft_consensus.cc:1275] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.414402 29164 consensus_queue.cc:1048] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.450845 29043 raft_consensus.cc:1275] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.452019 29164 consensus_queue.cc:1048] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.460747 28970 raft_consensus.cc:1275] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.462743 29270 consensus_queue.cc:1048] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.527761 28894 raft_consensus.cc:1275] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.529299 29209 consensus_queue.cc:1048] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.538221 28970 raft_consensus.cc:1275] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.540103 29272 consensus_queue.cc:1048] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:33.647482 28970 raft_consensus.cc:1275] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.648681 29164 consensus_queue.cc:1048] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.659011 29043 raft_consensus.cc:1275] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer 11ff4453d5684688997cb71f55cccc32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.660436 29270 consensus_queue.cc:1048] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.716343 29043 raft_consensus.cc:1275] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.717581 29136 consensus_queue.cc:1048] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:33.726372 28894 raft_consensus.cc:1275] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Refusing update from remote peer a3dcaa525ce54903a0606732f37b73e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:33.732863 29230 consensus_queue.cc:1048] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:35.592720 28790 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53780:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:35.612238 28790 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53780:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:35.647608 17964 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:35.856202 29311 log.cc:927] Time spent T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
W20260709 13:22:35.882601 29302 log.cc:927] Time spent T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
W20260709 13:22:35.864966 29008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.1:37935, user_credentials={real_user=slave}} blocked reactor thread for 86508.4us
I20260709 13:22:35.980239 29334 tablet.cc:1724] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.012908 29335 tablet.cc:1724] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:36.034349 29331 log.cc:927] Time spent T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:22:36.053525 29337 tablet.cc:1724] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:36.055861 29321 log.cc:927] Time spent T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:22:36.102228 29340 tablet.cc:1724] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.104456 29336 tablet.cc:1724] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.087385 29329 tablet.cc:1724] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.116209 29343 tablet.cc:1724] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.168927 28893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c"
dest_uuid: "11ff4453d5684688997cb71f55cccc32"
mode: GRACEFUL
new_leader_uuid: "f2ce0eedd00d45a192030ea417d443b5"
 from {username='slave'} at 127.0.0.1:60990
I20260709 13:22:36.169742 28893 raft_consensus.cc:606] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Received request to transfer leadership to TS f2ce0eedd00d45a192030ea417d443b5
I20260709 13:22:36.171478 17964 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:22:36.172138 17964 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:22:36.172502 28858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.139.2:43357, user_credentials={real_user=slave}} blocked reactor thread for 133282us
I20260709 13:22:36.175195 29348 tablet.cc:1724] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.157073 29339 tablet.cc:1724] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.183059 29336 tablet.cc:1724] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.185120 29337 tablet.cc:1724] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.193207 29344 tablet.cc:1724] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.194054 29349 tablet.cc:1724] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.196962 29336 tablet.cc:1724] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.203265 29334 tablet.cc:1724] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.205065 29346 tablet.cc:1724] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.221799 29340 tablet.cc:1724] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.236181 29335 tablet.cc:1724] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.243855 29334 tablet.cc:1724] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.263463 29346 tablet.cc:1724] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.243093 29343 tablet.cc:1724] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.253060 29339 tablet.cc:1724] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.242200 29336 tablet.cc:1724] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.258571 29344 tablet.cc:1724] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.263384 29337 tablet.cc:1724] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.250438 29329 tablet.cc:1724] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.260133 29340 tablet.cc:1724] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:36.316802 28790 catalog_manager.cc:6242] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d: soft_deleted_table [id=92e14711bcd84e068dda6429c97fedc9] alter complete (version 1)
I20260709 13:22:36.545270 29314 raft_consensus.cc:993] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32: : Instructing follower f2ce0eedd00d45a192030ea417d443b5 to start an election
I20260709 13:22:36.545827 29350 raft_consensus.cc:1081] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Signalling peer f2ce0eedd00d45a192030ea417d443b5 to start an election
I20260709 13:22:36.547363 29038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c"
dest_uuid: "f2ce0eedd00d45a192030ea417d443b5"
 from {username='slave'} at 127.0.0.1:44462
I20260709 13:22:36.547879 29038 raft_consensus.cc:493] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.548206 29038 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.554685 29038 raft_consensus.cc:515] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:36.556241 29038 leader_election.cc:290] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 3 election: Requested vote from peers 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935), a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357)
I20260709 13:22:36.557055 28894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11ff4453d5684688997cb71f55cccc32"
I20260709 13:22:36.557139 28970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c50f0e89e544afba188260ee500d39c" candidate_uuid: "f2ce0eedd00d45a192030ea417d443b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a3dcaa525ce54903a0606732f37b73e9"
I20260709 13:22:36.557802 28894 raft_consensus.cc:3055] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:36.557893 28970 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.558554 28894 raft_consensus.cc:740] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11ff4453d5684688997cb71f55cccc32, State: Running, Role: LEADER
I20260709 13:22:36.559329 28894 consensus_queue.cc:260] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:36.560286 28894 raft_consensus.cc:3060] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:36.563098 28970 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 3.
I20260709 13:22:36.564266 29007 leader_election.cc:304] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3dcaa525ce54903a0606732f37b73e9, f2ce0eedd00d45a192030ea417d443b5; no voters: 
I20260709 13:22:36.565053 29272 raft_consensus.cc:2804] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:36.565447 29272 raft_consensus.cc:697] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 3 LEADER]: Becoming Leader. State: Replica: f2ce0eedd00d45a192030ea417d443b5, State: Running, Role: LEADER
I20260709 13:22:36.565536 28894 raft_consensus.cc:2468] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce0eedd00d45a192030ea417d443b5 in term 3.
I20260709 13:22:36.566380 29272 consensus_queue.cc:237] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } }
I20260709 13:22:36.575017 28792 catalog_manager.cc:5697] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 reported cstate change: term changed from 2 to 3, leader changed from 11ff4453d5684688997cb71f55cccc32 (127.17.139.1) to f2ce0eedd00d45a192030ea417d443b5 (127.17.139.3). New cstate: current_term: 3 leader_uuid: "f2ce0eedd00d45a192030ea417d443b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce0eedd00d45a192030ea417d443b5" member_type: VOTER last_known_addr { host: "127.17.139.3" port: 35415 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:37.115810 28970 raft_consensus.cc:1275] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:37.116863 29272 consensus_queue.cc:1048] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dcaa525ce54903a0606732f37b73e9" member_type: VOTER last_known_addr { host: "127.17.139.2" port: 43357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:37.127345 28894 raft_consensus.cc:1275] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Refusing update from remote peer f2ce0eedd00d45a192030ea417d443b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:37.129122 29272 consensus_queue.cc:1048] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11ff4453d5684688997cb71f55cccc32" member_type: VOTER last_known_addr { host: "127.17.139.1" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:37.228551 17964 tablet_server.cc:179] TabletServer@127.17.139.1:0 shutting down...
W20260709 13:22:37.253175 28934 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:22:37.256675 28934 consensus_peers.cc:597] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 -> Peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Couldn't send request to peer 11ff4453d5684688997cb71f55cccc32. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:37.262781 29008 consensus_peers.cc:597] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 -> Peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Couldn't send request to peer 11ff4453d5684688997cb71f55cccc32. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:37.266224 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:37.267171 17964 tablet_replica.cc:333] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.267979 17964 raft_consensus.cc:2243] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.268445 17964 raft_consensus.cc:2272] T 724b577974364738b3f5dfd308dec95b P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.270918 17964 tablet_replica.cc:333] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.271524 17964 raft_consensus.cc:2243] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.271931 17964 raft_consensus.cc:2272] T 7c66185aca6b4b3c8210c61ac9b6a09f P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.274307 17964 tablet_replica.cc:333] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.274866 17964 raft_consensus.cc:2243] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.275580 17964 raft_consensus.cc:2272] T 6817e34308ca436cb9d321894e5d64e9 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.278018 17964 tablet_replica.cc:333] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.278914 17964 raft_consensus.cc:2243] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.279413 17964 raft_consensus.cc:2272] T aeeeaf8fbc5e43e6a37784a02f7ac391 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:37.280956 28934 consensus_peers.cc:597] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 -> Peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Couldn't send request to peer 11ff4453d5684688997cb71f55cccc32. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:37.281844 17964 tablet_replica.cc:333] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.282534 17964 raft_consensus.cc:2243] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.282905 17964 raft_consensus.cc:2272] T ddd380a58d404c148eafbc64a8f91c84 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.285781 17964 tablet_replica.cc:333] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.286325 17964 raft_consensus.cc:2243] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.286700 17964 raft_consensus.cc:2272] T 861dcf06cce340dab580232182854959 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.288537 17964 tablet_replica.cc:333] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.289052 17964 raft_consensus.cc:2243] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.289733 17964 raft_consensus.cc:2272] T e04c4746d8534435827a84740aad69d4 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.292166 17964 tablet_replica.cc:333] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.292964 17964 raft_consensus.cc:2243] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.293581 17964 raft_consensus.cc:2272] T 7506074b98eb4862871e0e77c6314e0c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:37.294288 28934 consensus_peers.cc:597] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 -> Peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Couldn't send request to peer 11ff4453d5684688997cb71f55cccc32. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:37.296274 17964 tablet_replica.cc:333] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.297093 17964 raft_consensus.cc:2243] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.297843 17964 raft_consensus.cc:2272] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.299850 17964 tablet_replica.cc:333] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.300318 17964 raft_consensus.cc:2243] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.300707 17964 raft_consensus.cc:2272] T 219494f6cc934fc88823c3632f8e3526 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.302711 17964 tablet_replica.cc:333] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.303184 17964 raft_consensus.cc:2243] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.303875 17964 raft_consensus.cc:2272] T 429ac41e709040e998620c3a56a58850 P 11ff4453d5684688997cb71f55cccc32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.306237 17964 tablet_replica.cc:333] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.306842 17964 raft_consensus.cc:2243] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.307547 17964 raft_consensus.cc:2272] T 9a2ae21e44ea4b09a37018ccfe51012d P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.309893 17964 tablet_replica.cc:333] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.310724 17964 raft_consensus.cc:2243] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.311560 17964 raft_consensus.cc:2272] T e1c8f576269d4ed29c53a2796f2f8e0d P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.313704 17964 tablet_replica.cc:333] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.314424 17964 raft_consensus.cc:2243] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.315105 17964 raft_consensus.cc:2272] T 7b50b06233fe41c0a67cfa0d081cc140 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.317083 17964 tablet_replica.cc:333] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.317533 17964 raft_consensus.cc:2243] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.317868 17964 raft_consensus.cc:2272] T 5c50f0e89e544afba188260ee500d39c P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.320263 17964 tablet_replica.cc:333] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.320981 17964 raft_consensus.cc:2243] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.321549 17964 raft_consensus.cc:2272] T b7e7891141834dca92babab10936feef P 11ff4453d5684688997cb71f55cccc32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.323886 17964 tablet_replica.cc:333] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.324366 17964 raft_consensus.cc:2243] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.324810 17964 raft_consensus.cc:2272] T 35b4f5cead3f4f38854f8cb658043a5c P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.326881 17964 tablet_replica.cc:333] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32: stopping tablet replica
I20260709 13:22:37.327332 17964 raft_consensus.cc:2243] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.327806 17964 raft_consensus.cc:2272] T 9113e3ed155c482897a96e7e916fc938 P 11ff4453d5684688997cb71f55cccc32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.369546 17964 tablet_server.cc:196] TabletServer@127.17.139.1:0 shutdown complete.
I20260709 13:22:37.403720 17964 tablet_server.cc:179] TabletServer@127.17.139.2:0 shutting down...
I20260709 13:22:37.430604 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:37.431278 17964 tablet_replica.cc:333] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.431892 17964 raft_consensus.cc:2243] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.432399 17964 raft_consensus.cc:2272] T 724b577974364738b3f5dfd308dec95b P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.434404 17964 tablet_replica.cc:333] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.434993 17964 raft_consensus.cc:2243] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.435720 17964 raft_consensus.cc:2272] T 7c66185aca6b4b3c8210c61ac9b6a09f P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.437633 17964 tablet_replica.cc:333] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.438331 17964 raft_consensus.cc:2243] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.439353 17964 raft_consensus.cc:2272] T 861dcf06cce340dab580232182854959 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.442022 17964 tablet_replica.cc:333] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.442611 17964 raft_consensus.cc:2243] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.443379 17964 raft_consensus.cc:2272] T ddd380a58d404c148eafbc64a8f91c84 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.445431 17964 tablet_replica.cc:333] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.445984 17964 raft_consensus.cc:2243] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.446383 17964 raft_consensus.cc:2272] T e04c4746d8534435827a84740aad69d4 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.448251 17964 tablet_replica.cc:333] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.448843 17964 raft_consensus.cc:2243] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.449622 17964 raft_consensus.cc:2272] T aeeeaf8fbc5e43e6a37784a02f7ac391 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.452020 17964 tablet_replica.cc:333] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.452785 17964 raft_consensus.cc:2243] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.453253 17964 raft_consensus.cc:2272] T 9a2ae21e44ea4b09a37018ccfe51012d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.455207 17964 tablet_replica.cc:333] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.455683 17964 raft_consensus.cc:2243] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.456061 17964 raft_consensus.cc:2272] T 7506074b98eb4862871e0e77c6314e0c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.458465 17964 tablet_replica.cc:333] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.459304 17964 raft_consensus.cc:2243] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.459777 17964 raft_consensus.cc:2272] T e1c8f576269d4ed29c53a2796f2f8e0d P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.462347 17964 tablet_replica.cc:333] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
W20260709 13:22:37.462504 29008 consensus_peers.cc:597] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 -> Peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Couldn't send request to peer 11ff4453d5684688997cb71f55cccc32. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:37.463086 17964 raft_consensus.cc:2243] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.463634 17964 raft_consensus.cc:2272] T 7b50b06233fe41c0a67cfa0d081cc140 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.465562 17964 tablet_replica.cc:333] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.466086 17964 raft_consensus.cc:2243] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.466472 17964 raft_consensus.cc:2272] T 5c50f0e89e544afba188260ee500d39c P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.468783 17964 tablet_replica.cc:333] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.469355 17964 raft_consensus.cc:2243] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.469794 17964 raft_consensus.cc:2272] T b7e7891141834dca92babab10936feef P a3dcaa525ce54903a0606732f37b73e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.471732 17964 tablet_replica.cc:333] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.472208 17964 raft_consensus.cc:2243] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.473019 17964 raft_consensus.cc:2272] T 9113e3ed155c482897a96e7e916fc938 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.474987 17964 tablet_replica.cc:333] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.475449 17964 raft_consensus.cc:2243] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.476148 17964 raft_consensus.cc:2272] T 35b4f5cead3f4f38854f8cb658043a5c P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.478070 17964 tablet_replica.cc:333] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.478567 17964 raft_consensus.cc:2243] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.478922 17964 raft_consensus.cc:2272] T 6817e34308ca436cb9d321894e5d64e9 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.480726 17964 tablet_replica.cc:333] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.481262 17964 raft_consensus.cc:2243] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.481675 17964 raft_consensus.cc:2272] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.483594 17964 tablet_replica.cc:333] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.484310 17964 raft_consensus.cc:2243] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.485973 17964 raft_consensus.cc:2272] T 219494f6cc934fc88823c3632f8e3526 P a3dcaa525ce54903a0606732f37b73e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.487905 17964 tablet_replica.cc:333] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9: stopping tablet replica
I20260709 13:22:37.488374 17964 raft_consensus.cc:2243] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.488794 17964 raft_consensus.cc:2272] T 429ac41e709040e998620c3a56a58850 P a3dcaa525ce54903a0606732f37b73e9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:37.520934 29008 consensus_peers.cc:597] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 -> Peer 11ff4453d5684688997cb71f55cccc32 (127.17.139.1:37935): Couldn't send request to peer 11ff4453d5684688997cb71f55cccc32. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.1:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:37.531311 17964 tablet_server.cc:196] TabletServer@127.17.139.2:0 shutdown complete.
W20260709 13:22:37.544564 29007 consensus_peers.cc:597] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 -> Peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Couldn't send request to peer a3dcaa525ce54903a0606732f37b73e9. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:43357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:37.564458 17964 tablet_server.cc:179] TabletServer@127.17.139.3:0 shutting down...
W20260709 13:22:37.585734 29007 consensus_peers.cc:597] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 -> Peer a3dcaa525ce54903a0606732f37b73e9 (127.17.139.2:43357): Couldn't send request to peer a3dcaa525ce54903a0606732f37b73e9. Status: Network error: Client connection negotiation failed: client connection to 127.17.139.2:43357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:37.592199 17964 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:37.593020 17964 tablet_replica.cc:333] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.593683 17964 raft_consensus.cc:2243] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.594456 17964 raft_consensus.cc:2272] T 724b577974364738b3f5dfd308dec95b P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.596383 17964 tablet_replica.cc:333] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.597095 17964 raft_consensus.cc:2243] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.597524 17964 raft_consensus.cc:2272] T 7c66185aca6b4b3c8210c61ac9b6a09f P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.599406 17964 tablet_replica.cc:333] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.599972 17964 raft_consensus.cc:2243] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.600416 17964 raft_consensus.cc:2272] T aeeeaf8fbc5e43e6a37784a02f7ac391 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.602422 17964 tablet_replica.cc:333] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.602978 17964 raft_consensus.cc:2243] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.603401 17964 raft_consensus.cc:2272] T 6817e34308ca436cb9d321894e5d64e9 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.605401 17964 tablet_replica.cc:333] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.605955 17964 raft_consensus.cc:2243] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.606410 17964 raft_consensus.cc:2272] T ddd380a58d404c148eafbc64a8f91c84 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.608294 17964 tablet_replica.cc:333] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.608816 17964 raft_consensus.cc:2243] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.609282 17964 raft_consensus.cc:2272] T 861dcf06cce340dab580232182854959 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.611253 17964 tablet_replica.cc:333] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.611714 17964 raft_consensus.cc:2243] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.612082 17964 raft_consensus.cc:2272] T e04c4746d8534435827a84740aad69d4 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.613919 17964 tablet_replica.cc:333] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.614382 17964 raft_consensus.cc:2243] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.614745 17964 raft_consensus.cc:2272] T 7b50b06233fe41c0a67cfa0d081cc140 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.616533 17964 tablet_replica.cc:333] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.617095 17964 raft_consensus.cc:2243] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.617791 17964 raft_consensus.cc:2272] T 5c50f0e89e544afba188260ee500d39c P f2ce0eedd00d45a192030ea417d443b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.620635 17964 tablet_replica.cc:333] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.621217 17964 raft_consensus.cc:2243] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.621971 17964 raft_consensus.cc:2272] T b7e7891141834dca92babab10936feef P f2ce0eedd00d45a192030ea417d443b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.623992 17964 tablet_replica.cc:333] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.624495 17964 raft_consensus.cc:2243] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.624861 17964 raft_consensus.cc:2272] T 219494f6cc934fc88823c3632f8e3526 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.626958 17964 tablet_replica.cc:333] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.627434 17964 raft_consensus.cc:2243] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.627947 17964 raft_consensus.cc:2272] T bc2bbfeb3c8a4a9fb64bb4fbf2f8ae52 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.629995 17964 tablet_replica.cc:333] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.630522 17964 raft_consensus.cc:2243] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.630937 17964 raft_consensus.cc:2272] T 429ac41e709040e998620c3a56a58850 P f2ce0eedd00d45a192030ea417d443b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.632802 17964 tablet_replica.cc:333] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.633337 17964 raft_consensus.cc:2243] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.633785 17964 raft_consensus.cc:2272] T 35b4f5cead3f4f38854f8cb658043a5c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.635707 17964 tablet_replica.cc:333] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.636193 17964 raft_consensus.cc:2243] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.636632 17964 raft_consensus.cc:2272] T 9113e3ed155c482897a96e7e916fc938 P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.638476 17964 tablet_replica.cc:333] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.638921 17964 raft_consensus.cc:2243] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.639328 17964 raft_consensus.cc:2272] T 9a2ae21e44ea4b09a37018ccfe51012d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.641161 17964 tablet_replica.cc:333] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.641608 17964 raft_consensus.cc:2243] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:37.641999 17964 raft_consensus.cc:2272] T e1c8f576269d4ed29c53a2796f2f8e0d P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.643877 17964 tablet_replica.cc:333] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5: stopping tablet replica
I20260709 13:22:37.644387 17964 raft_consensus.cc:2243] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.645264 17964 raft_consensus.cc:2272] T 7506074b98eb4862871e0e77c6314e0c P f2ce0eedd00d45a192030ea417d443b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.683720 17964 tablet_server.cc:196] TabletServer@127.17.139.3:0 shutdown complete.
I20260709 13:22:37.715179 17964 master.cc:562] Master@127.17.139.62:35973 shutting down...
I20260709 13:22:37.736641 17964 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:37.737205 17964 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:37.737496 17964 tablet_replica.cc:333] T 00000000000000000000000000000000 P aad5cf689a6b4c6cab1bf72846e1ea1d: stopping tablet replica
I20260709 13:22:37.757779 17964 master.cc:584] Master@127.17.139.62:35973 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11219 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23112 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (304429 ms total)
[  PASSED  ] 8 tests.
I20260709 13:22:37.813057 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 396 messages since previous log ~14 seconds ago
I20260709 13:22:37.813293 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 400 messages since previous log ~14 seconds ago
I20260709 13:22:37.813475 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 400 messages since previous log ~14 seconds ago
I20260709 13:22:37.813689 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:22:37.813879 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:22:37.814078 17964 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 4 messages since previous log ~148 seconds ago
I20260709 13:22:37.814275 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 4 messages since previous log ~148 seconds ago
I20260709 13:22:37.814487 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~146 seconds ago
I20260709 13:22:37.814735 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 13:22:37.815033 17964 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
